Jul 19 14:46:33.952932 ip-10-0-139-202 systemd[1]: Starting Kubernetes Kubelet... Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.444066 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453454 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453465 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453468 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453471 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453474 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453477 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453480 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 14:46:34.480527 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453483 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453486 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453489 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453492 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453494 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453497 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453500 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453503 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453506 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453510 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453513 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453516 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453525 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453528 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453531 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453534 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453537 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453540 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453543 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453545 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 14:46:34.483032 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453548 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453551 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453554 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453557 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453560 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453562 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453568 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453572 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453574 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453579 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453582 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453585 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453589 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453594 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453596 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453599 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453602 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453604 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453607 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 14:46:34.484734 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453609 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453612 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453615 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453617 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453620 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453624 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453626 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453630 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453633 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453635 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453638 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453641 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453643 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453646 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453648 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453652 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453668 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453671 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453674 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453677 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 14:46:34.486890 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453679 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453682 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453685 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453688 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453690 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453694 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453697 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453699 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453702 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453704 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453707 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453709 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453712 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453714 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453717 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453720 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453722 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453725 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453728 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453730 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 14:46:34.489894 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453734 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453737 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453740 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453742 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453745 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453747 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453750 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453752 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453755 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453758 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453761 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453763 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.453766 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454436 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454441 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454445 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454447 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454450 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454454 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454456 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 14:46:34.492114 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454459 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454461 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454464 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454467 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454469 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454472 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454474 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454477 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454479 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454482 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454484 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454487 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454491 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454496 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454500 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454503 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454506 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454509 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454512 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454515 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 14:46:34.493947 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454517 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454520 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454522 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454525 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454529 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454532 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454535 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454537 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454540 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454542 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454545 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454548 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454551 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454554 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454556 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454559 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454562 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454564 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454567 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 14:46:34.496261 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454569 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454572 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454575 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454577 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454581 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454585 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454588 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454591 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454594 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454597 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454599 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454602 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454605 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454608 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454611 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454614 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454616 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454619 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454622 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 14:46:34.498445 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454624 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454627 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454630 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454632 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454635 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454637 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454640 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454643 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454645 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454649 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454652 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454671 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454674 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454677 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454682 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454684 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454687 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454689 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454692 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454695 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 14:46:34.500899 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454697 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454700 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454702 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454705 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454708 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454711 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454713 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454718 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454721 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454723 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454725 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454728 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454730 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.454733 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455064 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455069 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455071 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455074 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455077 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455080 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 14:46:34.502746 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455083 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455086 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455088 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455091 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455093 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455096 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455100 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455103 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455106 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455109 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455111 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455114 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455116 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455118 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455121 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455124 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455126 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455129 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455132 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455137 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 14:46:34.505095 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455139 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455142 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455144 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455147 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455149 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455152 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455155 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455157 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455160 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455162 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455167 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455171 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455174 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455177 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455180 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455183 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455186 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455189 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455194 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 14:46:34.511408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455196 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455199 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455202 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455205 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455207 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455210 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455213 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455216 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455219 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455221 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455224 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455227 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455231 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455233 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455236 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455238 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455241 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455244 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455247 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455249 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 14:46:34.513480 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455251 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455254 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455256 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455259 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455261 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455265 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455267 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455270 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455272 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455275 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455277 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455282 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455284 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455287 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455290 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455292 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455296 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455298 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455301 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455303 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 14:46:34.515202 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455307 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455310 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455313 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455316 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455320 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455322 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455325 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455327 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455330 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455333 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455336 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455338 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455341 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.455343 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455412 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455418 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455424 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455428 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455433 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455436 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455440 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 19 14:46:34.517478 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455445 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455448 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455452 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455456 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455459 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455462 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455465 2580 flags.go:64] FLAG: --cgroup-root="" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455467 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455470 2580 flags.go:64] FLAG: --client-ca-file="" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455473 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455476 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455480 2580 flags.go:64] FLAG: --cluster-domain="" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455482 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455486 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455489 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455493 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455496 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455499 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455503 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455506 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455509 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455512 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455514 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455518 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 19 14:46:34.523426 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455521 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455525 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455528 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455531 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455533 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455536 2580 flags.go:64] FLAG: --enable-server="true" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455540 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455544 2580 flags.go:64] FLAG: --event-burst="100" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455547 2580 flags.go:64] FLAG: --event-qps="50" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455550 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455554 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455557 2580 flags.go:64] FLAG: --eviction-hard="" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455561 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455564 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455567 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455570 2580 flags.go:64] FLAG: --eviction-soft="" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455573 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455576 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455579 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455581 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455584 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455587 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455590 2580 flags.go:64] FLAG: --feature-gates="" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455599 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455602 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 19 14:46:34.526046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455605 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455608 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455612 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455615 2580 flags.go:64] FLAG: --help="false" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455618 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-139-202.ec2.internal" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455621 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455624 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455627 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455630 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455633 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455636 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455639 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455641 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455644 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455652 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455672 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455675 2580 flags.go:64] FLAG: --kube-reserved="" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455679 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455682 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455685 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455688 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455691 2580 flags.go:64] FLAG: --lock-file="" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455694 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455696 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 19 14:46:34.528365 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455700 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455705 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455708 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455711 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455713 2580 flags.go:64] FLAG: --logging-format="text" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455716 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455721 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455724 2580 flags.go:64] FLAG: --manifest-url="" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455727 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455731 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455734 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455738 2580 flags.go:64] FLAG: --max-pods="110" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455741 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455744 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455746 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455750 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455753 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455756 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455758 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455765 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455768 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455771 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455774 2580 flags.go:64] FLAG: --pod-cidr="" Jul 19 14:46:34.531165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455780 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455787 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455791 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455794 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455797 2580 flags.go:64] FLAG: --port="10250" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455799 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455802 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-048ffa8d00cf27877" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455805 2580 flags.go:64] FLAG: --qos-reserved="" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455808 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455811 2580 flags.go:64] FLAG: --register-node="true" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455814 2580 flags.go:64] FLAG: --register-with-taints="" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455818 2580 flags.go:64] FLAG: --registry-burst="10" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455820 2580 flags.go:64] FLAG: --registry-qps="5" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455823 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455826 2580 flags.go:64] FLAG: --reserved-memory="" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455829 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455834 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455837 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455840 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455843 2580 flags.go:64] FLAG: --runonce="false" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455846 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455849 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455852 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455854 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455857 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455860 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 19 14:46:34.758998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455863 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 19 14:46:34.533147 ip-10-0-139-202 systemd[1]: Started Kubernetes Kubelet. Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455866 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455869 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455872 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455875 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455877 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455881 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455884 2580 flags.go:64] FLAG: --system-cgroups="" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455888 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455893 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455896 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455899 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455903 2580 flags.go:64] FLAG: --tls-min-version="" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455905 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455908 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455911 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455914 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455917 2580 flags.go:64] FLAG: --v="2" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455920 2580 flags.go:64] FLAG: --version="false" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455924 2580 flags.go:64] FLAG: --vmodule="" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455927 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.455931 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456039 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456043 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 14:46:34.781690 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456046 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456049 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456052 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456055 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456058 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456060 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456063 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456066 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456069 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456072 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456075 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456077 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456080 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456084 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456086 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456089 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456102 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456105 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456108 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456111 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 14:46:34.793283 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456113 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456116 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456118 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456121 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456124 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456126 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456129 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456131 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456133 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456136 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456140 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456143 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456145 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456148 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456170 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456174 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456178 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456181 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456184 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 14:46:34.794106 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456187 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456190 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456194 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456198 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456201 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456204 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456206 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456209 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456212 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456217 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456220 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456223 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456225 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456228 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456230 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456233 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456235 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456238 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456240 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 14:46:34.794731 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456243 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456245 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456248 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456250 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456255 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456257 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456260 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456262 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456265 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456268 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456270 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456273 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456275 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456278 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456281 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456283 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456286 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456289 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456292 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456294 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 14:46:34.795367 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456297 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456299 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456305 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456308 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456312 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456315 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456318 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456320 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456323 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456326 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456328 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456331 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456334 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456337 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456340 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456342 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456347 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456350 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 19 14:46:34.795987 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.456353 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.457104 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.465402 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.465416 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.466332 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.466342 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466411 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466420 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466425 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466429 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466434 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466439 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466443 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466448 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466452 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 19 14:46:34.796569 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466456 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466460 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466464 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466468 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466474 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466480 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466485 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466489 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466494 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466498 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466501 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466506 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466512 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466517 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466522 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466526 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466530 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466534 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466538 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 14:46:34.797076 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466542 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466546 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466550 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466554 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466558 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466562 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466565 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466569 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466573 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466577 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466581 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466585 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466589 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466593 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466596 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466600 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466604 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466608 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466612 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466616 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 14:46:34.797680 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466620 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466623 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466627 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466634 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466638 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466642 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466645 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466649 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466669 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466674 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466678 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466682 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466686 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466690 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466694 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466698 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466701 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466705 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466709 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466713 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 14:46:34.798296 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466716 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466723 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466726 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466730 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466734 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466738 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466741 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466745 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466749 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466752 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466756 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466760 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466763 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466767 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466771 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466777 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466781 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466785 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466788 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 14:46:34.798957 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466793 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466797 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466801 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466805 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466811 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466816 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466821 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466824 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466829 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466833 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466837 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466841 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.466848 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.466999 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 19 14:46:34.799509 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467008 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467012 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467016 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467020 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467025 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467029 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467033 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467036 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467041 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467044 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467048 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467052 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467057 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467060 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467065 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467070 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467074 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467078 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467082 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 19 14:46:34.800034 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467088 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467092 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467098 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467102 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467108 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467113 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467118 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467122 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467127 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467132 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467135 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467139 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467143 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467148 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467152 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467155 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467161 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467165 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467169 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 19 14:46:34.800619 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467174 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467178 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467182 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467185 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467189 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467193 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467197 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467201 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467205 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467212 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467216 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467220 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467223 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467227 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467230 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467234 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467239 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467243 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467247 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467250 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 19 14:46:34.801205 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467254 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467258 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467262 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467266 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467270 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467273 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467278 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467283 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467286 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467290 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467293 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467297 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467301 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467304 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467307 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467309 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467312 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467314 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467317 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467319 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 19 14:46:34.801770 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467322 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467326 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467328 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467331 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467334 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467336 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467339 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467341 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467344 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467347 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467349 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467352 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467354 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467357 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467359 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467363 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467366 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467368 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467372 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 19 14:46:34.802348 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:34.467374 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.467380 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.467497 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.472927 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.474709 2580 server.go:1019] "Starting client certificate rotation" Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.474812 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.474844 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.478637 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.484026 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.498623 2580 log.go:25] "Validated CRI v1 runtime API" Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.501527 2580 log.go:25] "Validated CRI v1 image API" Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.502718 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 19 14:46:34.802880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.505236 2580 fs.go:135] Filesystem UUIDs: map[3630220b-1dcb-46de-9ac4-c523b040da7a:/dev/nvme0n1p3 38d4c709-e360-4056-9959-4097fc8c826d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 19 14:46:34.803259 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.505250 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 19 14:46:34.803259 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.508520 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.510365 2580 manager.go:216] Machine: {Timestamp:2026-07-19 14:46:34.508994333 +0000 UTC m=+0.388460138 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090132 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26256f99a9ad663d44a8d040e43bc6 SystemUUID:ec26256f-99a9-ad66-3d44-a8d040e43bc6 BootID:9e432838-e1ed-425a-830c-907ef8f6ad9f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:65:db:11:b8:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:65:db:11:b8:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:08:e5:bc:51:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.510494 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.510577 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.511920 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.511942 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.512850 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.512859 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.512867 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.513652 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.516418 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.521050 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.521170 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.521197 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.521206 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.521216 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.521225 2580 kubelet.go:398] "Adding apiserver pod source" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.521234 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 19 14:46:34.803457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.521531 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.521546 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.523911 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.526301 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.526407 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.527070 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.527089 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.527100 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.527117 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.527129 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.527138 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.527373 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.527382 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.527393 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.527402 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.528310 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.528335 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.529089 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.529112 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.532491 2580 server.go:1268] "Started kubelet" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.532922 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.532973 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.533123 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.533764 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.533848 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.533953 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.534519 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.535122 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.539505 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.541935 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.541947 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.542068 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.542524 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.542691 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.542702 2580 factory.go:55] Registering systemd factory Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.542707 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.542715 2580 factory.go:223] Registration of the systemd container factory successfully Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.542784 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.542794 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.542950 2580 factory.go:153] Registering CRI-O factory Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.542964 2580 factory.go:223] Registration of the crio container factory successfully Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.543011 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.543033 2580 factory.go:103] Registering Raw factory Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.543049 2580 manager.go:1196] Started watching for new ooms in manager Jul 19 14:46:34.931859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.543463 2580 manager.go:349] Starting recovery of all containers Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.542589 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-202.ec2.internal.18c3b83033991c71 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-202.ec2.internal,UID:ip-10-0-139-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-202.ec2.internal,},FirstTimestamp:2026-07-19 14:46:34.532461681 +0000 UTC m=+0.411927486,LastTimestamp:2026-07-19 14:46:34.532461681 +0000 UTC m=+0.411927486,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-202.ec2.internal,}" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.544998 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.545048 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.554112 2580 manager.go:354] Recovery completed Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.554499 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6w7df" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.559006 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.559060 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6w7df" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.560774 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientMemory" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.560800 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.560809 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientPID" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.561228 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.561237 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.561242 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.561252 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.562195 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientMemory" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.562219 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.562232 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientPID" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.563204 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-202.ec2.internal.18c3b8303549536b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-202.ec2.internal,UID:ip-10-0-139-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-202.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-202.ec2.internal,},FirstTimestamp:2026-07-19 14:46:34.560787307 +0000 UTC m=+0.440253111,LastTimestamp:2026-07-19 14:46:34.560787307 +0000 UTC m=+0.440253111,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-202.ec2.internal,}" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.565526 2580 policy_none.go:49] "None policy: Start" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.565550 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.565560 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.567500 2580 policy_none.go:47] "Start" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.614751 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.615893 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.615927 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.615948 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.615976 2580 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.617917 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.619279 2580 manager.go:337] "Starting Device Plugin manager" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.619301 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.619311 2580 server.go:87] "Starting device plugin registration server" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.619512 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 19 14:46:34.933082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.619521 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.619608 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.619695 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.619704 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.620047 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.620092 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.716861 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal"] Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.716923 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.717689 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientMemory" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.717711 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.717726 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientPID" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.719814 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.719881 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.719966 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.719985 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.720937 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientMemory" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.720953 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientMemory" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.720953 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientMemory" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.720990 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.720999 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientPID" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.720959 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.721036 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientPID" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.720975 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.721140 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientPID" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.721172 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-202.ec2.internal" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.723078 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.723099 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.723718 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientMemory" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.723738 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasNoDiskPressure" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.723747 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeHasSufficientPID" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.730825 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-202.ec2.internal" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.730842 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-202.ec2.internal\": node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.744666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d396f8c2e6f8349d1d0a007818a026a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal\" (UID: \"6d396f8c2e6f8349d1d0a007818a026a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.744687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2f86c374327211bfdc0d050c53cf8a9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-202.ec2.internal\" (UID: \"a2f86c374327211bfdc0d050c53cf8a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.744703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d396f8c2e6f8349d1d0a007818a026a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal\" (UID: \"6d396f8c2e6f8349d1d0a007818a026a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" Jul 19 14:46:34.934765 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.761224 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.766082 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-202.ec2.internal\" not found" node="ip-10-0-139-202.ec2.internal" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.770310 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-202.ec2.internal\" not found" node="ip-10-0-139-202.ec2.internal" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.845674 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d396f8c2e6f8349d1d0a007818a026a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal\" (UID: \"6d396f8c2e6f8349d1d0a007818a026a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.845696 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d396f8c2e6f8349d1d0a007818a026a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal\" (UID: \"6d396f8c2e6f8349d1d0a007818a026a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.845713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2f86c374327211bfdc0d050c53cf8a9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-202.ec2.internal\" (UID: \"a2f86c374327211bfdc0d050c53cf8a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.845749 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d396f8c2e6f8349d1d0a007818a026a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal\" (UID: \"6d396f8c2e6f8349d1d0a007818a026a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.845756 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d396f8c2e6f8349d1d0a007818a026a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal\" (UID: \"6d396f8c2e6f8349d1d0a007818a026a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:34.845787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2f86c374327211bfdc0d050c53cf8a9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-202.ec2.internal\" (UID: \"a2f86c374327211bfdc0d050c53cf8a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.861770 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:34.962100 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:35.062556 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:35.075255 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:35.068703 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" Jul 19 14:46:35.080671 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:35.080259 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal" Jul 19 14:46:35.180166 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:35.164143 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:35.303610 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:35.264677 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:35.467115 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:35.365132 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:35.467115 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:35.374185 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 14:46:35.467115 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:35.466187 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:35.588283 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:35.474334 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 19 14:46:35.588283 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:35.474432 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 19 14:46:35.588283 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:35.474450 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 19 14:46:35.588283 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:35.507028 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 14:46:35.588283 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:35.567245 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:35.588283 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:35.567236 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-18 14:41:35 +0000 UTC" deadline="2028-03-06 18:54:42.443843246 +0000 UTC" Jul 19 14:46:35.588283 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:35.567278 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14308h8m6.876569347s" Jul 19 14:46:36.876570 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:35.667818 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:36.981453 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:36.934139 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-202.ec2.internal\" not found" Jul 19 14:46:36.981453 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:36.938429 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 14:46:37.137836 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.007449 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal" Jul 19 14:46:37.137836 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:37.009560 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f86c374327211bfdc0d050c53cf8a9.slice/crio-4bd58a28a5764b04d2852cf065ee6696af7ef8870254d32b5e5567dea0f24471 WatchSource:0}: Error finding container 4bd58a28a5764b04d2852cf065ee6696af7ef8870254d32b5e5567dea0f24471: Status 404 returned error can't find the container with id 4bd58a28a5764b04d2852cf065ee6696af7ef8870254d32b5e5567dea0f24471 Jul 19 14:46:37.137836 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:37.009799 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d396f8c2e6f8349d1d0a007818a026a.slice/crio-e52064d475516e1053f6cd2eec63d0a2cb03abc2a0b6003c330e5bc0b4cff0a4 WatchSource:0}: Error finding container e52064d475516e1053f6cd2eec63d0a2cb03abc2a0b6003c330e5bc0b4cff0a4: Status 404 returned error can't find the container with id e52064d475516e1053f6cd2eec63d0a2cb03abc2a0b6003c330e5bc0b4cff0a4 Jul 19 14:46:37.137836 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.018274 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 19 14:46:37.137836 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.019239 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" Jul 19 14:46:37.137836 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.019690 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 19 14:46:37.137836 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.029844 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.687657 2580 apiserver.go:52] "Watching apiserver" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.694563 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.694947 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rfcg5","openshift-ovn-kubernetes/ovnkube-node-rmwrk","kube-system/global-pull-secret-syncer-rx596","kube-system/konnectivity-agent-hwqs4","kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q","openshift-dns/node-resolver-fmxxg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal","openshift-multus/multus-additional-cni-plugins-fmvzq","openshift-network-diagnostics/network-check-target-5j8td","openshift-cluster-node-tuning-operator/tuned-64x7r","openshift-image-registry/node-ca-rhrjr","openshift-multus/multus-chqvj","openshift-multus/network-metrics-daemon-r28nx"] Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.697489 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.699652 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.699868 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.699974 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.700060 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.700240 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.700259 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-chv22\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.700439 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.700506 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.702552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.702609 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.704691 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.706800 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.706917 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-55krb\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.707038 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.707199 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.708531 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.709450 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.709738 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.709800 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.709985 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.710207 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8tv67\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.712005 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.712171 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.712249 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-248vh\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.712329 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.714701 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.715210 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5pjq4\"" Jul 19 14:46:37.718992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.715299 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 19 14:46:37.720642 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.715389 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 19 14:46:37.720642 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.716679 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:37.720642 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.716733 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:37.720642 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.717559 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 19 14:46:37.720642 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.719141 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.722411 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.721063 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 19 14:46:37.722411 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.721289 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 19 14:46:37.722411 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.721494 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2whms\"" Jul 19 14:46:37.722411 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.721730 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.723691 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724184 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724243 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724372 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724447 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hh2kr\"" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724510 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwjhd\" (UniqueName: \"kubernetes.io/projected/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-kube-api-access-nwjhd\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-sys-fs\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b-hosts-file\") pod \"node-resolver-fmxxg\" (UID: \"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b\") " pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b-tmp-dir\") pod \"node-resolver-fmxxg\" (UID: \"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b\") " pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724633 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw25z\" (UniqueName: \"kubernetes.io/projected/2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b-kube-api-access-xw25z\") pod \"node-resolver-fmxxg\" (UID: \"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b\") " pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-os-release\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724679 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v574l\" (UniqueName: \"kubernetes.io/projected/3467f795-87e7-46aa-821b-f854cdc83634-kube-api-access-v574l\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f1b180a8-170f-4693-b6ba-291db25b3a46-agent-certs\") pod \"konnectivity-agent-hwqs4\" (UID: \"f1b180a8-170f-4693-b6ba-291db25b3a46\") " pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724760 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-socket-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-registration-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8zrp\" (UniqueName: \"kubernetes.io/projected/4c1226ef-c4d5-4e24-a5dc-065a940c000a-kube-api-access-s8zrp\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.724935 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724871 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dz9d\" (UniqueName: \"kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d\") pod \"network-check-target-5j8td\" (UID: \"6552ac5c-c770-46e7-a793-412892a6d1a1\") " pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-system-cni-dir\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-cnibin\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.724986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.725005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f1b180a8-170f-4693-b6ba-291db25b3a46-konnectivity-ca\") pod \"konnectivity-agent-hwqs4\" (UID: \"f1b180a8-170f-4693-b6ba-291db25b3a46\") " pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.725041 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-device-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.725062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.725084 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.725629 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.725936 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8z8f8\"" Jul 19 14:46:37.727333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.726216 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.728801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.728584 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 19 14:46:37.728801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.728601 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 19 14:46:37.728801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.728619 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 19 14:46:37.728801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.728667 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 19 14:46:37.728801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.728678 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bm5qs\"" Jul 19 14:46:37.728801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.728619 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 19 14:46:37.728801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.728619 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 19 14:46:37.741133 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.740880 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pr8ml" Jul 19 14:46:37.751265 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.751223 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pr8ml" Jul 19 14:46:37.796169 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.796130 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal" event={"ID":"a2f86c374327211bfdc0d050c53cf8a9","Type":"ContainerStarted","Data":"4bd58a28a5764b04d2852cf065ee6696af7ef8870254d32b5e5567dea0f24471"} Jul 19 14:46:37.798747 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.798708 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" event={"ID":"6d396f8c2e6f8349d1d0a007818a026a","Type":"ContainerStarted","Data":"e52064d475516e1053f6cd2eec63d0a2cb03abc2a0b6003c330e5bc0b4cff0a4"} Jul 19 14:46:37.810743 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.810716 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 19 14:46:37.826231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826205 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b-tmp-dir\") pod \"node-resolver-fmxxg\" (UID: \"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b\") " pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:37.826327 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw25z\" (UniqueName: \"kubernetes.io/projected/2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b-kube-api-access-xw25z\") pod \"node-resolver-fmxxg\" (UID: \"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b\") " pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:37.826327 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-ovn-node-metrics-cert\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.826327 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826297 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-ovnkube-script-lib\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.826480 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v574l\" (UniqueName: \"kubernetes.io/projected/3467f795-87e7-46aa-821b-f854cdc83634-kube-api-access-v574l\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:37.826480 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f1b180a8-170f-4693-b6ba-291db25b3a46-agent-certs\") pod \"konnectivity-agent-hwqs4\" (UID: \"f1b180a8-170f-4693-b6ba-291db25b3a46\") " pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:46:37.826480 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826413 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rlpd\" (UniqueName: \"kubernetes.io/projected/2689c9af-0d4d-44ff-879d-99b31eff40b1-kube-api-access-6rlpd\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.826480 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826435 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73a5d9ce-871b-4fc8-8642-3f931640aa86-host\") pod \"node-ca-rhrjr\" (UID: \"73a5d9ce-871b-4fc8-8642-3f931640aa86\") " pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:37.826480 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-run-netns\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.826712 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-node-log\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.826712 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-ovnkube-config\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.826712 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826540 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b-tmp-dir\") pod \"node-resolver-fmxxg\" (UID: \"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b\") " pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:37.826712 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-sysctl-d\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.826712 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-sysctl-conf\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.826712 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-socket-dir-parent\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.826712 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826649 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-run-k8s-cni-cncf-io\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.827063 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-systemd-units\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.827063 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-run-openvswitch\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.827063 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.826977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-sysconfig\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.827063 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.827248 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b-hosts-file\") pod \"node-resolver-fmxxg\" (UID: \"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b\") " pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:37.827248 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-sys\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.827248 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1736e40e-e1dd-4786-a806-35f83a5ea6e8-iptables-alerter-script\") pod \"iptables-alerter-rfcg5\" (UID: \"1736e40e-e1dd-4786-a806-35f83a5ea6e8\") " pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:37.827248 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-conf-dir\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.827248 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827193 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-run-multus-certs\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.827248 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827224 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-socket-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.827531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827248 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b-hosts-file\") pod \"node-resolver-fmxxg\" (UID: \"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b\") " pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:37.827531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827271 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.827531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-socket-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.827531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1736e40e-e1dd-4786-a806-35f83a5ea6e8-host-slash\") pod \"iptables-alerter-rfcg5\" (UID: \"1736e40e-e1dd-4786-a806-35f83a5ea6e8\") " pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:37.827531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827441 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 19 14:46:37.827531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-os-release\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.827531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-var-lib-cni-bin\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-var-lib-kubelet\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827560 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-system-cni-dir\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827632 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-system-cni-dir\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-device-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827684 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-systemd\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be3f0910-7935-4f9d-bc8b-ac92026ecff8-dbus\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827758 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-device-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq9f7\" (UniqueName: \"kubernetes.io/projected/73a5d9ce-871b-4fc8-8642-3f931640aa86-kube-api-access-mq9f7\") pod \"node-ca-rhrjr\" (UID: \"73a5d9ce-871b-4fc8-8642-3f931640aa86\") " pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:37.827840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827823 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrvc9\" (UniqueName: \"kubernetes.io/projected/1736e40e-e1dd-4786-a806-35f83a5ea6e8-kube-api-access-zrvc9\") pod \"iptables-alerter-rfcg5\" (UID: \"1736e40e-e1dd-4786-a806-35f83a5ea6e8\") " pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-hostroot\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42cs2\" (UniqueName: \"kubernetes.io/projected/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-kube-api-access-42cs2\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-os-release\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-registration-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.827999 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8zrp\" (UniqueName: \"kubernetes.io/projected/4c1226ef-c4d5-4e24-a5dc-065a940c000a-kube-api-access-s8zrp\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828038 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-lib-modules\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-run-systemd\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-registration-dir\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828038 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-os-release\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-etc-openvswitch\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-log-socket\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828142 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-cni-netd\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828184 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dz9d\" (UniqueName: \"kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d\") pod \"network-check-target-5j8td\" (UID: \"6552ac5c-c770-46e7-a793-412892a6d1a1\") " pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:37.828477 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828259 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-modprobe-d\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-kubernetes\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828303 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-run\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828325 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-tuned\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828346 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be3f0910-7935-4f9d-bc8b-ac92026ecff8-kubelet-config\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f1b180a8-170f-4693-b6ba-291db25b3a46-konnectivity-ca\") pod \"konnectivity-agent-hwqs4\" (UID: \"f1b180a8-170f-4693-b6ba-291db25b3a46\") " pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-host\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828413 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-var-lib-openvswitch\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828435 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjz8\" (UniqueName: \"kubernetes.io/projected/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-kube-api-access-6vjz8\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-system-cni-dir\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-cni-dir\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828622 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-cni-binary-copy\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828697 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwjhd\" (UniqueName: \"kubernetes.io/projected/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-kube-api-access-nwjhd\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828719 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828723 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-var-lib-kubelet\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-daemon-config\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.829231 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-etc-kubernetes\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2689c9af-0d4d-44ff-879d-99b31eff40b1-tmp\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73a5d9ce-871b-4fc8-8642-3f931640aa86-serviceca\") pod \"node-ca-rhrjr\" (UID: \"73a5d9ce-871b-4fc8-8642-3f931640aa86\") " pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828877 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-kubelet\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828900 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-slash\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-run-ovn\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-run-netns\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.828993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f1b180a8-170f-4693-b6ba-291db25b3a46-konnectivity-ca\") pod \"konnectivity-agent-hwqs4\" (UID: \"f1b180a8-170f-4693-b6ba-291db25b3a46\") " pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829049 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-cni-bin\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-cnibin\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829100 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829139 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-cnibin\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:37.830087 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-cnibin\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.830844 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.829210 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:37.830844 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.830844 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.829276 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs podName:3467f795-87e7-46aa-821b-f854cdc83634 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:38.329257373 +0000 UTC m=+3.043369647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs") pod "network-metrics-daemon-r28nx" (UID: "3467f795-87e7-46aa-821b-f854cdc83634") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:37.830844 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-var-lib-cni-multus\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.830844 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-env-overrides\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.830844 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829360 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-sys-fs\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.830844 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.829463 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c1226ef-c4d5-4e24-a5dc-065a940c000a-sys-fs\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.832176 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.832156 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f1b180a8-170f-4693-b6ba-291db25b3a46-agent-certs\") pod \"konnectivity-agent-hwqs4\" (UID: \"f1b180a8-170f-4693-b6ba-291db25b3a46\") " pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:46:37.833506 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.833488 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 14:46:37.833584 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.833512 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 14:46:37.833584 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.833535 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8dz9d for pod openshift-network-diagnostics/network-check-target-5j8td: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:37.833692 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.833613 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d podName:6552ac5c-c770-46e7-a793-412892a6d1a1 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:38.333576145 +0000 UTC m=+3.047688416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8dz9d" (UniqueName: "kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d") pod "network-check-target-5j8td" (UID: "6552ac5c-c770-46e7-a793-412892a6d1a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:37.835507 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.835486 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8zrp\" (UniqueName: \"kubernetes.io/projected/4c1226ef-c4d5-4e24-a5dc-065a940c000a-kube-api-access-s8zrp\") pod \"aws-ebs-csi-driver-node-g7l6q\" (UID: \"4c1226ef-c4d5-4e24-a5dc-065a940c000a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:37.838055 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.837981 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwjhd\" (UniqueName: \"kubernetes.io/projected/2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c-kube-api-access-nwjhd\") pod \"multus-additional-cni-plugins-fmvzq\" (UID: \"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c\") " pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:37.838055 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.837981 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v574l\" (UniqueName: \"kubernetes.io/projected/3467f795-87e7-46aa-821b-f854cdc83634-kube-api-access-v574l\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:37.838319 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.838296 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw25z\" (UniqueName: \"kubernetes.io/projected/2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b-kube-api-access-xw25z\") pod \"node-resolver-fmxxg\" (UID: \"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b\") " pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:37.929766 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.929739 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73a5d9ce-871b-4fc8-8642-3f931640aa86-host\") pod \"node-ca-rhrjr\" (UID: \"73a5d9ce-871b-4fc8-8642-3f931640aa86\") " pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:37.929903 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.929778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-run-netns\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.929903 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.929802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-node-log\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.929903 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.929824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-ovnkube-config\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.929903 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.929848 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-sysctl-d\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.929903 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.929871 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-sysctl-conf\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.929903 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.929897 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-socket-dir-parent\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.929930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-run-k8s-cni-cncf-io\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.929953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-systemd-units\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.929976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-run-openvswitch\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-sysconfig\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930047 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-sys\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1736e40e-e1dd-4786-a806-35f83a5ea6e8-iptables-alerter-script\") pod \"iptables-alerter-rfcg5\" (UID: \"1736e40e-e1dd-4786-a806-35f83a5ea6e8\") " pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930093 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-conf-dir\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-run-multus-certs\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930142 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1736e40e-e1dd-4786-a806-35f83a5ea6e8-host-slash\") pod \"iptables-alerter-rfcg5\" (UID: \"1736e40e-e1dd-4786-a806-35f83a5ea6e8\") " pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930157 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-run-openvswitch\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-os-release\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-var-lib-cni-bin\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930197 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73a5d9ce-871b-4fc8-8642-3f931640aa86-host\") pod \"node-ca-rhrjr\" (UID: \"73a5d9ce-871b-4fc8-8642-3f931640aa86\") " pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-var-lib-kubelet\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-systemd\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930250 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-run-netns\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be3f0910-7935-4f9d-bc8b-ac92026ecff8-dbus\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:37.930872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930284 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-sysctl-conf\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9f7\" (UniqueName: \"kubernetes.io/projected/73a5d9ce-871b-4fc8-8642-3f931640aa86-kube-api-access-mq9f7\") pod \"node-ca-rhrjr\" (UID: \"73a5d9ce-871b-4fc8-8642-3f931640aa86\") " pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrvc9\" (UniqueName: \"kubernetes.io/projected/1736e40e-e1dd-4786-a806-35f83a5ea6e8-kube-api-access-zrvc9\") pod \"iptables-alerter-rfcg5\" (UID: \"1736e40e-e1dd-4786-a806-35f83a5ea6e8\") " pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-hostroot\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42cs2\" (UniqueName: \"kubernetes.io/projected/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-kube-api-access-42cs2\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930379 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-socket-dir-parent\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930382 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/be3f0910-7935-4f9d-bc8b-ac92026ecff8-dbus\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930396 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-lib-modules\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-run-systemd\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930431 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-sysconfig\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930430 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-systemd-units\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-etc-openvswitch\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930475 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-etc-openvswitch\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930493 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-sys\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930521 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-hostroot\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930646 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-node-log\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930149 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-sysctl-d\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930708 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-run-systemd\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.931759 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930753 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-conf-dir\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930763 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-run-multus-certs\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930799 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-lib-modules\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930813 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1736e40e-e1dd-4786-a806-35f83a5ea6e8-host-slash\") pod \"iptables-alerter-rfcg5\" (UID: \"1736e40e-e1dd-4786-a806-35f83a5ea6e8\") " pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-log-socket\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930847 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-os-release\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930863 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-var-lib-kubelet\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-cni-netd\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930894 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-log-socket\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930905 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-var-lib-cni-bin\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-modprobe-d\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930944 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-cni-netd\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930947 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-systemd\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930955 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-run-k8s-cni-cncf-io\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-kubernetes\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-kubernetes\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.930998 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-run\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931039 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-tuned\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.932655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931049 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1736e40e-e1dd-4786-a806-35f83a5ea6e8-iptables-alerter-script\") pod \"iptables-alerter-rfcg5\" (UID: \"1736e40e-e1dd-4786-a806-35f83a5ea6e8\") " pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931063 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-run\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931039 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-modprobe-d\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be3f0910-7935-4f9d-bc8b-ac92026ecff8-kubelet-config\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931157 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/be3f0910-7935-4f9d-bc8b-ac92026ecff8-kubelet-config\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931173 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-ovnkube-config\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-host\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-var-lib-openvswitch\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjz8\" (UniqueName: \"kubernetes.io/projected/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-kube-api-access-6vjz8\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-host\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-system-cni-dir\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-cni-dir\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931310 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-var-lib-openvswitch\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-cni-binary-copy\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931351 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-var-lib-kubelet\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931376 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-daemon-config\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-etc-kubernetes\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2689c9af-0d4d-44ff-879d-99b31eff40b1-tmp\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.933553 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73a5d9ce-871b-4fc8-8642-3f931640aa86-serviceca\") pod \"node-ca-rhrjr\" (UID: \"73a5d9ce-871b-4fc8-8642-3f931640aa86\") " pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931489 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-kubelet\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931499 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-system-cni-dir\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-slash\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931547 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-etc-kubernetes\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-run-ovn\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2689c9af-0d4d-44ff-879d-99b31eff40b1-var-lib-kubelet\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-run-netns\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931630 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931655 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-cni-bin\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931696 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931720 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-cnibin\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-var-lib-cni-multus\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-env-overrides\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-ovn-node-metrics-cert\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-ovnkube-script-lib\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.934441 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931826 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-cni-binary-copy\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.931871 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rlpd\" (UniqueName: \"kubernetes.io/projected/2689c9af-0d4d-44ff-879d-99b31eff40b1-kube-api-access-6rlpd\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932037 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-daemon-config\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932128 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-multus-cni-dir\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932177 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-run-netns\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932180 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-cnibin\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932215 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932263 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-kubelet\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932305 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-slash\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932318 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-ovnkube-script-lib\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932348 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-run-ovn\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932384 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-host-var-lib-cni-multus\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932401 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932472 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-host-cni-bin\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.932558 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:37.932606 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret podName:be3f0910-7935-4f9d-bc8b-ac92026ecff8 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:38.432589286 +0000 UTC m=+3.146701555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret") pod "global-pull-secret-syncer-rx596" (UID: "be3f0910-7935-4f9d-bc8b-ac92026ecff8") : object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.932720 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-env-overrides\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.935279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.933215 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73a5d9ce-871b-4fc8-8642-3f931640aa86-serviceca\") pod \"node-ca-rhrjr\" (UID: \"73a5d9ce-871b-4fc8-8642-3f931640aa86\") " pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:37.937149 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.934095 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2689c9af-0d4d-44ff-879d-99b31eff40b1-etc-tuned\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.937149 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.936352 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2689c9af-0d4d-44ff-879d-99b31eff40b1-tmp\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.937648 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.937624 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-ovn-node-metrics-cert\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.939664 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.939642 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9f7\" (UniqueName: \"kubernetes.io/projected/73a5d9ce-871b-4fc8-8642-3f931640aa86-kube-api-access-mq9f7\") pod \"node-ca-rhrjr\" (UID: \"73a5d9ce-871b-4fc8-8642-3f931640aa86\") " pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:37.939921 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.939899 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrvc9\" (UniqueName: \"kubernetes.io/projected/1736e40e-e1dd-4786-a806-35f83a5ea6e8-kube-api-access-zrvc9\") pod \"iptables-alerter-rfcg5\" (UID: \"1736e40e-e1dd-4786-a806-35f83a5ea6e8\") " pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:37.940874 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.940848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjz8\" (UniqueName: \"kubernetes.io/projected/300d5a7c-8baa-4f06-8e81-7d9fd4a080dc-kube-api-access-6vjz8\") pod \"ovnkube-node-rmwrk\" (UID: \"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:37.941670 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.941632 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42cs2\" (UniqueName: \"kubernetes.io/projected/38f88d2c-945f-40cc-9a22-5a2b6e31ad01-kube-api-access-42cs2\") pod \"multus-chqvj\" (UID: \"38f88d2c-945f-40cc-9a22-5a2b6e31ad01\") " pod="openshift-multus/multus-chqvj" Jul 19 14:46:37.941771 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.941751 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rlpd\" (UniqueName: \"kubernetes.io/projected/2689c9af-0d4d-44ff-879d-99b31eff40b1-kube-api-access-6rlpd\") pod \"tuned-64x7r\" (UID: \"2689c9af-0d4d-44ff-879d-99b31eff40b1\") " pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:37.948343 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:37.948323 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 14:46:38.008333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.008280 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" Jul 19 14:46:38.018558 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.018346 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:46:38.019763 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:38.019741 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5e74bc_ae0d_46ed_8b93_821aaf1aba8c.slice/crio-f2738092ac91060cfdbe0d6385af1d449bd547037c158780cfe278a81d1272e9 WatchSource:0}: Error finding container f2738092ac91060cfdbe0d6385af1d449bd547037c158780cfe278a81d1272e9: Status 404 returned error can't find the container with id f2738092ac91060cfdbe0d6385af1d449bd547037c158780cfe278a81d1272e9 Jul 19 14:46:38.026480 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.026462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" Jul 19 14:46:38.028885 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:38.028857 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b180a8_170f_4693_b6ba_291db25b3a46.slice/crio-5bbb5b0c51a078bb62106c7a4e3704a4bd0857736be810be161f84ef0bab5854 WatchSource:0}: Error finding container 5bbb5b0c51a078bb62106c7a4e3704a4bd0857736be810be161f84ef0bab5854: Status 404 returned error can't find the container with id 5bbb5b0c51a078bb62106c7a4e3704a4bd0857736be810be161f84ef0bab5854 Jul 19 14:46:38.031724 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.031633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fmxxg" Jul 19 14:46:38.037097 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:38.037070 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1226ef_c4d5_4e24_a5dc_065a940c000a.slice/crio-dbe4e1a61769d8c98570c6d89e52499520a091c1dfd3d7ca97c658b965986114 WatchSource:0}: Error finding container dbe4e1a61769d8c98570c6d89e52499520a091c1dfd3d7ca97c658b965986114: Status 404 returned error can't find the container with id dbe4e1a61769d8c98570c6d89e52499520a091c1dfd3d7ca97c658b965986114 Jul 19 14:46:38.042124 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:38.042097 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1fcdaa_1e73_4c4f_bea2_a7c02d7e376b.slice/crio-07509bd315d4b88c31f112a7b9e08decc7532ff3281f106727647fb25d5b29da WatchSource:0}: Error finding container 07509bd315d4b88c31f112a7b9e08decc7532ff3281f106727647fb25d5b29da: Status 404 returned error can't find the container with id 07509bd315d4b88c31f112a7b9e08decc7532ff3281f106727647fb25d5b29da Jul 19 14:46:38.047795 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.047775 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rfcg5" Jul 19 14:46:38.056764 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.056602 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-64x7r" Jul 19 14:46:38.059022 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:38.058971 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1736e40e_e1dd_4786_a806_35f83a5ea6e8.slice/crio-712678f2f5c87b0c424e4b8577f684af4f0d5fc6b2bcd54162189c610dba8fc0 WatchSource:0}: Error finding container 712678f2f5c87b0c424e4b8577f684af4f0d5fc6b2bcd54162189c610dba8fc0: Status 404 returned error can't find the container with id 712678f2f5c87b0c424e4b8577f684af4f0d5fc6b2bcd54162189c610dba8fc0 Jul 19 14:46:38.064237 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.064152 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rhrjr" Jul 19 14:46:38.069052 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:38.068997 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2689c9af_0d4d_44ff_879d_99b31eff40b1.slice/crio-30addf778ea3fad968176539c4b629a34a265237cf2ca52775244be726e7987a WatchSource:0}: Error finding container 30addf778ea3fad968176539c4b629a34a265237cf2ca52775244be726e7987a: Status 404 returned error can't find the container with id 30addf778ea3fad968176539c4b629a34a265237cf2ca52775244be726e7987a Jul 19 14:46:38.070494 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.070359 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-chqvj" Jul 19 14:46:38.075278 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:38.075258 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a5d9ce_871b_4fc8_8642_3f931640aa86.slice/crio-c9300c9e6d2770bd74b416fa1717bc0f5c51a776a63d4450ab4636247010a33b WatchSource:0}: Error finding container c9300c9e6d2770bd74b416fa1717bc0f5c51a776a63d4450ab4636247010a33b: Status 404 returned error can't find the container with id c9300c9e6d2770bd74b416fa1717bc0f5c51a776a63d4450ab4636247010a33b Jul 19 14:46:38.076707 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.076562 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:46:38.082505 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:38.082484 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f88d2c_945f_40cc_9a22_5a2b6e31ad01.slice/crio-f9cf582c5c0acb78b955e4cbb3647a7e083ff6e173cd5622ee17bbd34530f7c0 WatchSource:0}: Error finding container f9cf582c5c0acb78b955e4cbb3647a7e083ff6e173cd5622ee17bbd34530f7c0: Status 404 returned error can't find the container with id f9cf582c5c0acb78b955e4cbb3647a7e083ff6e173cd5622ee17bbd34530f7c0 Jul 19 14:46:38.088364 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:46:38.088333 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod300d5a7c_8baa_4f06_8e81_7d9fd4a080dc.slice/crio-681e31ccaafae8ed5609d4ccc7dd0b231af28825fabbfd3ca8d8a52e4d084f67 WatchSource:0}: Error finding container 681e31ccaafae8ed5609d4ccc7dd0b231af28825fabbfd3ca8d8a52e4d084f67: Status 404 returned error can't find the container with id 681e31ccaafae8ed5609d4ccc7dd0b231af28825fabbfd3ca8d8a52e4d084f67 Jul 19 14:46:38.334837 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.334753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dz9d\" (UniqueName: \"kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d\") pod \"network-check-target-5j8td\" (UID: \"6552ac5c-c770-46e7-a793-412892a6d1a1\") " pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:38.334837 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.334817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:38.335007 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:38.334947 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:38.335007 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:38.335004 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs podName:3467f795-87e7-46aa-821b-f854cdc83634 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:39.334986102 +0000 UTC m=+4.049098380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs") pod "network-metrics-daemon-r28nx" (UID: "3467f795-87e7-46aa-821b-f854cdc83634") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:38.335122 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:38.334946 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 14:46:38.335122 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:38.335065 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 14:46:38.335122 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:38.335086 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8dz9d for pod openshift-network-diagnostics/network-check-target-5j8td: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:38.335221 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:38.335162 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d podName:6552ac5c-c770-46e7-a793-412892a6d1a1 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:39.335148349 +0000 UTC m=+4.049260630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dz9d" (UniqueName: "kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d") pod "network-check-target-5j8td" (UID: "6552ac5c-c770-46e7-a793-412892a6d1a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:38.435318 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.435289 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:38.435494 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:38.435412 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:38.435494 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:38.435471 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret podName:be3f0910-7935-4f9d-bc8b-ac92026ecff8 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:39.435453989 +0000 UTC m=+4.149566246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret") pod "global-pull-secret-syncer-rx596" (UID: "be3f0910-7935-4f9d-bc8b-ac92026ecff8") : object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:38.756900 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.756784 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-18 14:41:37 +0000 UTC" deadline="2028-03-16 01:28:38.960454811 +0000 UTC" Jul 19 14:46:38.756900 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.756849 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14530h42m0.203610163s" Jul 19 14:46:38.782110 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.782089 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:38.782276 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.782089 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:38.782276 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:38.782188 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:38.782276 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:38.782261 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:38.801605 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.801580 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" event={"ID":"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc","Type":"ContainerStarted","Data":"681e31ccaafae8ed5609d4ccc7dd0b231af28825fabbfd3ca8d8a52e4d084f67"} Jul 19 14:46:38.802851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.802784 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-chqvj" event={"ID":"38f88d2c-945f-40cc-9a22-5a2b6e31ad01","Type":"ContainerStarted","Data":"f9cf582c5c0acb78b955e4cbb3647a7e083ff6e173cd5622ee17bbd34530f7c0"} Jul 19 14:46:38.803931 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.803905 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fmxxg" event={"ID":"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b","Type":"ContainerStarted","Data":"07509bd315d4b88c31f112a7b9e08decc7532ff3281f106727647fb25d5b29da"} Jul 19 14:46:38.804909 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.804886 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hwqs4" event={"ID":"f1b180a8-170f-4693-b6ba-291db25b3a46","Type":"ContainerStarted","Data":"5bbb5b0c51a078bb62106c7a4e3704a4bd0857736be810be161f84ef0bab5854"} Jul 19 14:46:38.806051 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.806032 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rhrjr" event={"ID":"73a5d9ce-871b-4fc8-8642-3f931640aa86","Type":"ContainerStarted","Data":"c9300c9e6d2770bd74b416fa1717bc0f5c51a776a63d4450ab4636247010a33b"} Jul 19 14:46:38.807307 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.807276 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-64x7r" event={"ID":"2689c9af-0d4d-44ff-879d-99b31eff40b1","Type":"ContainerStarted","Data":"30addf778ea3fad968176539c4b629a34a265237cf2ca52775244be726e7987a"} Jul 19 14:46:38.808451 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.808433 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rfcg5" event={"ID":"1736e40e-e1dd-4786-a806-35f83a5ea6e8","Type":"ContainerStarted","Data":"712678f2f5c87b0c424e4b8577f684af4f0d5fc6b2bcd54162189c610dba8fc0"} Jul 19 14:46:38.809497 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.809479 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" event={"ID":"4c1226ef-c4d5-4e24-a5dc-065a940c000a","Type":"ContainerStarted","Data":"dbe4e1a61769d8c98570c6d89e52499520a091c1dfd3d7ca97c658b965986114"} Jul 19 14:46:38.810517 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:38.810498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" event={"ID":"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c","Type":"ContainerStarted","Data":"f2738092ac91060cfdbe0d6385af1d449bd547037c158780cfe278a81d1272e9"} Jul 19 14:46:39.038286 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:39.038214 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 19 14:46:39.341204 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:39.341175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dz9d\" (UniqueName: \"kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d\") pod \"network-check-target-5j8td\" (UID: \"6552ac5c-c770-46e7-a793-412892a6d1a1\") " pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:39.341353 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:39.341246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:39.341417 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:39.341402 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:39.341472 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:39.341455 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs podName:3467f795-87e7-46aa-821b-f854cdc83634 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:41.341437386 +0000 UTC m=+6.055549644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs") pod "network-metrics-daemon-r28nx" (UID: "3467f795-87e7-46aa-821b-f854cdc83634") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:39.341955 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:39.341840 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 14:46:39.341955 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:39.341873 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 14:46:39.341955 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:39.341888 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8dz9d for pod openshift-network-diagnostics/network-check-target-5j8td: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:39.341955 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:39.341933 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d podName:6552ac5c-c770-46e7-a793-412892a6d1a1 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:41.341918096 +0000 UTC m=+6.056030352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dz9d" (UniqueName: "kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d") pod "network-check-target-5j8td" (UID: "6552ac5c-c770-46e7-a793-412892a6d1a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:39.443177 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:39.442611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:39.443177 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:39.442746 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:39.443177 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:39.442802 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret podName:be3f0910-7935-4f9d-bc8b-ac92026ecff8 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:41.442785923 +0000 UTC m=+6.156898184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret") pod "global-pull-secret-syncer-rx596" (UID: "be3f0910-7935-4f9d-bc8b-ac92026ecff8") : object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:39.786081 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:39.784960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:39.786624 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:39.786269 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:39.819411 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:39.819377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal" event={"ID":"a2f86c374327211bfdc0d050c53cf8a9","Type":"ContainerStarted","Data":"fb2b99778da45f98057e41e46b93fe8d887434bdd94aec5f732c28fd8340c413"} Jul 19 14:46:40.781674 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:40.781642 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:40.781970 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:40.781783 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:40.782228 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:40.782206 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:40.782327 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:40.782307 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:40.838602 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:40.838569 2580 generic.go:356] "Generic (PLEG): container finished" podID="6d396f8c2e6f8349d1d0a007818a026a" containerID="8daeea70a5c0149b208079d896c5018744796ee4b918ae29d063cc74bf5150ea" exitCode=0 Jul 19 14:46:40.839463 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:40.839439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" event={"ID":"6d396f8c2e6f8349d1d0a007818a026a","Type":"ContainerDied","Data":"8daeea70a5c0149b208079d896c5018744796ee4b918ae29d063cc74bf5150ea"} Jul 19 14:46:40.853523 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:40.853463 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-202.ec2.internal" podStartSLOduration=3.853444133 podStartE2EDuration="3.853444133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:46:39.834172807 +0000 UTC m=+4.548285088" watchObservedRunningTime="2026-07-19 14:46:40.853444133 +0000 UTC m=+5.567556412" Jul 19 14:46:41.364784 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:41.364685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dz9d\" (UniqueName: \"kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d\") pod \"network-check-target-5j8td\" (UID: \"6552ac5c-c770-46e7-a793-412892a6d1a1\") " pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:41.364784 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:41.364768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:41.364995 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:41.364910 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:41.364995 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:41.364967 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs podName:3467f795-87e7-46aa-821b-f854cdc83634 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:45.36494968 +0000 UTC m=+10.079061956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs") pod "network-metrics-daemon-r28nx" (UID: "3467f795-87e7-46aa-821b-f854cdc83634") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:41.365427 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:41.365407 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 14:46:41.365513 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:41.365435 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 14:46:41.365513 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:41.365448 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8dz9d for pod openshift-network-diagnostics/network-check-target-5j8td: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:41.365513 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:41.365491 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d podName:6552ac5c-c770-46e7-a793-412892a6d1a1 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:45.365476158 +0000 UTC m=+10.079588419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dz9d" (UniqueName: "kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d") pod "network-check-target-5j8td" (UID: "6552ac5c-c770-46e7-a793-412892a6d1a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:41.465438 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:41.465403 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:41.465597 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:41.465557 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:41.465673 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:41.465635 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret podName:be3f0910-7935-4f9d-bc8b-ac92026ecff8 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:45.465601709 +0000 UTC m=+10.179713970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret") pod "global-pull-secret-syncer-rx596" (UID: "be3f0910-7935-4f9d-bc8b-ac92026ecff8") : object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:41.782624 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:41.782547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:41.782785 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:41.782658 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:41.844148 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:41.844111 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" event={"ID":"6d396f8c2e6f8349d1d0a007818a026a","Type":"ContainerStarted","Data":"2d958562bf868793ab25a64ffe9b9a7dfcbd93ce5238fd4bc84821c47977469d"} Jul 19 14:46:41.857971 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:41.857902 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-202.ec2.internal" podStartSLOduration=4.857888603 podStartE2EDuration="4.857888603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:46:41.85714795 +0000 UTC m=+6.571260228" watchObservedRunningTime="2026-07-19 14:46:41.857888603 +0000 UTC m=+6.572000884" Jul 19 14:46:42.781748 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:42.781715 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:42.781913 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:42.781858 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:42.782229 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:42.782209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:42.782339 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:42.782318 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:43.782712 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:43.782682 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:43.783142 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:43.782818 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:44.781635 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:44.781604 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:44.781812 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:44.781739 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:44.781883 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:44.781862 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:44.781937 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:44.781734 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:45.398069 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:45.398040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dz9d\" (UniqueName: \"kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d\") pod \"network-check-target-5j8td\" (UID: \"6552ac5c-c770-46e7-a793-412892a6d1a1\") " pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:45.398528 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:45.398086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:45.398528 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:45.398195 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:45.398528 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:45.398207 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 14:46:45.398528 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:45.398224 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 14:46:45.398528 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:45.398236 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8dz9d for pod openshift-network-diagnostics/network-check-target-5j8td: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:45.398528 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:45.398249 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs podName:3467f795-87e7-46aa-821b-f854cdc83634 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:53.398230891 +0000 UTC m=+18.112343149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs") pod "network-metrics-daemon-r28nx" (UID: "3467f795-87e7-46aa-821b-f854cdc83634") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:45.398528 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:45.398269 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d podName:6552ac5c-c770-46e7-a793-412892a6d1a1 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:53.39825909 +0000 UTC m=+18.112371358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dz9d" (UniqueName: "kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d") pod "network-check-target-5j8td" (UID: "6552ac5c-c770-46e7-a793-412892a6d1a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:45.498680 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:45.498640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:45.498840 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:45.498776 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:45.498840 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:45.498836 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret podName:be3f0910-7935-4f9d-bc8b-ac92026ecff8 nodeName:}" failed. No retries permitted until 2026-07-19 14:46:53.498818748 +0000 UTC m=+18.212931005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret") pod "global-pull-secret-syncer-rx596" (UID: "be3f0910-7935-4f9d-bc8b-ac92026ecff8") : object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:45.785595 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:45.785496 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:45.785734 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:45.785661 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:46.781916 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:46.781882 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:46.782386 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:46.782041 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:46.782386 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:46.782120 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:46.782386 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:46.782237 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:47.785952 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:47.785924 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:47.786414 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:47.786055 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:48.781824 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:48.781789 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:48.781984 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:48.781899 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:48.781984 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:48.781788 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:48.782118 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:48.781992 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:49.785367 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:49.785335 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:49.785786 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:49.785456 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:50.782143 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:50.782113 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:50.782329 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:50.782228 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:50.782329 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:50.782290 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:50.782445 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:50.782416 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:51.781743 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:51.781700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:51.782203 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:51.781833 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:52.782120 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:52.782091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:52.782643 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:52.782138 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:52.782643 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:52.782223 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:52.782643 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:52.782352 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:53.457757 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:53.457721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dz9d\" (UniqueName: \"kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d\") pod \"network-check-target-5j8td\" (UID: \"6552ac5c-c770-46e7-a793-412892a6d1a1\") " pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:53.457955 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:53.457775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:53.457955 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:53.457883 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:53.457955 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:53.457891 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 14:46:53.457955 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:53.457918 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 14:46:53.457955 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:53.457933 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8dz9d for pod openshift-network-diagnostics/network-check-target-5j8td: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:53.457955 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:53.457942 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs podName:3467f795-87e7-46aa-821b-f854cdc83634 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:09.45792525 +0000 UTC m=+34.172037536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs") pod "network-metrics-daemon-r28nx" (UID: "3467f795-87e7-46aa-821b-f854cdc83634") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:46:53.458220 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:53.457977 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d podName:6552ac5c-c770-46e7-a793-412892a6d1a1 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:09.457965399 +0000 UTC m=+34.172077655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dz9d" (UniqueName: "kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d") pod "network-check-target-5j8td" (UID: "6552ac5c-c770-46e7-a793-412892a6d1a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:46:53.558259 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:53.558226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:53.558400 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:53.558381 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:53.558482 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:53.558468 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret podName:be3f0910-7935-4f9d-bc8b-ac92026ecff8 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:09.558448118 +0000 UTC m=+34.272560375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret") pod "global-pull-secret-syncer-rx596" (UID: "be3f0910-7935-4f9d-bc8b-ac92026ecff8") : object "kube-system"/"original-pull-secret" not registered Jul 19 14:46:53.781511 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:53.781436 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:53.781653 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:53.781568 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:54.781565 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:54.781527 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:54.781565 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:54.781564 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:54.782030 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:54.781677 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:54.782030 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:54.781768 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:55.784928 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:55.784900 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:55.785350 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:55.785001 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:56.782028 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:56.781991 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:56.782194 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:56.782127 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:56.782270 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:56.782187 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:56.782321 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:56.782303 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:57.784432 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.784232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:57.784731 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:57.784447 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:57.875476 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.875449 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-64x7r" event={"ID":"2689c9af-0d4d-44ff-879d-99b31eff40b1","Type":"ContainerStarted","Data":"ba8b9f2cab7d4cc9f224415de7da589bc9402f4cf5f42506442913a5f9316484"} Jul 19 14:46:57.877116 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.877091 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" event={"ID":"4c1226ef-c4d5-4e24-a5dc-065a940c000a","Type":"ContainerStarted","Data":"c1ababa80ec256cb41a212e68743f27415c148b939b0b1fe93f1a0c2b28c7b60"} Jul 19 14:46:57.878602 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.878579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" event={"ID":"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c","Type":"ContainerStarted","Data":"17cf25547d51c9e8ff624c53ad5a8e7136cf27ac4aac911cf1e626fc50b7da14"} Jul 19 14:46:57.880480 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.880257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-chqvj" event={"ID":"38f88d2c-945f-40cc-9a22-5a2b6e31ad01","Type":"ContainerStarted","Data":"1c653b3d3a7b1ee53e86a665bce416a5dc3107111f31d04c8a3f2d2832045d92"} Jul 19 14:46:57.881733 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.881709 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fmxxg" event={"ID":"2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b","Type":"ContainerStarted","Data":"4486eeaa98ab61852782aad58a4b5837fdf3ad898796150585bec418d7bdb081"} Jul 19 14:46:57.883144 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.883124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hwqs4" event={"ID":"f1b180a8-170f-4693-b6ba-291db25b3a46","Type":"ContainerStarted","Data":"28bac6e0de39c14c27b501600ac3189e867be516f8efbbc2efdd738a9286d293"} Jul 19 14:46:57.884505 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.884485 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rhrjr" event={"ID":"73a5d9ce-871b-4fc8-8642-3f931640aa86","Type":"ContainerStarted","Data":"af8be840b428a00267d9e4d8b8a1e3badf08596c52c247799c2222b41f66ad4d"} Jul 19 14:46:57.891092 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.891055 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-64x7r" podStartSLOduration=2.380533722 podStartE2EDuration="21.891002781s" totalImagesPullingTime="19.510469059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:46:57.890223041 +0000 UTC m=+22.604335327" watchObservedRunningTime="2026-07-19 14:46:57.891002781 +0000 UTC m=+22.605115057" Jul 19 14:46:57.903142 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.903103 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hwqs4" podStartSLOduration=6.901385474 podStartE2EDuration="21.903091038s" totalImagesPullingTime="15.001705564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:46:57.90308903 +0000 UTC m=+22.617201309" watchObservedRunningTime="2026-07-19 14:46:57.903091038 +0000 UTC m=+22.617203346" Jul 19 14:46:57.917400 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.917362 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fmxxg" podStartSLOduration=2.38152298 podStartE2EDuration="21.917351236s" totalImagesPullingTime="19.535828256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:46:57.917152426 +0000 UTC m=+22.631264704" watchObservedRunningTime="2026-07-19 14:46:57.917351236 +0000 UTC m=+22.631463514" Jul 19 14:46:57.949514 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.949431 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-chqvj" podStartSLOduration=2.440716208 podStartE2EDuration="21.949417511s" totalImagesPullingTime="19.508701303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:46:57.949118265 +0000 UTC m=+22.663230548" watchObservedRunningTime="2026-07-19 14:46:57.949417511 +0000 UTC m=+22.663529790" Jul 19 14:46:57.962649 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:57.962608 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rhrjr" podStartSLOduration=7.00741684 podStartE2EDuration="21.962599675s" totalImagesPullingTime="14.955182835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:46:57.962363778 +0000 UTC m=+22.676476056" watchObservedRunningTime="2026-07-19 14:46:57.962599675 +0000 UTC m=+22.676711999" Jul 19 14:46:58.781637 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:58.781610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:46:58.781751 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:58.781645 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:46:58.781751 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:58.781727 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:46:58.781852 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:58.781836 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:46:58.887760 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:58.887732 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rfcg5" event={"ID":"1736e40e-e1dd-4786-a806-35f83a5ea6e8","Type":"ContainerStarted","Data":"e09ddc33a8bd2535f72d5590c49c44a5078cc8bdde2a44d9e56710df7e2e136d"} Jul 19 14:46:58.889155 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:58.889134 2580 generic.go:356] "Generic (PLEG): container finished" podID="2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c" containerID="17cf25547d51c9e8ff624c53ad5a8e7136cf27ac4aac911cf1e626fc50b7da14" exitCode=0 Jul 19 14:46:58.889255 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:58.889214 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" event={"ID":"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c","Type":"ContainerDied","Data":"17cf25547d51c9e8ff624c53ad5a8e7136cf27ac4aac911cf1e626fc50b7da14"} Jul 19 14:46:58.891123 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:58.891103 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" event={"ID":"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc","Type":"ContainerStarted","Data":"5a7598217a14fc3a5c54ad7e77c8e685ac9d6d118ac1177b9f1f90be58d338a2"} Jul 19 14:46:58.891189 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:58.891157 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" event={"ID":"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc","Type":"ContainerStarted","Data":"8c27b605480f3536126261b9673104c56744c6012c710d14b08673f1e8a2e572"} Jul 19 14:46:59.185839 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:59.185812 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 19 14:46:59.784898 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:59.784868 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:46:59.785178 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:46:59.784962 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:46:59.803556 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:59.803422 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-19T14:46:59.185838004Z","UUID":"3ffc142f-13c1-407b-a003-b9c1a9816edb","Handler":null,"Name":"","Endpoint":""} Jul 19 14:46:59.805039 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:59.805002 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 19 14:46:59.805134 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:59.805054 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 19 14:46:59.895911 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:59.895883 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" event={"ID":"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc","Type":"ContainerStarted","Data":"ab66af62a735d540ef84f70d02a3c4205c2194bd944b0f5939da3001f3b93b69"} Jul 19 14:46:59.896379 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:59.895948 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" event={"ID":"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc","Type":"ContainerStarted","Data":"f0b4b0fd0e56a0eef3b2250f6874178b4902148aa059822b257c09345d9208ad"} Jul 19 14:46:59.896379 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:59.895984 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" event={"ID":"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc","Type":"ContainerStarted","Data":"50d2f75b0d34dc1ee314806f7179edf6d747c4a5c80e9a45e76b34d85cc49271"} Jul 19 14:46:59.896379 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:59.896041 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" event={"ID":"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc","Type":"ContainerStarted","Data":"98c0ab965fc331c5b214fa3c2a1e7951c27e517971bd93e6852d0f1a85c0f5ac"} Jul 19 14:46:59.897831 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:46:59.897812 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" event={"ID":"4c1226ef-c4d5-4e24-a5dc-065a940c000a","Type":"ContainerStarted","Data":"8bca41ddd50fb34f162a3f81177e5b1087a106ea18dc4f51ee1559c5aecff9d8"} Jul 19 14:47:00.508406 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:00.508370 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:47:00.508955 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:00.508924 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:47:00.525541 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:00.525499 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rfcg5" podStartSLOduration=5.007036674 podStartE2EDuration="24.525485876s" totalImagesPullingTime="19.518449202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:46:58.921395353 +0000 UTC m=+23.635507642" watchObservedRunningTime="2026-07-19 14:47:00.525485876 +0000 UTC m=+25.239598155" Jul 19 14:47:00.782204 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:00.782146 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:00.782204 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:00.782177 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:47:00.782355 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:00.782248 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:47:00.782404 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:00.782373 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:47:00.902345 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:00.902312 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" event={"ID":"4c1226ef-c4d5-4e24-a5dc-065a940c000a","Type":"ContainerStarted","Data":"4d66e1bd7750ffe39b3caa840f68882f9445063450909af79e073026c2d676b7"} Jul 19 14:47:00.902837 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:00.902809 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:47:00.903237 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:00.903211 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hwqs4" Jul 19 14:47:00.919803 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:00.919762 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7l6q" podStartSLOduration=2.648165365 podStartE2EDuration="24.919748934s" totalImagesPullingTime="22.271583569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:47:00.919298118 +0000 UTC m=+25.633410397" watchObservedRunningTime="2026-07-19 14:47:00.919748934 +0000 UTC m=+25.633861214" Jul 19 14:47:01.782139 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:01.781852 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:01.782296 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:01.782204 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:47:01.907609 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:01.907577 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" event={"ID":"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc","Type":"ContainerStarted","Data":"e00035d858bd1f9127624dfde6e2afd8e089cad92dd04320a4c2a242bcf5c953"} Jul 19 14:47:02.782385 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:02.782353 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:47:02.782545 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:02.782468 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:47:02.782545 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:02.782522 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:02.782637 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:02.782618 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:47:03.782393 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:03.782364 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:03.782930 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:03.782479 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:47:04.782094 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:04.781880 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:47:04.782176 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:04.781921 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:04.782176 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:04.782152 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:47:04.782256 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:04.782221 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:47:04.916139 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:04.916114 2580 generic.go:356] "Generic (PLEG): container finished" podID="2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c" containerID="e8227ad2eb16639a531bd09c7c0ccb80479e3d1fd79f89d706422f883d71ebaf" exitCode=0 Jul 19 14:47:04.916686 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:04.916147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" event={"ID":"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c","Type":"ContainerDied","Data":"e8227ad2eb16639a531bd09c7c0ccb80479e3d1fd79f89d706422f883d71ebaf"} Jul 19 14:47:04.920144 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:04.920117 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" event={"ID":"300d5a7c-8baa-4f06-8e81-7d9fd4a080dc","Type":"ContainerStarted","Data":"7e0cd77cf232c1dafed58d709e2b124064407b44c5741b5d6e7724b14b086107"} Jul 19 14:47:04.920406 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:04.920388 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:47:04.935191 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:04.935171 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:47:04.962474 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:04.962431 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" podStartSLOduration=8.584558441 podStartE2EDuration="28.96241797s" totalImagesPullingTime="20.377859529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:47:04.96196634 +0000 UTC m=+29.676078613" watchObservedRunningTime="2026-07-19 14:47:04.96241797 +0000 UTC m=+29.676530248" Jul 19 14:47:05.782384 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:05.782349 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:05.782689 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:05.782445 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:47:05.922403 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:05.922379 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 19 14:47:05.922830 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:05.922802 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:47:05.936593 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:05.936576 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:47:06.309460 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:06.309372 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r28nx"] Jul 19 14:47:06.309593 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:06.309505 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:47:06.309657 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:06.309621 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:47:06.310031 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:06.309995 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rx596"] Jul 19 14:47:06.310153 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:06.310090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:06.310213 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:06.310173 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:47:06.310599 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:06.310579 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5j8td"] Jul 19 14:47:06.310693 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:06.310648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:06.310746 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:06.310718 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:47:06.926088 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:06.926052 2580 generic.go:356] "Generic (PLEG): container finished" podID="2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c" containerID="8bdf6bdd7148c5a2235ceaa7e18cc0e871de89845ec441e8dbafe54938370567" exitCode=0 Jul 19 14:47:06.926457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:06.926125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" event={"ID":"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c","Type":"ContainerDied","Data":"8bdf6bdd7148c5a2235ceaa7e18cc0e871de89845ec441e8dbafe54938370567"} Jul 19 14:47:06.926457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:06.926208 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 19 14:47:07.250452 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:07.250380 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:47:07.782309 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:07.782281 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:07.782309 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:07.782308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:07.782533 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:07.782281 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:47:07.782533 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:07.782386 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:47:07.782533 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:07.782460 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:47:07.782688 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:07.782554 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:47:08.933718 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:08.933526 2580 generic.go:356] "Generic (PLEG): container finished" podID="2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c" containerID="e82f13e452b2d5a83b33c1ceaf0413aaf57409a8c466e5fd09eaa6b4e4880015" exitCode=0 Jul 19 14:47:08.934252 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:08.933622 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" event={"ID":"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c","Type":"ContainerDied","Data":"e82f13e452b2d5a83b33c1ceaf0413aaf57409a8c466e5fd09eaa6b4e4880015"} Jul 19 14:47:09.478324 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:09.478278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:47:09.478476 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:09.478358 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dz9d\" (UniqueName: \"kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d\") pod \"network-check-target-5j8td\" (UID: \"6552ac5c-c770-46e7-a793-412892a6d1a1\") " pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:09.478476 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.478430 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:47:09.478476 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.478451 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 19 14:47:09.478476 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.478465 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 19 14:47:09.478476 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.478474 2580 projected.go:196] Error preparing data for projected volume kube-api-access-8dz9d for pod openshift-network-diagnostics/network-check-target-5j8td: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:47:09.478654 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.478502 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs podName:3467f795-87e7-46aa-821b-f854cdc83634 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:41.47848165 +0000 UTC m=+66.192593908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs") pod "network-metrics-daemon-r28nx" (UID: "3467f795-87e7-46aa-821b-f854cdc83634") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 19 14:47:09.478654 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.478527 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d podName:6552ac5c-c770-46e7-a793-412892a6d1a1 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:41.478520149 +0000 UTC m=+66.192632406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dz9d" (UniqueName: "kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d") pod "network-check-target-5j8td" (UID: "6552ac5c-c770-46e7-a793-412892a6d1a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 19 14:47:09.579561 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:09.579483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:09.579713 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.579612 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 19 14:47:09.579713 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.579672 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret podName:be3f0910-7935-4f9d-bc8b-ac92026ecff8 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:41.579656984 +0000 UTC m=+66.293769246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret") pod "global-pull-secret-syncer-rx596" (UID: "be3f0910-7935-4f9d-bc8b-ac92026ecff8") : object "kube-system"/"original-pull-secret" not registered Jul 19 14:47:09.781603 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:09.781571 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:09.781762 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.781680 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rx596" podUID="be3f0910-7935-4f9d-bc8b-ac92026ecff8" Jul 19 14:47:09.781985 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:09.781959 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:47:09.782103 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.782089 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:47:09.782168 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:09.782119 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:09.782214 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:09.782197 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5j8td" podUID="6552ac5c-c770-46e7-a793-412892a6d1a1" Jul 19 14:47:11.554751 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.554680 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-202.ec2.internal" event="NodeReady" Jul 19 14:47:11.555295 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.554830 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 19 14:47:11.590363 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.590335 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5"] Jul 19 14:47:11.594234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.594214 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64d74c75f7-ctv5x"] Jul 19 14:47:11.594373 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.594343 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:11.596623 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.596581 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 19 14:47:11.596763 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.596742 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 19 14:47:11.596889 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.596856 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g8q88\"" Jul 19 14:47:11.598037 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.597999 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.602559 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.602079 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bbjc4\"" Jul 19 14:47:11.602559 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.602156 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 19 14:47:11.602559 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.602271 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 19 14:47:11.602559 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.602324 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 19 14:47:11.603194 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.602792 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5"] Jul 19 14:47:11.606584 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.606564 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 19 14:47:11.608538 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.608520 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6r4tz"] Jul 19 14:47:11.612787 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.612394 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6r4tz" Jul 19 14:47:11.613030 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.612991 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64d74c75f7-ctv5x"] Jul 19 14:47:11.614069 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.614050 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z5g48"] Jul 19 14:47:11.616682 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.615895 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 19 14:47:11.616682 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.616194 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 19 14:47:11.617419 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.616829 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q8987\"" Jul 19 14:47:11.617419 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.616989 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 19 14:47:11.620312 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.620289 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.622527 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.622447 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 19 14:47:11.623367 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.623059 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 19 14:47:11.623367 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.623196 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4r258\"" Jul 19 14:47:11.624449 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.624418 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6r4tz"] Jul 19 14:47:11.626754 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.626734 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z5g48"] Jul 19 14:47:11.698093 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.698072 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-ca-trust-extracted\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.698241 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.698098 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-trusted-ca\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.698241 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.698115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-installation-pull-secrets\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.698241 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.698141 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:11.698387 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.698237 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-certificates\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.698387 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.698285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vkx8\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-kube-api-access-9vkx8\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.698387 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.698340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f7aa48da-331e-47c7-b787-e034c4a24046-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:11.698387 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.698373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-bound-sa-token\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.698533 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.698417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-image-registry-private-configuration\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.698533 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.698443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.782495 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.782463 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:47:11.782613 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.782497 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:11.782842 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.782463 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:11.785262 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.785223 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 19 14:47:11.785470 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.785427 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 19 14:47:11.785539 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.785494 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 19 14:47:11.785539 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.785510 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 19 14:47:11.785647 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.785555 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c6kqk\"" Jul 19 14:47:11.785728 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.785710 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p5rq\"" Jul 19 14:47:11.798837 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.798813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2x6m\" (UniqueName: \"kubernetes.io/projected/c185d060-0ddf-4918-9330-8677891cdc3b-kube-api-access-f2x6m\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.798930 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.798855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f7aa48da-331e-47c7-b787-e034c4a24046-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:11.798930 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.798888 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-bound-sa-token\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.798930 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.798912 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c185d060-0ddf-4918-9330-8677891cdc3b-config-volume\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.799130 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.798944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-image-registry-private-configuration\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.799130 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.798971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.799130 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-ca-trust-extracted\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.799130 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-trusted-ca\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.799130 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-installation-pull-secrets\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.799371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:11.799371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9654b2f6-3e26-4fdd-8ce3-a509a8753b8a-cert\") pod \"ingress-canary-6r4tz\" (UID: \"9654b2f6-3e26-4fdd-8ce3-a509a8753b8a\") " pod="openshift-ingress-canary/ingress-canary-6r4tz" Jul 19 14:47:11.799371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v54n\" (UniqueName: \"kubernetes.io/projected/9654b2f6-3e26-4fdd-8ce3-a509a8753b8a-kube-api-access-7v54n\") pod \"ingress-canary-6r4tz\" (UID: \"9654b2f6-3e26-4fdd-8ce3-a509a8753b8a\") " pod="openshift-ingress-canary/ingress-canary-6r4tz" Jul 19 14:47:11.799371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.799371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c185d060-0ddf-4918-9330-8677891cdc3b-tmp-dir\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.799371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-certificates\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.799371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vkx8\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-kube-api-access-9vkx8\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.799692 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.799658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f7aa48da-331e-47c7-b787-e034c4a24046-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:11.799796 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:11.799768 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 14:47:11.799889 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:11.799842 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert podName:f7aa48da-331e-47c7-b787-e034c4a24046 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:12.299824603 +0000 UTC m=+37.013936878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-cqql5" (UID: "f7aa48da-331e-47c7-b787-e034c4a24046") : secret "networking-console-plugin-cert" not found Jul 19 14:47:11.799980 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:11.799967 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 14:47:11.800052 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:11.799985 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d74c75f7-ctv5x: secret "image-registry-tls" not found Jul 19 14:47:11.800112 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:11.800076 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls podName:7ab6e450-5a6b-4791-b1f0-a1f3605eca41 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:12.30005642 +0000 UTC m=+37.014168696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls") pod "image-registry-64d74c75f7-ctv5x" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41") : secret "image-registry-tls" not found Jul 19 14:47:11.800112 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.800085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-trusted-ca\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.800341 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.800320 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-ca-trust-extracted\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.800406 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.800345 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-certificates\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.803874 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.803850 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-installation-pull-secrets\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.803958 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.803860 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-image-registry-private-configuration\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.808382 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.808336 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-bound-sa-token\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.808690 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.808665 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vkx8\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-kube-api-access-9vkx8\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:11.900151 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.900123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9654b2f6-3e26-4fdd-8ce3-a509a8753b8a-cert\") pod \"ingress-canary-6r4tz\" (UID: \"9654b2f6-3e26-4fdd-8ce3-a509a8753b8a\") " pod="openshift-ingress-canary/ingress-canary-6r4tz" Jul 19 14:47:11.900151 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.900152 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v54n\" (UniqueName: \"kubernetes.io/projected/9654b2f6-3e26-4fdd-8ce3-a509a8753b8a-kube-api-access-7v54n\") pod \"ingress-canary-6r4tz\" (UID: \"9654b2f6-3e26-4fdd-8ce3-a509a8753b8a\") " pod="openshift-ingress-canary/ingress-canary-6r4tz" Jul 19 14:47:11.900377 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.900189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.900377 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.900208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c185d060-0ddf-4918-9330-8677891cdc3b-tmp-dir\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.900377 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.900243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2x6m\" (UniqueName: \"kubernetes.io/projected/c185d060-0ddf-4918-9330-8677891cdc3b-kube-api-access-f2x6m\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.900377 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.900269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c185d060-0ddf-4918-9330-8677891cdc3b-config-volume\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.900377 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:11.900295 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 14:47:11.900377 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:11.900373 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls podName:c185d060-0ddf-4918-9330-8677891cdc3b nodeName:}" failed. No retries permitted until 2026-07-19 14:47:12.400352765 +0000 UTC m=+37.114465056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls") pod "dns-default-z5g48" (UID: "c185d060-0ddf-4918-9330-8677891cdc3b") : secret "dns-default-metrics-tls" not found Jul 19 14:47:11.900663 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.900513 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c185d060-0ddf-4918-9330-8677891cdc3b-tmp-dir\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.900824 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.900787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c185d060-0ddf-4918-9330-8677891cdc3b-config-volume\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.902722 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.902699 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9654b2f6-3e26-4fdd-8ce3-a509a8753b8a-cert\") pod \"ingress-canary-6r4tz\" (UID: \"9654b2f6-3e26-4fdd-8ce3-a509a8753b8a\") " pod="openshift-ingress-canary/ingress-canary-6r4tz" Jul 19 14:47:11.909355 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.909317 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2x6m\" (UniqueName: \"kubernetes.io/projected/c185d060-0ddf-4918-9330-8677891cdc3b-kube-api-access-f2x6m\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:11.909595 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.909578 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v54n\" (UniqueName: \"kubernetes.io/projected/9654b2f6-3e26-4fdd-8ce3-a509a8753b8a-kube-api-access-7v54n\") pod \"ingress-canary-6r4tz\" (UID: \"9654b2f6-3e26-4fdd-8ce3-a509a8753b8a\") " pod="openshift-ingress-canary/ingress-canary-6r4tz" Jul 19 14:47:11.927400 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:11.927377 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6r4tz" Jul 19 14:47:12.303901 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:12.303868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:12.304085 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:12.303945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:12.304085 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:12.304059 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 14:47:12.304085 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:12.304081 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d74c75f7-ctv5x: secret "image-registry-tls" not found Jul 19 14:47:12.304215 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:12.304105 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 14:47:12.304215 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:12.304159 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls podName:7ab6e450-5a6b-4791-b1f0-a1f3605eca41 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:13.304136749 +0000 UTC m=+38.018249024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls") pod "image-registry-64d74c75f7-ctv5x" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41") : secret "image-registry-tls" not found Jul 19 14:47:12.304215 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:12.304180 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert podName:f7aa48da-331e-47c7-b787-e034c4a24046 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:13.304170377 +0000 UTC m=+38.018282639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-cqql5" (UID: "f7aa48da-331e-47c7-b787-e034c4a24046") : secret "networking-console-plugin-cert" not found Jul 19 14:47:12.405002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:12.404971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:12.405155 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:12.405098 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 14:47:12.405155 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:12.405150 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls podName:c185d060-0ddf-4918-9330-8677891cdc3b nodeName:}" failed. No retries permitted until 2026-07-19 14:47:13.405136645 +0000 UTC m=+38.119248922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls") pod "dns-default-z5g48" (UID: "c185d060-0ddf-4918-9330-8677891cdc3b") : secret "dns-default-metrics-tls" not found Jul 19 14:47:13.313033 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:13.312982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:13.313588 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:13.313098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:13.313588 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:13.313133 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 14:47:13.313588 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:13.313208 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert podName:f7aa48da-331e-47c7-b787-e034c4a24046 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:15.313189007 +0000 UTC m=+40.027301284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-cqql5" (UID: "f7aa48da-331e-47c7-b787-e034c4a24046") : secret "networking-console-plugin-cert" not found Jul 19 14:47:13.313588 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:13.313232 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 14:47:13.313588 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:13.313248 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d74c75f7-ctv5x: secret "image-registry-tls" not found Jul 19 14:47:13.313588 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:13.313295 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls podName:7ab6e450-5a6b-4791-b1f0-a1f3605eca41 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:15.313280147 +0000 UTC m=+40.027392422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls") pod "image-registry-64d74c75f7-ctv5x" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41") : secret "image-registry-tls" not found Jul 19 14:47:13.414069 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:13.413712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:13.414199 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:13.414070 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 14:47:13.414199 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:13.414135 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls podName:c185d060-0ddf-4918-9330-8677891cdc3b nodeName:}" failed. No retries permitted until 2026-07-19 14:47:15.414116654 +0000 UTC m=+40.128228927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls") pod "dns-default-z5g48" (UID: "c185d060-0ddf-4918-9330-8677891cdc3b") : secret "dns-default-metrics-tls" not found Jul 19 14:47:13.495446 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:13.495416 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6r4tz"] Jul 19 14:47:13.500343 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:47:13.500301 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9654b2f6_3e26_4fdd_8ce3_a509a8753b8a.slice/crio-75c663ed0865850670e0866b325e7019cf34a600e2760eb4f0d2efd10b8001a1 WatchSource:0}: Error finding container 75c663ed0865850670e0866b325e7019cf34a600e2760eb4f0d2efd10b8001a1: Status 404 returned error can't find the container with id 75c663ed0865850670e0866b325e7019cf34a600e2760eb4f0d2efd10b8001a1 Jul 19 14:47:13.945986 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:13.945950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6r4tz" event={"ID":"9654b2f6-3e26-4fdd-8ce3-a509a8753b8a","Type":"ContainerStarted","Data":"75c663ed0865850670e0866b325e7019cf34a600e2760eb4f0d2efd10b8001a1"} Jul 19 14:47:13.948749 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:13.948722 2580 generic.go:356] "Generic (PLEG): container finished" podID="2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c" containerID="7f4a3a7cf868e1fcf4f449cce129fa2e80c3f25729323bc879f02108c16e6e4a" exitCode=0 Jul 19 14:47:13.948862 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:13.948762 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" event={"ID":"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c","Type":"ContainerDied","Data":"7f4a3a7cf868e1fcf4f449cce129fa2e80c3f25729323bc879f02108c16e6e4a"} Jul 19 14:47:14.954302 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:14.954269 2580 generic.go:356] "Generic (PLEG): container finished" podID="2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c" containerID="fb652363b6ed4eea56d10a8bf1f6cc6dff04f8a4150c8e0a9d4058afc9f729ba" exitCode=0 Jul 19 14:47:14.954685 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:14.954327 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" event={"ID":"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c","Type":"ContainerDied","Data":"fb652363b6ed4eea56d10a8bf1f6cc6dff04f8a4150c8e0a9d4058afc9f729ba"} Jul 19 14:47:15.327735 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:15.327655 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:15.327735 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:15.327713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:15.327912 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:15.327795 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 14:47:15.327912 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:15.327814 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d74c75f7-ctv5x: secret "image-registry-tls" not found Jul 19 14:47:15.327912 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:15.327817 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 14:47:15.327912 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:15.327868 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls podName:7ab6e450-5a6b-4791-b1f0-a1f3605eca41 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:19.327853464 +0000 UTC m=+44.041965724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls") pod "image-registry-64d74c75f7-ctv5x" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41") : secret "image-registry-tls" not found Jul 19 14:47:15.327912 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:15.327882 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert podName:f7aa48da-331e-47c7-b787-e034c4a24046 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:19.327876344 +0000 UTC m=+44.041988600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-cqql5" (UID: "f7aa48da-331e-47c7-b787-e034c4a24046") : secret "networking-console-plugin-cert" not found Jul 19 14:47:15.428850 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:15.428820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:15.428989 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:15.428906 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 14:47:15.428989 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:15.428947 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls podName:c185d060-0ddf-4918-9330-8677891cdc3b nodeName:}" failed. No retries permitted until 2026-07-19 14:47:19.428935859 +0000 UTC m=+44.143048116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls") pod "dns-default-z5g48" (UID: "c185d060-0ddf-4918-9330-8677891cdc3b") : secret "dns-default-metrics-tls" not found Jul 19 14:47:15.961371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:15.961333 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" event={"ID":"2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c","Type":"ContainerStarted","Data":"3ef613c4f6d56820ebcaa64ddcefd726b4c230540dab0e7541ec66cfa4876e35"} Jul 19 14:47:15.983185 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:15.983137 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fmvzq" podStartSLOduration=9.126091479 podStartE2EDuration="40.983122485s" totalImagesPullingTime="31.857031006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:47:15.981242294 +0000 UTC m=+40.695354574" watchObservedRunningTime="2026-07-19 14:47:15.983122485 +0000 UTC m=+40.697234762" Jul 19 14:47:16.964834 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:16.964794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6r4tz" event={"ID":"9654b2f6-3e26-4fdd-8ce3-a509a8753b8a","Type":"ContainerStarted","Data":"54317ab3e9fd93ee9f4b8bf1451bc649292f2e78a53bbdc5c1405e9f3fbffa68"} Jul 19 14:47:16.990918 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:16.990874 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6r4tz" podStartSLOduration=2.928387509 podStartE2EDuration="5.990858745s" totalImagesPullingTime="3.062471236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:47:16.990668167 +0000 UTC m=+41.704780446" watchObservedRunningTime="2026-07-19 14:47:16.990858745 +0000 UTC m=+41.704971026" Jul 19 14:47:19.356815 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:19.356766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:19.357262 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:19.356842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:19.357262 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:19.356922 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 14:47:19.357262 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:19.356998 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert podName:f7aa48da-331e-47c7-b787-e034c4a24046 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:27.356980392 +0000 UTC m=+52.071092649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-cqql5" (UID: "f7aa48da-331e-47c7-b787-e034c4a24046") : secret "networking-console-plugin-cert" not found Jul 19 14:47:19.357262 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:19.356936 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 14:47:19.357262 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:19.357038 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d74c75f7-ctv5x: secret "image-registry-tls" not found Jul 19 14:47:19.357262 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:19.357089 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls podName:7ab6e450-5a6b-4791-b1f0-a1f3605eca41 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:27.357075308 +0000 UTC m=+52.071187565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls") pod "image-registry-64d74c75f7-ctv5x" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41") : secret "image-registry-tls" not found Jul 19 14:47:19.457794 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:19.457765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:19.457952 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:19.457929 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 14:47:19.458044 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:19.458005 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls podName:c185d060-0ddf-4918-9330-8677891cdc3b nodeName:}" failed. No retries permitted until 2026-07-19 14:47:27.457983007 +0000 UTC m=+52.172095314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls") pod "dns-default-z5g48" (UID: "c185d060-0ddf-4918-9330-8677891cdc3b") : secret "dns-default-metrics-tls" not found Jul 19 14:47:27.416025 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:27.415980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:27.416510 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:27.416163 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 14:47:27.416510 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:27.416222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:27.416510 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:27.416258 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert podName:f7aa48da-331e-47c7-b787-e034c4a24046 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:43.41623733 +0000 UTC m=+68.130349587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-cqql5" (UID: "f7aa48da-331e-47c7-b787-e034c4a24046") : secret "networking-console-plugin-cert" not found Jul 19 14:47:27.416510 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:27.416309 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 14:47:27.416510 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:27.416322 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d74c75f7-ctv5x: secret "image-registry-tls" not found Jul 19 14:47:27.416510 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:27.416377 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls podName:7ab6e450-5a6b-4791-b1f0-a1f3605eca41 nodeName:}" failed. No retries permitted until 2026-07-19 14:47:43.416363677 +0000 UTC m=+68.130475990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls") pod "image-registry-64d74c75f7-ctv5x" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41") : secret "image-registry-tls" not found Jul 19 14:47:27.516885 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:27.516853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:27.517047 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:27.516967 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 14:47:27.517047 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:27.517032 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls podName:c185d060-0ddf-4918-9330-8677891cdc3b nodeName:}" failed. No retries permitted until 2026-07-19 14:47:43.51699976 +0000 UTC m=+68.231112017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls") pod "dns-default-z5g48" (UID: "c185d060-0ddf-4918-9330-8677891cdc3b") : secret "dns-default-metrics-tls" not found Jul 19 14:47:38.944027 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:38.943981 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rmwrk" Jul 19 14:47:41.517924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.517890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dz9d\" (UniqueName: \"kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d\") pod \"network-check-target-5j8td\" (UID: \"6552ac5c-c770-46e7-a793-412892a6d1a1\") " pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:41.518304 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.517939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:47:41.520386 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.520364 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 19 14:47:41.520493 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.520457 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 19 14:47:41.528675 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:41.528655 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 19 14:47:41.528746 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:41.528710 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs podName:3467f795-87e7-46aa-821b-f854cdc83634 nodeName:}" failed. No retries permitted until 2026-07-19 14:48:45.528695349 +0000 UTC m=+130.242807619 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs") pod "network-metrics-daemon-r28nx" (UID: "3467f795-87e7-46aa-821b-f854cdc83634") : secret "metrics-daemon-secret" not found Jul 19 14:47:41.530470 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.530454 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 19 14:47:41.542865 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.542839 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dz9d\" (UniqueName: \"kubernetes.io/projected/6552ac5c-c770-46e7-a793-412892a6d1a1-kube-api-access-8dz9d\") pod \"network-check-target-5j8td\" (UID: \"6552ac5c-c770-46e7-a793-412892a6d1a1\") " pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:41.618972 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.618948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:41.621334 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.621320 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 19 14:47:41.631340 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.631318 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/be3f0910-7935-4f9d-bc8b-ac92026ecff8-original-pull-secret\") pod \"global-pull-secret-syncer-rx596\" (UID: \"be3f0910-7935-4f9d-bc8b-ac92026ecff8\") " pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:41.803451 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.803381 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c6kqk\"" Jul 19 14:47:41.811381 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.811366 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:41.818970 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.818950 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rx596" Jul 19 14:47:41.958516 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.958488 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5j8td"] Jul 19 14:47:41.960924 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:47:41.960899 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6552ac5c_c770_46e7_a793_412892a6d1a1.slice/crio-1a6161b09e5a73ee155545ba867cbdc258bc6df4401cb413ef56d69f221d91c3 WatchSource:0}: Error finding container 1a6161b09e5a73ee155545ba867cbdc258bc6df4401cb413ef56d69f221d91c3: Status 404 returned error can't find the container with id 1a6161b09e5a73ee155545ba867cbdc258bc6df4401cb413ef56d69f221d91c3 Jul 19 14:47:41.961176 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:41.961156 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rx596"] Jul 19 14:47:41.965139 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:47:41.965116 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3f0910_7935_4f9d_bc8b_ac92026ecff8.slice/crio-4aaef07ef21dde02fbe42b04bed9800c7aceea06dcf94578b0ebea90acddf7ce WatchSource:0}: Error finding container 4aaef07ef21dde02fbe42b04bed9800c7aceea06dcf94578b0ebea90acddf7ce: Status 404 returned error can't find the container with id 4aaef07ef21dde02fbe42b04bed9800c7aceea06dcf94578b0ebea90acddf7ce Jul 19 14:47:42.020632 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:42.020605 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rx596" event={"ID":"be3f0910-7935-4f9d-bc8b-ac92026ecff8","Type":"ContainerStarted","Data":"4aaef07ef21dde02fbe42b04bed9800c7aceea06dcf94578b0ebea90acddf7ce"} Jul 19 14:47:42.021637 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:42.021616 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5j8td" event={"ID":"6552ac5c-c770-46e7-a793-412892a6d1a1","Type":"ContainerStarted","Data":"1a6161b09e5a73ee155545ba867cbdc258bc6df4401cb413ef56d69f221d91c3"} Jul 19 14:47:43.435824 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:43.435793 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:47:43.436242 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:43.435861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:47:43.436242 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:43.435961 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 14:47:43.436242 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:43.435986 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d74c75f7-ctv5x: secret "image-registry-tls" not found Jul 19 14:47:43.436242 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:43.435960 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 14:47:43.436242 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:43.436063 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls podName:7ab6e450-5a6b-4791-b1f0-a1f3605eca41 nodeName:}" failed. No retries permitted until 2026-07-19 14:48:15.436044991 +0000 UTC m=+100.150157270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls") pod "image-registry-64d74c75f7-ctv5x" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41") : secret "image-registry-tls" not found Jul 19 14:47:43.436242 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:43.436081 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert podName:f7aa48da-331e-47c7-b787-e034c4a24046 nodeName:}" failed. No retries permitted until 2026-07-19 14:48:15.436071973 +0000 UTC m=+100.150184235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-cqql5" (UID: "f7aa48da-331e-47c7-b787-e034c4a24046") : secret "networking-console-plugin-cert" not found Jul 19 14:47:43.536703 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:43.536665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:47:43.536883 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:43.536794 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 14:47:43.536883 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:47:43.536860 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls podName:c185d060-0ddf-4918-9330-8677891cdc3b nodeName:}" failed. No retries permitted until 2026-07-19 14:48:15.536841581 +0000 UTC m=+100.250953856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls") pod "dns-default-z5g48" (UID: "c185d060-0ddf-4918-9330-8677891cdc3b") : secret "dns-default-metrics-tls" not found Jul 19 14:47:47.035409 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:47.035318 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rx596" event={"ID":"be3f0910-7935-4f9d-bc8b-ac92026ecff8","Type":"ContainerStarted","Data":"75337e259d4dfcef958e48d39f2c19f3d2f9745280e0d07d84750285ba73d80b"} Jul 19 14:47:47.036836 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:47.036813 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5j8td" event={"ID":"6552ac5c-c770-46e7-a793-412892a6d1a1","Type":"ContainerStarted","Data":"c20cd9050196eca62111654f1454977ff31aee0c75a4579e4cdc5a5ba0a89844"} Jul 19 14:47:47.036945 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:47.036934 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:47:47.051599 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:47.051548 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rx596" podStartSLOduration=66.297717471 podStartE2EDuration="1m11.051532461s" totalImagesPullingTime="4.75381499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:47:47.050247425 +0000 UTC m=+71.764359715" watchObservedRunningTime="2026-07-19 14:47:47.051532461 +0000 UTC m=+71.765644747" Jul 19 14:47:47.067312 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:47:47.067267 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5j8td" podStartSLOduration=67.314626666 podStartE2EDuration="1m12.067250658s" totalImagesPullingTime="4.752623992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:47:47.066544513 +0000 UTC m=+71.780656792" watchObservedRunningTime="2026-07-19 14:47:47.067250658 +0000 UTC m=+71.781362938" Jul 19 14:48:15.465225 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:48:15.465080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:48:15.465225 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:48:15.465183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:48:15.465766 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:48:15.465255 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 14:48:15.465766 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:48:15.465273 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 14:48:15.465766 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:48:15.465285 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d74c75f7-ctv5x: secret "image-registry-tls" not found Jul 19 14:48:15.465766 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:48:15.465352 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert podName:f7aa48da-331e-47c7-b787-e034c4a24046 nodeName:}" failed. No retries permitted until 2026-07-19 14:49:19.465334026 +0000 UTC m=+164.179446286 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-cqql5" (UID: "f7aa48da-331e-47c7-b787-e034c4a24046") : secret "networking-console-plugin-cert" not found Jul 19 14:48:15.465766 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:48:15.465370 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls podName:7ab6e450-5a6b-4791-b1f0-a1f3605eca41 nodeName:}" failed. No retries permitted until 2026-07-19 14:49:19.465363745 +0000 UTC m=+164.179476093 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls") pod "image-registry-64d74c75f7-ctv5x" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41") : secret "image-registry-tls" not found Jul 19 14:48:15.566240 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:48:15.566209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:48:15.566341 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:48:15.566311 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 14:48:15.566379 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:48:15.566366 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls podName:c185d060-0ddf-4918-9330-8677891cdc3b nodeName:}" failed. No retries permitted until 2026-07-19 14:49:19.566354324 +0000 UTC m=+164.280466580 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls") pod "dns-default-z5g48" (UID: "c185d060-0ddf-4918-9330-8677891cdc3b") : secret "dns-default-metrics-tls" not found Jul 19 14:48:18.041826 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:48:18.041797 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5j8td" Jul 19 14:48:45.552798 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:48:45.552736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:48:45.553394 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:48:45.552938 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 19 14:48:45.553394 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:48:45.553082 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs podName:3467f795-87e7-46aa-821b-f854cdc83634 nodeName:}" failed. No retries permitted until 2026-07-19 14:50:47.553055573 +0000 UTC m=+252.267167850 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs") pod "network-metrics-daemon-r28nx" (UID: "3467f795-87e7-46aa-821b-f854cdc83634") : secret "metrics-daemon-secret" not found Jul 19 14:49:14.607855 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:14.607801 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" podUID="f7aa48da-331e-47c7-b787-e034c4a24046" Jul 19 14:49:14.618000 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:14.617961 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" podUID="7ab6e450-5a6b-4791-b1f0-a1f3605eca41" Jul 19 14:49:14.633183 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:14.633156 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z5g48" podUID="c185d060-0ddf-4918-9330-8677891cdc3b" Jul 19 14:49:14.794157 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:14.794122 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:49:15.247299 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:49:15.247269 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:49:15.247491 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:49:15.247268 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:49:15.247491 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:49:15.247279 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5g48" Jul 19 14:49:19.476648 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:49:19.476615 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:49:19.477040 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:49:19.476681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:49:19.477040 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:19.476760 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 19 14:49:19.477040 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:19.476779 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 19 14:49:19.477040 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:19.476791 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64d74c75f7-ctv5x: secret "image-registry-tls" not found Jul 19 14:49:19.477040 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:19.476835 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert podName:f7aa48da-331e-47c7-b787-e034c4a24046 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:21.476818891 +0000 UTC m=+286.190931148 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-cqql5" (UID: "f7aa48da-331e-47c7-b787-e034c4a24046") : secret "networking-console-plugin-cert" not found Jul 19 14:49:19.477040 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:19.476849 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls podName:7ab6e450-5a6b-4791-b1f0-a1f3605eca41 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:21.476842323 +0000 UTC m=+286.190954580 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls") pod "image-registry-64d74c75f7-ctv5x" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41") : secret "image-registry-tls" not found Jul 19 14:49:19.577503 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:49:19.577478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:49:19.577621 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:19.577574 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 19 14:49:19.577621 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:49:19.577615 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls podName:c185d060-0ddf-4918-9330-8677891cdc3b nodeName:}" failed. No retries permitted until 2026-07-19 14:51:21.577603488 +0000 UTC m=+286.291715744 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls") pod "dns-default-z5g48" (UID: "c185d060-0ddf-4918-9330-8677891cdc3b") : secret "dns-default-metrics-tls" not found Jul 19 14:49:25.783573 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:49:25.783531 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:50:47.553320 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:50:47.553279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:50:47.553786 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:50:47.553404 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 19 14:50:47.553786 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:50:47.553454 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs podName:3467f795-87e7-46aa-821b-f854cdc83634 nodeName:}" failed. No retries permitted until 2026-07-19 14:52:49.553441731 +0000 UTC m=+374.267553987 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs") pod "network-metrics-daemon-r28nx" (UID: "3467f795-87e7-46aa-821b-f854cdc83634") : secret "metrics-daemon-secret" not found Jul 19 14:51:01.842041 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.841949 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4"] Jul 19 14:51:01.843844 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.843825 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4" Jul 19 14:51:01.846789 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.846764 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8mdml\"" Jul 19 14:51:01.849641 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.849617 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr"] Jul 19 14:51:01.854635 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.854592 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-7vbh4"] Jul 19 14:51:01.855036 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.854857 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr" Jul 19 14:51:01.857165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.857147 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5"] Jul 19 14:51:01.857281 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.857262 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:01.857450 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.857425 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 19 14:51:01.857857 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.857836 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8222w\"" Jul 19 14:51:01.857978 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.857960 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 19 14:51:01.859067 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.859047 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-q67m4"] Jul 19 14:51:01.859156 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.859140 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:01.859840 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.859821 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 19 14:51:01.859924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.859854 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 19 14:51:01.860105 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.860087 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 19 14:51:01.860195 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.860127 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 19 14:51:01.860483 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.860470 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fmxcv\"" Jul 19 14:51:01.860797 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.860780 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4"] Jul 19 14:51:01.860872 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.860863 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:01.862805 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.862784 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 19 14:51:01.863022 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.862996 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr"] Jul 19 14:51:01.863461 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.863444 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 19 14:51:01.863837 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.863816 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5blsd\"" Jul 19 14:51:01.864134 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.864117 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 19 14:51:01.864263 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.864125 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vntpg\"" Jul 19 14:51:01.864459 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.864224 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 19 14:51:01.864552 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.864510 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 19 14:51:01.864640 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.864621 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 19 14:51:01.864820 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.864804 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 19 14:51:01.868065 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.868044 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-7vbh4"] Jul 19 14:51:01.869190 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.869168 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 19 14:51:01.870863 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.870844 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 19 14:51:01.870988 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.870899 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5"] Jul 19 14:51:01.872071 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.872052 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-q67m4"] Jul 19 14:51:01.943892 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.943869 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb"] Jul 19 14:51:01.945891 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.945876 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:01.947473 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.947451 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxh56\" (UniqueName: \"kubernetes.io/projected/eacaf94b-8567-4c91-8782-6d8aa0cfa882-kube-api-access-cxh56\") pod \"network-check-source-7bc5b6bf85-gzgw4\" (UID: \"eacaf94b-8567-4c91-8782-6d8aa0cfa882\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4" Jul 19 14:51:01.947585 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.947547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-252w8\" (UniqueName: \"kubernetes.io/projected/dd9f7187-473c-4e1b-a90c-c7cebba24d45-kube-api-access-252w8\") pod \"volume-data-source-validator-78cf4c6f6-588hr\" (UID: \"dd9f7187-473c-4e1b-a90c-c7cebba24d45\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr" Jul 19 14:51:01.948658 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.948639 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 19 14:51:01.948658 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.948654 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5lhkx\"" Jul 19 14:51:01.948658 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.948639 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 19 14:51:01.948881 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.948682 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 19 14:51:01.949348 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.949334 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 19 14:51:01.958901 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:01.958884 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb"] Jul 19 14:51:02.048672 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048651 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dldrm\" (UniqueName: \"kubernetes.io/projected/f36fa4ec-c3c3-425c-9289-badff93367a2-kube-api-access-dldrm\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.048767 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048680 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f36fa4ec-c3c3-425c-9289-badff93367a2-config\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.048767 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048702 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aff56ccc-99a3-41c9-8cfb-0533ffcb0274-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-npbsb\" (UID: \"aff56ccc-99a3-41c9-8cfb-0533ffcb0274\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:02.048767 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048756 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e5f751-5f2d-4255-9d36-725c766e8c25-tmp\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.048874 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048785 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f36fa4ec-c3c3-425c-9289-badff93367a2-serving-cert\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.048874 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gzrq\" (UniqueName: \"kubernetes.io/projected/aff56ccc-99a3-41c9-8cfb-0533ffcb0274-kube-api-access-8gzrq\") pod \"kube-storage-version-migrator-operator-7658d9b749-npbsb\" (UID: \"aff56ccc-99a3-41c9-8cfb-0533ffcb0274\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:02.048874 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:02.048999 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pll9n\" (UniqueName: \"kubernetes.io/projected/e8e5f751-5f2d-4255-9d36-725c766e8c25-kube-api-access-pll9n\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.048999 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aff56ccc-99a3-41c9-8cfb-0533ffcb0274-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-npbsb\" (UID: \"aff56ccc-99a3-41c9-8cfb-0533ffcb0274\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:02.048999 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f36fa4ec-c3c3-425c-9289-badff93367a2-trusted-ca\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.048999 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048929 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e5f751-5f2d-4255-9d36-725c766e8c25-serving-cert\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.048999 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.048945 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e5f751-5f2d-4255-9d36-725c766e8c25-service-ca-bundle\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.049221 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.049042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-252w8\" (UniqueName: \"kubernetes.io/projected/dd9f7187-473c-4e1b-a90c-c7cebba24d45-kube-api-access-252w8\") pod \"volume-data-source-validator-78cf4c6f6-588hr\" (UID: \"dd9f7187-473c-4e1b-a90c-c7cebba24d45\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr" Jul 19 14:51:02.049221 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.049068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6n6q\" (UniqueName: \"kubernetes.io/projected/de47e54b-1766-4bd9-a923-81f26eec7fa8-kube-api-access-b6n6q\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:02.049221 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.049088 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e5f751-5f2d-4255-9d36-725c766e8c25-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.049221 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.049108 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e8e5f751-5f2d-4255-9d36-725c766e8c25-snapshots\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.049221 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.049134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxh56\" (UniqueName: \"kubernetes.io/projected/eacaf94b-8567-4c91-8782-6d8aa0cfa882-kube-api-access-cxh56\") pod \"network-check-source-7bc5b6bf85-gzgw4\" (UID: \"eacaf94b-8567-4c91-8782-6d8aa0cfa882\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4" Jul 19 14:51:02.057687 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.057666 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-252w8\" (UniqueName: \"kubernetes.io/projected/dd9f7187-473c-4e1b-a90c-c7cebba24d45-kube-api-access-252w8\") pod \"volume-data-source-validator-78cf4c6f6-588hr\" (UID: \"dd9f7187-473c-4e1b-a90c-c7cebba24d45\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr" Jul 19 14:51:02.057784 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.057763 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxh56\" (UniqueName: \"kubernetes.io/projected/eacaf94b-8567-4c91-8782-6d8aa0cfa882-kube-api-access-cxh56\") pod \"network-check-source-7bc5b6bf85-gzgw4\" (UID: \"eacaf94b-8567-4c91-8782-6d8aa0cfa882\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4" Jul 19 14:51:02.149837 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.149816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f36fa4ec-c3c3-425c-9289-badff93367a2-trusted-ca\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.149921 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.149843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e5f751-5f2d-4255-9d36-725c766e8c25-serving-cert\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.149921 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.149858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e5f751-5f2d-4255-9d36-725c766e8c25-service-ca-bundle\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.149921 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.149880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6n6q\" (UniqueName: \"kubernetes.io/projected/de47e54b-1766-4bd9-a923-81f26eec7fa8-kube-api-access-b6n6q\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:02.149921 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.149900 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e5f751-5f2d-4255-9d36-725c766e8c25-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.149921 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.149917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e8e5f751-5f2d-4255-9d36-725c766e8c25-snapshots\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.150197 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.149960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dldrm\" (UniqueName: \"kubernetes.io/projected/f36fa4ec-c3c3-425c-9289-badff93367a2-kube-api-access-dldrm\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.150197 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.149977 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f36fa4ec-c3c3-425c-9289-badff93367a2-config\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.150197 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.150000 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aff56ccc-99a3-41c9-8cfb-0533ffcb0274-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-npbsb\" (UID: \"aff56ccc-99a3-41c9-8cfb-0533ffcb0274\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:02.150197 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.150061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e5f751-5f2d-4255-9d36-725c766e8c25-tmp\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.150197 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.150105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f36fa4ec-c3c3-425c-9289-badff93367a2-serving-cert\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.150432 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.150202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gzrq\" (UniqueName: \"kubernetes.io/projected/aff56ccc-99a3-41c9-8cfb-0533ffcb0274-kube-api-access-8gzrq\") pod \"kube-storage-version-migrator-operator-7658d9b749-npbsb\" (UID: \"aff56ccc-99a3-41c9-8cfb-0533ffcb0274\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:02.150432 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.150232 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:02.150432 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.150261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pll9n\" (UniqueName: \"kubernetes.io/projected/e8e5f751-5f2d-4255-9d36-725c766e8c25-kube-api-access-pll9n\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.150432 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.150286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aff56ccc-99a3-41c9-8cfb-0533ffcb0274-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-npbsb\" (UID: \"aff56ccc-99a3-41c9-8cfb-0533ffcb0274\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:02.150685 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:02.150476 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 19 14:51:02.150685 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:02.150529 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls podName:de47e54b-1766-4bd9-a923-81f26eec7fa8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:02.650512708 +0000 UTC m=+267.364624968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d4rj5" (UID: "de47e54b-1766-4bd9-a923-81f26eec7fa8") : secret "samples-operator-tls" not found Jul 19 14:51:02.150796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.150729 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f36fa4ec-c3c3-425c-9289-badff93367a2-config\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.150796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.150754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f36fa4ec-c3c3-425c-9289-badff93367a2-trusted-ca\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.150796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.150769 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aff56ccc-99a3-41c9-8cfb-0533ffcb0274-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-npbsb\" (UID: \"aff56ccc-99a3-41c9-8cfb-0533ffcb0274\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:02.151481 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.151445 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e5f751-5f2d-4255-9d36-725c766e8c25-service-ca-bundle\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.151481 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.151465 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8e5f751-5f2d-4255-9d36-725c766e8c25-tmp\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.151664 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.151556 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8e5f751-5f2d-4255-9d36-725c766e8c25-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.151664 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.151563 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e8e5f751-5f2d-4255-9d36-725c766e8c25-snapshots\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.152284 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.152266 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e5f751-5f2d-4255-9d36-725c766e8c25-serving-cert\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.152530 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.152515 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f36fa4ec-c3c3-425c-9289-badff93367a2-serving-cert\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.152663 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.152645 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aff56ccc-99a3-41c9-8cfb-0533ffcb0274-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-npbsb\" (UID: \"aff56ccc-99a3-41c9-8cfb-0533ffcb0274\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:02.153578 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.153559 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4" Jul 19 14:51:02.159002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.158956 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6n6q\" (UniqueName: \"kubernetes.io/projected/de47e54b-1766-4bd9-a923-81f26eec7fa8-kube-api-access-b6n6q\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:02.160145 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.160113 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gzrq\" (UniqueName: \"kubernetes.io/projected/aff56ccc-99a3-41c9-8cfb-0533ffcb0274-kube-api-access-8gzrq\") pod \"kube-storage-version-migrator-operator-7658d9b749-npbsb\" (UID: \"aff56ccc-99a3-41c9-8cfb-0533ffcb0274\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:02.160398 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.160379 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dldrm\" (UniqueName: \"kubernetes.io/projected/f36fa4ec-c3c3-425c-9289-badff93367a2-kube-api-access-dldrm\") pod \"console-operator-565b7b569d-q67m4\" (UID: \"f36fa4ec-c3c3-425c-9289-badff93367a2\") " pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.160684 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.160669 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pll9n\" (UniqueName: \"kubernetes.io/projected/e8e5f751-5f2d-4255-9d36-725c766e8c25-kube-api-access-pll9n\") pod \"insights-operator-555d9d7885-7vbh4\" (UID: \"e8e5f751-5f2d-4255-9d36-725c766e8c25\") " pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.167411 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.167392 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr" Jul 19 14:51:02.175483 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.175463 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-7vbh4" Jul 19 14:51:02.186459 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.186437 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:02.254757 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.254325 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" Jul 19 14:51:02.318906 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.318533 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4"] Jul 19 14:51:02.322278 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:02.322250 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeacaf94b_8567_4c91_8782_6d8aa0cfa882.slice/crio-00e3adec9f670b97f3918dcf4e407414190d635a8cdfcd5943b9b154ca69f61b WatchSource:0}: Error finding container 00e3adec9f670b97f3918dcf4e407414190d635a8cdfcd5943b9b154ca69f61b: Status 404 returned error can't find the container with id 00e3adec9f670b97f3918dcf4e407414190d635a8cdfcd5943b9b154ca69f61b Jul 19 14:51:02.331293 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.331269 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr"] Jul 19 14:51:02.340742 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:02.340709 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9f7187_473c_4e1b_a90c_c7cebba24d45.slice/crio-0e5be2b656973105fdcdb6149fecee93018a1fee25b76a10bd50a82549786079 WatchSource:0}: Error finding container 0e5be2b656973105fdcdb6149fecee93018a1fee25b76a10bd50a82549786079: Status 404 returned error can't find the container with id 0e5be2b656973105fdcdb6149fecee93018a1fee25b76a10bd50a82549786079 Jul 19 14:51:02.410992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.410929 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb"] Jul 19 14:51:02.414615 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:02.414583 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff56ccc_99a3_41c9_8cfb_0533ffcb0274.slice/crio-fd4e96532dc328fb0454f37e96dab7ba952efaad5dd8d1664c1865b50544be0a WatchSource:0}: Error finding container fd4e96532dc328fb0454f37e96dab7ba952efaad5dd8d1664c1865b50544be0a: Status 404 returned error can't find the container with id fd4e96532dc328fb0454f37e96dab7ba952efaad5dd8d1664c1865b50544be0a Jul 19 14:51:02.504522 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.504487 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4" event={"ID":"eacaf94b-8567-4c91-8782-6d8aa0cfa882","Type":"ContainerStarted","Data":"976b2c37bc7979fc616061b4b165e45ad87400511568f8cdad15806563ab53c4"} Jul 19 14:51:02.504638 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.504537 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4" event={"ID":"eacaf94b-8567-4c91-8782-6d8aa0cfa882","Type":"ContainerStarted","Data":"00e3adec9f670b97f3918dcf4e407414190d635a8cdfcd5943b9b154ca69f61b"} Jul 19 14:51:02.505646 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.505624 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr" event={"ID":"dd9f7187-473c-4e1b-a90c-c7cebba24d45","Type":"ContainerStarted","Data":"0e5be2b656973105fdcdb6149fecee93018a1fee25b76a10bd50a82549786079"} Jul 19 14:51:02.506639 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.506618 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" event={"ID":"aff56ccc-99a3-41c9-8cfb-0533ffcb0274","Type":"ContainerStarted","Data":"fd4e96532dc328fb0454f37e96dab7ba952efaad5dd8d1664c1865b50544be0a"} Jul 19 14:51:02.520965 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.520922 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzgw4" podStartSLOduration=1.520910065 podStartE2EDuration="1.520910065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:02.519916892 +0000 UTC m=+267.234029181" watchObservedRunningTime="2026-07-19 14:51:02.520910065 +0000 UTC m=+267.235022343" Jul 19 14:51:02.561148 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.561126 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-q67m4"] Jul 19 14:51:02.564366 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:02.564345 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36fa4ec_c3c3_425c_9289_badff93367a2.slice/crio-03ac5165d8774dce8edba20618442a90540a4e8d479506c2bf77a058eb461eea WatchSource:0}: Error finding container 03ac5165d8774dce8edba20618442a90540a4e8d479506c2bf77a058eb461eea: Status 404 returned error can't find the container with id 03ac5165d8774dce8edba20618442a90540a4e8d479506c2bf77a058eb461eea Jul 19 14:51:02.564645 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.564604 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-7vbh4"] Jul 19 14:51:02.566795 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:02.566768 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e5f751_5f2d_4255_9d36_725c766e8c25.slice/crio-73e3f2909a6f76a57639b6dc965a2606cdfc93b6541af567af7c5e5adcfad41a WatchSource:0}: Error finding container 73e3f2909a6f76a57639b6dc965a2606cdfc93b6541af567af7c5e5adcfad41a: Status 404 returned error can't find the container with id 73e3f2909a6f76a57639b6dc965a2606cdfc93b6541af567af7c5e5adcfad41a Jul 19 14:51:02.657647 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:02.657617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:02.657799 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:02.657779 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 19 14:51:02.657864 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:02.657852 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls podName:de47e54b-1766-4bd9-a923-81f26eec7fa8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:03.657831204 +0000 UTC m=+268.371943475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d4rj5" (UID: "de47e54b-1766-4bd9-a923-81f26eec7fa8") : secret "samples-operator-tls" not found Jul 19 14:51:03.510793 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:03.510711 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" event={"ID":"f36fa4ec-c3c3-425c-9289-badff93367a2","Type":"ContainerStarted","Data":"03ac5165d8774dce8edba20618442a90540a4e8d479506c2bf77a058eb461eea"} Jul 19 14:51:03.512660 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:03.512604 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7vbh4" event={"ID":"e8e5f751-5f2d-4255-9d36-725c766e8c25","Type":"ContainerStarted","Data":"73e3f2909a6f76a57639b6dc965a2606cdfc93b6541af567af7c5e5adcfad41a"} Jul 19 14:51:03.671430 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:03.671392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:03.671609 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:03.671546 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 19 14:51:03.671674 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:03.671616 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls podName:de47e54b-1766-4bd9-a923-81f26eec7fa8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:05.671594698 +0000 UTC m=+270.385706971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d4rj5" (UID: "de47e54b-1766-4bd9-a923-81f26eec7fa8") : secret "samples-operator-tls" not found Jul 19 14:51:04.517994 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:04.517955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr" event={"ID":"dd9f7187-473c-4e1b-a90c-c7cebba24d45","Type":"ContainerStarted","Data":"7ec1c59c504b45558d5486cf5a9a6b5dc628c481ee2d6ec12142b30a05cc5054"} Jul 19 14:51:04.531927 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:04.531805 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-588hr" podStartSLOduration=2.119216724 podStartE2EDuration="3.531759709s" totalImagesPullingTime="1.412542985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:04.531764882 +0000 UTC m=+269.245877153" watchObservedRunningTime="2026-07-19 14:51:04.531759709 +0000 UTC m=+269.245871987" Jul 19 14:51:05.689785 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:05.689758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:05.690175 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:05.689867 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 19 14:51:05.690175 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:05.689921 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls podName:de47e54b-1766-4bd9-a923-81f26eec7fa8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:09.689905667 +0000 UTC m=+274.404017926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d4rj5" (UID: "de47e54b-1766-4bd9-a923-81f26eec7fa8") : secret "samples-operator-tls" not found Jul 19 14:51:06.526353 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.526321 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" event={"ID":"aff56ccc-99a3-41c9-8cfb-0533ffcb0274","Type":"ContainerStarted","Data":"f3df3cf479850725e632f064c1224d5d5e82e309d078bc0c1db9bf7a611faaf4"} Jul 19 14:51:06.528045 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.528001 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/0.log" Jul 19 14:51:06.528181 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.528066 2580 generic.go:356] "Generic (PLEG): container finished" podID="f36fa4ec-c3c3-425c-9289-badff93367a2" containerID="66bc3496ec935226a45f05d9cc18cfcbc913199da7635d9bfafa46362b570ccb" exitCode=255 Jul 19 14:51:06.528181 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.528148 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" event={"ID":"f36fa4ec-c3c3-425c-9289-badff93367a2","Type":"ContainerDied","Data":"66bc3496ec935226a45f05d9cc18cfcbc913199da7635d9bfafa46362b570ccb"} Jul 19 14:51:06.528357 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.528341 2580 scope.go:117] "RemoveContainer" containerID="66bc3496ec935226a45f05d9cc18cfcbc913199da7635d9bfafa46362b570ccb" Jul 19 14:51:06.529880 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.529854 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7vbh4" event={"ID":"e8e5f751-5f2d-4255-9d36-725c766e8c25","Type":"ContainerStarted","Data":"0109a2411405069a097c202967cf58984562cca1ee7f1394b58fbac2a6ef0b3b"} Jul 19 14:51:06.541151 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.541104 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" podStartSLOduration=2.411946078 podStartE2EDuration="5.541086907s" totalImagesPullingTime="3.129140829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:06.539947813 +0000 UTC m=+271.254060095" watchObservedRunningTime="2026-07-19 14:51:06.541086907 +0000 UTC m=+271.255199187" Jul 19 14:51:06.555671 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.555576 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-7vbh4" podStartSLOduration=2.572868161 podStartE2EDuration="5.5555627s" totalImagesPullingTime="2.982694539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:06.555056254 +0000 UTC m=+271.269168537" watchObservedRunningTime="2026-07-19 14:51:06.5555627 +0000 UTC m=+271.269674979" Jul 19 14:51:06.812957 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.812884 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6"] Jul 19 14:51:06.815000 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.814980 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6" Jul 19 14:51:06.818081 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.818060 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 19 14:51:06.818370 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.818344 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 19 14:51:06.818470 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.818432 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xpkh9\"" Jul 19 14:51:06.831489 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.831462 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6"] Jul 19 14:51:06.841272 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.841249 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d2fpq"] Jul 19 14:51:06.843847 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.843825 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:06.846422 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.846399 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 19 14:51:06.846523 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.846399 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 19 14:51:06.846523 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.846443 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gskh7\"" Jul 19 14:51:06.859480 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.859452 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d2fpq"] Jul 19 14:51:06.902068 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.902047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:06.902169 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.902084 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2mb2\" (UniqueName: \"kubernetes.io/projected/30e77c07-9afa-4f7f-b163-ffaa6d232954-kube-api-access-p2mb2\") pod \"migrator-7cc9c7ffd7-frlb6\" (UID: \"30e77c07-9afa-4f7f-b163-ffaa6d232954\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6" Jul 19 14:51:06.902169 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.902102 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f9410b2-9e8d-4725-bc3c-7200501992f8-crio-socket\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:06.902240 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.902174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxsvl\" (UniqueName: \"kubernetes.io/projected/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-api-access-wxsvl\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:06.902274 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.902235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:06.902306 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:06.902281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f9410b2-9e8d-4725-bc3c-7200501992f8-data-volume\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.002716 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.002691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f9410b2-9e8d-4725-bc3c-7200501992f8-crio-socket\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.002817 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.002737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxsvl\" (UniqueName: \"kubernetes.io/projected/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-api-access-wxsvl\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.002817 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.002778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.002817 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.002809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f9410b2-9e8d-4725-bc3c-7200501992f8-data-volume\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.002817 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.002808 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f9410b2-9e8d-4725-bc3c-7200501992f8-crio-socket\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.002942 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.002859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.002942 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.002890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mb2\" (UniqueName: \"kubernetes.io/projected/30e77c07-9afa-4f7f-b163-ffaa6d232954-kube-api-access-p2mb2\") pod \"migrator-7cc9c7ffd7-frlb6\" (UID: \"30e77c07-9afa-4f7f-b163-ffaa6d232954\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6" Jul 19 14:51:07.002942 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:07.002929 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 19 14:51:07.003062 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:07.002977 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 19 14:51:07.003062 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:07.002999 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls podName:6f9410b2-9e8d-4725-bc3c-7200501992f8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:07.502980692 +0000 UTC m=+272.217092962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d2fpq" (UID: "6f9410b2-9e8d-4725-bc3c-7200501992f8") : secret "insights-runtime-extractor-tls" not found Jul 19 14:51:07.003062 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:07.003055 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm podName:6f9410b2-9e8d-4725-bc3c-7200501992f8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:07.503041226 +0000 UTC m=+272.217153490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d2fpq" (UID: "6f9410b2-9e8d-4725-bc3c-7200501992f8") : configmap "kube-rbac-proxy" not found Jul 19 14:51:07.003167 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.003149 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f9410b2-9e8d-4725-bc3c-7200501992f8-data-volume\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.012323 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.012293 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxsvl\" (UniqueName: \"kubernetes.io/projected/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-api-access-wxsvl\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.012407 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.012297 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mb2\" (UniqueName: \"kubernetes.io/projected/30e77c07-9afa-4f7f-b163-ffaa6d232954-kube-api-access-p2mb2\") pod \"migrator-7cc9c7ffd7-frlb6\" (UID: \"30e77c07-9afa-4f7f-b163-ffaa6d232954\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6" Jul 19 14:51:07.127700 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.127677 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6" Jul 19 14:51:07.251912 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.251880 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6"] Jul 19 14:51:07.254081 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:07.254055 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e77c07_9afa_4f7f_b163_ffaa6d232954.slice/crio-93ff5039dd2dab3516e6da366eaf34098659f59ecb60ef2e96471133284d5aab WatchSource:0}: Error finding container 93ff5039dd2dab3516e6da366eaf34098659f59ecb60ef2e96471133284d5aab: Status 404 returned error can't find the container with id 93ff5039dd2dab3516e6da366eaf34098659f59ecb60ef2e96471133284d5aab Jul 19 14:51:07.506594 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.506539 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.506671 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.506603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:07.506705 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:07.506684 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 19 14:51:07.506705 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:07.506684 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 19 14:51:07.506769 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:07.506729 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm podName:6f9410b2-9e8d-4725-bc3c-7200501992f8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:08.506716853 +0000 UTC m=+273.220829110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d2fpq" (UID: "6f9410b2-9e8d-4725-bc3c-7200501992f8") : configmap "kube-rbac-proxy" not found Jul 19 14:51:07.506769 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:07.506742 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls podName:6f9410b2-9e8d-4725-bc3c-7200501992f8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:08.506736137 +0000 UTC m=+273.220848394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d2fpq" (UID: "6f9410b2-9e8d-4725-bc3c-7200501992f8") : secret "insights-runtime-extractor-tls" not found Jul 19 14:51:07.533615 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.533585 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6" event={"ID":"30e77c07-9afa-4f7f-b163-ffaa6d232954","Type":"ContainerStarted","Data":"93ff5039dd2dab3516e6da366eaf34098659f59ecb60ef2e96471133284d5aab"} Jul 19 14:51:07.534910 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.534893 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 14:51:07.535260 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.535246 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/0.log" Jul 19 14:51:07.535317 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.535279 2580 generic.go:356] "Generic (PLEG): container finished" podID="f36fa4ec-c3c3-425c-9289-badff93367a2" containerID="d47f9680dbc4c53e1c03fc0af8bef4ec2e8219854d279cd50ed178afa248fc8b" exitCode=255 Jul 19 14:51:07.535317 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.535305 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" event={"ID":"f36fa4ec-c3c3-425c-9289-badff93367a2","Type":"ContainerDied","Data":"d47f9680dbc4c53e1c03fc0af8bef4ec2e8219854d279cd50ed178afa248fc8b"} Jul 19 14:51:07.535383 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.535370 2580 scope.go:117] "RemoveContainer" containerID="66bc3496ec935226a45f05d9cc18cfcbc913199da7635d9bfafa46362b570ccb" Jul 19 14:51:07.535554 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:07.535538 2580 scope.go:117] "RemoveContainer" containerID="d47f9680dbc4c53e1c03fc0af8bef4ec2e8219854d279cd50ed178afa248fc8b" Jul 19 14:51:07.535712 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:07.535687 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-q67m4_openshift-console-operator(f36fa4ec-c3c3-425c-9289-badff93367a2)\"" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" podUID="f36fa4ec-c3c3-425c-9289-badff93367a2" Jul 19 14:51:08.514457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:08.514433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:08.514793 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:08.514529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:08.514793 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:08.514609 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 19 14:51:08.514793 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:08.514609 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 19 14:51:08.514793 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:08.514662 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm podName:6f9410b2-9e8d-4725-bc3c-7200501992f8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:10.514644819 +0000 UTC m=+275.228757085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d2fpq" (UID: "6f9410b2-9e8d-4725-bc3c-7200501992f8") : configmap "kube-rbac-proxy" not found Jul 19 14:51:08.514793 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:08.514745 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls podName:6f9410b2-9e8d-4725-bc3c-7200501992f8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:10.514723772 +0000 UTC m=+275.228836036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d2fpq" (UID: "6f9410b2-9e8d-4725-bc3c-7200501992f8") : secret "insights-runtime-extractor-tls" not found Jul 19 14:51:08.540821 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:08.540800 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 14:51:08.541251 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:08.541228 2580 scope.go:117] "RemoveContainer" containerID="d47f9680dbc4c53e1c03fc0af8bef4ec2e8219854d279cd50ed178afa248fc8b" Jul 19 14:51:08.541468 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:08.541424 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-q67m4_openshift-console-operator(f36fa4ec-c3c3-425c-9289-badff93367a2)\"" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" podUID="f36fa4ec-c3c3-425c-9289-badff93367a2" Jul 19 14:51:08.542720 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:08.542699 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6" event={"ID":"30e77c07-9afa-4f7f-b163-ffaa6d232954","Type":"ContainerStarted","Data":"2631fc0ca06e01af5b767919a0bd5f7440c9d1ce5d43f0629ed02b0b3f21499c"} Jul 19 14:51:08.837592 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:08.837521 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fmxxg_2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b/dns-node-resolver/0.log" Jul 19 14:51:09.549447 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:09.549415 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6" event={"ID":"30e77c07-9afa-4f7f-b163-ffaa6d232954","Type":"ContainerStarted","Data":"27a7de289b2d401c65e37098a174e80c0894fb29b00a11fbdfce15621486dd56"} Jul 19 14:51:09.565099 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:09.564934 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-frlb6" podStartSLOduration=2.358615107 podStartE2EDuration="3.564917114s" totalImagesPullingTime="1.206302007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:09.564571536 +0000 UTC m=+274.278683816" watchObservedRunningTime="2026-07-19 14:51:09.564917114 +0000 UTC m=+274.279029393" Jul 19 14:51:09.723715 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:09.723692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:09.723852 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:09.723835 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 19 14:51:09.723904 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:09.723891 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls podName:de47e54b-1766-4bd9-a923-81f26eec7fa8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:17.723877514 +0000 UTC m=+282.437989775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d4rj5" (UID: "de47e54b-1766-4bd9-a923-81f26eec7fa8") : secret "samples-operator-tls" not found Jul 19 14:51:10.037724 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:10.037704 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rhrjr_73a5d9ce-871b-4fc8-8642-3f931640aa86/node-ca/0.log" Jul 19 14:51:10.529861 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:10.529828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:10.529998 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:10.529896 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:10.529998 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:10.529964 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 19 14:51:10.529998 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:10.529972 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 19 14:51:10.530124 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:10.530042 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm podName:6f9410b2-9e8d-4725-bc3c-7200501992f8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:14.530025904 +0000 UTC m=+279.244138190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d2fpq" (UID: "6f9410b2-9e8d-4725-bc3c-7200501992f8") : configmap "kube-rbac-proxy" not found Jul 19 14:51:10.530124 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:10.530057 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls podName:6f9410b2-9e8d-4725-bc3c-7200501992f8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:14.530050926 +0000 UTC m=+279.244163183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d2fpq" (UID: "6f9410b2-9e8d-4725-bc3c-7200501992f8") : secret "insights-runtime-extractor-tls" not found Jul 19 14:51:10.636765 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:10.636743 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6r4tz_9654b2f6-3e26-4fdd-8ce3-a509a8753b8a/serve-healthcheck-canary/0.log" Jul 19 14:51:12.186957 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:12.186922 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:12.187447 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:12.186995 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:12.187447 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:12.187406 2580 scope.go:117] "RemoveContainer" containerID="d47f9680dbc4c53e1c03fc0af8bef4ec2e8219854d279cd50ed178afa248fc8b" Jul 19 14:51:12.187621 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:12.187598 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-q67m4_openshift-console-operator(f36fa4ec-c3c3-425c-9289-badff93367a2)\"" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" podUID="f36fa4ec-c3c3-425c-9289-badff93367a2" Jul 19 14:51:14.564068 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:14.564031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:14.564505 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:14.564130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:14.564505 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:14.564192 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 19 14:51:14.564505 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:14.564230 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 19 14:51:14.564505 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:14.564272 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls podName:6f9410b2-9e8d-4725-bc3c-7200501992f8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:22.564253994 +0000 UTC m=+287.278366250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d2fpq" (UID: "6f9410b2-9e8d-4725-bc3c-7200501992f8") : secret "insights-runtime-extractor-tls" not found Jul 19 14:51:14.564505 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:14.564288 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm podName:6f9410b2-9e8d-4725-bc3c-7200501992f8 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:22.564280703 +0000 UTC m=+287.278392960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d2fpq" (UID: "6f9410b2-9e8d-4725-bc3c-7200501992f8") : configmap "kube-rbac-proxy" not found Jul 19 14:51:17.788629 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:17.788596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:17.790924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:17.790902 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de47e54b-1766-4bd9-a923-81f26eec7fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d4rj5\" (UID: \"de47e54b-1766-4bd9-a923-81f26eec7fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:18.081862 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:18.081788 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" Jul 19 14:51:18.203079 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:18.202938 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5"] Jul 19 14:51:18.248494 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:18.248467 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" podUID="f7aa48da-331e-47c7-b787-e034c4a24046" Jul 19 14:51:18.248609 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:18.248469 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z5g48" podUID="c185d060-0ddf-4918-9330-8677891cdc3b" Jul 19 14:51:18.248609 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:18.248469 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" podUID="7ab6e450-5a6b-4791-b1f0-a1f3605eca41" Jul 19 14:51:18.577994 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:18.577968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:51:18.577994 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:18.577981 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5g48" Jul 19 14:51:18.577994 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:18.577979 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" event={"ID":"de47e54b-1766-4bd9-a923-81f26eec7fa8","Type":"ContainerStarted","Data":"4e05abf886da7cfcc230a4790511da2084bd9dd8e42d72decf9708a2b94378e4"} Jul 19 14:51:18.577994 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:18.577981 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:51:20.585860 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:20.585784 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" event={"ID":"de47e54b-1766-4bd9-a923-81f26eec7fa8","Type":"ContainerStarted","Data":"6010cedd0852a5a90a915c045aba1eed961f6cc00098be5eba62181ace0caf4f"} Jul 19 14:51:20.585860 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:20.585834 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" event={"ID":"de47e54b-1766-4bd9-a923-81f26eec7fa8","Type":"ContainerStarted","Data":"c528f2168634de327ee2a70cfb45a96183d1f00f0993dba16843844aeb2e129c"} Jul 19 14:51:20.601228 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:20.601183 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d4rj5" podStartSLOduration=17.720342804 podStartE2EDuration="19.60116879s" totalImagesPullingTime="1.880825986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:20.59997287 +0000 UTC m=+285.314085150" watchObservedRunningTime="2026-07-19 14:51:20.60116879 +0000 UTC m=+285.315281069" Jul 19 14:51:21.518850 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.518811 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:51:21.519057 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.518925 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:51:21.521366 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.521332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7aa48da-331e-47c7-b787-e034c4a24046-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cqql5\" (UID: \"f7aa48da-331e-47c7-b787-e034c4a24046\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:51:21.521479 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.521332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"image-registry-64d74c75f7-ctv5x\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:51:21.582438 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.582410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bbjc4\"" Jul 19 14:51:21.582438 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.582415 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g8q88\"" Jul 19 14:51:21.589760 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.589730 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" Jul 19 14:51:21.591989 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.591958 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:51:21.619860 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.619826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:51:21.622202 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.622175 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c185d060-0ddf-4918-9330-8677891cdc3b-metrics-tls\") pod \"dns-default-z5g48\" (UID: \"c185d060-0ddf-4918-9330-8677891cdc3b\") " pod="openshift-dns/dns-default-z5g48" Jul 19 14:51:21.747256 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.747093 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64d74c75f7-ctv5x"] Jul 19 14:51:21.749840 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:21.749817 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab6e450_5a6b_4791_b1f0_a1f3605eca41.slice/crio-c2be5239b476c7d70e749e4190a78f619e361dca7c6211f07608378fdc74c346 WatchSource:0}: Error finding container c2be5239b476c7d70e749e4190a78f619e361dca7c6211f07608378fdc74c346: Status 404 returned error can't find the container with id c2be5239b476c7d70e749e4190a78f619e361dca7c6211f07608378fdc74c346 Jul 19 14:51:21.762113 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.762067 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5"] Jul 19 14:51:21.767130 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:21.767106 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7aa48da_331e_47c7_b787_e034c4a24046.slice/crio-e7a4b5e6843427df9be24a3dc2bdb5f8e3272d53fa6b8ec07494a2f985d05112 WatchSource:0}: Error finding container e7a4b5e6843427df9be24a3dc2bdb5f8e3272d53fa6b8ec07494a2f985d05112: Status 404 returned error can't find the container with id e7a4b5e6843427df9be24a3dc2bdb5f8e3272d53fa6b8ec07494a2f985d05112 Jul 19 14:51:21.881518 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.881498 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4r258\"" Jul 19 14:51:21.890288 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:21.890271 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5g48" Jul 19 14:51:22.009404 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.009354 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z5g48"] Jul 19 14:51:22.013903 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:22.013879 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc185d060_0ddf_4918_9330_8677891cdc3b.slice/crio-417ae23dd5ce7836884b6d161d3755756bd029418f9b004b2ad3998908fa26a9 WatchSource:0}: Error finding container 417ae23dd5ce7836884b6d161d3755756bd029418f9b004b2ad3998908fa26a9: Status 404 returned error can't find the container with id 417ae23dd5ce7836884b6d161d3755756bd029418f9b004b2ad3998908fa26a9 Jul 19 14:51:22.600622 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.600578 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5g48" event={"ID":"c185d060-0ddf-4918-9330-8677891cdc3b","Type":"ContainerStarted","Data":"417ae23dd5ce7836884b6d161d3755756bd029418f9b004b2ad3998908fa26a9"} Jul 19 14:51:22.601902 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.601868 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" event={"ID":"f7aa48da-331e-47c7-b787-e034c4a24046","Type":"ContainerStarted","Data":"e7a4b5e6843427df9be24a3dc2bdb5f8e3272d53fa6b8ec07494a2f985d05112"} Jul 19 14:51:22.603361 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.603336 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" event={"ID":"7ab6e450-5a6b-4791-b1f0-a1f3605eca41","Type":"ContainerStarted","Data":"b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e"} Jul 19 14:51:22.603467 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.603381 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" event={"ID":"7ab6e450-5a6b-4791-b1f0-a1f3605eca41","Type":"ContainerStarted","Data":"c2be5239b476c7d70e749e4190a78f619e361dca7c6211f07608378fdc74c346"} Jul 19 14:51:22.603542 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.603509 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:51:22.620924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.620873 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" podStartSLOduration=286.620857566 podStartE2EDuration="4m46.620857566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:22.620062332 +0000 UTC m=+287.334174682" watchObservedRunningTime="2026-07-19 14:51:22.620857566 +0000 UTC m=+287.334969846" Jul 19 14:51:22.636893 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.636862 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:22.636992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.636929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:22.637516 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.637492 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f9410b2-9e8d-4725-bc3c-7200501992f8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:22.639639 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.639580 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f9410b2-9e8d-4725-bc3c-7200501992f8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d2fpq\" (UID: \"6f9410b2-9e8d-4725-bc3c-7200501992f8\") " pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:22.752757 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.752731 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d2fpq" Jul 19 14:51:22.782213 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:22.782173 2580 scope.go:117] "RemoveContainer" containerID="d47f9680dbc4c53e1c03fc0af8bef4ec2e8219854d279cd50ed178afa248fc8b" Jul 19 14:51:23.175794 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:23.175765 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d2fpq"] Jul 19 14:51:23.178655 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:23.178633 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9410b2_9e8d_4725_bc3c_7200501992f8.slice/crio-6fb9ad9aded6faf84803612c97c51ca06a60fb63f72f85960e3c205622d15b14 WatchSource:0}: Error finding container 6fb9ad9aded6faf84803612c97c51ca06a60fb63f72f85960e3c205622d15b14: Status 404 returned error can't find the container with id 6fb9ad9aded6faf84803612c97c51ca06a60fb63f72f85960e3c205622d15b14 Jul 19 14:51:23.613604 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:23.612771 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" event={"ID":"f7aa48da-331e-47c7-b787-e034c4a24046","Type":"ContainerStarted","Data":"5bc80f50b66d0f93c5c6b67dbe5d539329229619fa623075c33a2e89ad13a3d0"} Jul 19 14:51:23.615404 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:23.615317 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d2fpq" event={"ID":"6f9410b2-9e8d-4725-bc3c-7200501992f8","Type":"ContainerStarted","Data":"6fb9ad9aded6faf84803612c97c51ca06a60fb63f72f85960e3c205622d15b14"} Jul 19 14:51:23.618995 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:23.618293 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 14:51:23.618995 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:23.618807 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" event={"ID":"f36fa4ec-c3c3-425c-9289-badff93367a2","Type":"ContainerStarted","Data":"dca617c15ad433421e9b12e6882ec991c2b57f30fbea54a573e6965c2dcb4e85"} Jul 19 14:51:23.619351 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:23.619298 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:23.628960 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:23.628717 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cqql5" podStartSLOduration=261.306885774 podStartE2EDuration="4m22.628699769s" totalImagesPullingTime="1.321813995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:23.627315384 +0000 UTC m=+288.341427663" watchObservedRunningTime="2026-07-19 14:51:23.628699769 +0000 UTC m=+288.342812049" Jul 19 14:51:23.643328 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:23.643172 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" podStartSLOduration=19.65718837 podStartE2EDuration="22.643155342s" totalImagesPullingTime="2.985966972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:23.641384061 +0000 UTC m=+288.355496343" watchObservedRunningTime="2026-07-19 14:51:23.643155342 +0000 UTC m=+288.357267622" Jul 19 14:51:23.870111 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:23.869869 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-q67m4" Jul 19 14:51:24.623767 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:24.623724 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5g48" event={"ID":"c185d060-0ddf-4918-9330-8677891cdc3b","Type":"ContainerStarted","Data":"1eed12e778283f1b681a24231bd2f70561b628a1dec4030f9df08f3ccfd5a8ce"} Jul 19 14:51:24.624244 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:24.623795 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5g48" event={"ID":"c185d060-0ddf-4918-9330-8677891cdc3b","Type":"ContainerStarted","Data":"953beeb7b1bcc2b2657efe74bb83b3fc2130418a4373c03dd2ef34fd534ddf7e"} Jul 19 14:51:24.644901 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:24.644843 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z5g48" podStartSLOduration=251.37939064 podStartE2EDuration="4m13.644825308s" totalImagesPullingTime="2.265434668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:24.643803601 +0000 UTC m=+289.357915883" watchObservedRunningTime="2026-07-19 14:51:24.644825308 +0000 UTC m=+289.358937588" Jul 19 14:51:25.630347 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:25.630314 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z5g48" Jul 19 14:51:28.643730 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:28.643689 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d2fpq" event={"ID":"6f9410b2-9e8d-4725-bc3c-7200501992f8","Type":"ContainerStarted","Data":"f9a0a1280c1aefb4984437fc2432ffca6324863a6ee959f1f6cc8619fa790047"} Jul 19 14:51:28.784207 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:28.784149 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r28nx" podUID="3467f795-87e7-46aa-821b-f854cdc83634" Jul 19 14:51:30.388169 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:30.388136 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-xb5k7"] Jul 19 14:51:30.409921 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:30.409887 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-xb5k7"] Jul 19 14:51:30.410115 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:30.410033 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-xb5k7" Jul 19 14:51:30.413151 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:30.412989 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 19 14:51:30.413151 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:30.413066 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-thss7\"" Jul 19 14:51:30.413401 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:30.413383 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 19 14:51:30.503643 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:30.503615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll7wn\" (UniqueName: \"kubernetes.io/projected/d0e09800-a4bc-4d51-aa75-2a3533d709a3-kube-api-access-ll7wn\") pod \"downloads-5bc67dcd46-xb5k7\" (UID: \"d0e09800-a4bc-4d51-aa75-2a3533d709a3\") " pod="openshift-console/downloads-5bc67dcd46-xb5k7" Jul 19 14:51:30.604420 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:30.604376 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll7wn\" (UniqueName: \"kubernetes.io/projected/d0e09800-a4bc-4d51-aa75-2a3533d709a3-kube-api-access-ll7wn\") pod \"downloads-5bc67dcd46-xb5k7\" (UID: \"d0e09800-a4bc-4d51-aa75-2a3533d709a3\") " pod="openshift-console/downloads-5bc67dcd46-xb5k7" Jul 19 14:51:30.620040 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:30.619992 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll7wn\" (UniqueName: \"kubernetes.io/projected/d0e09800-a4bc-4d51-aa75-2a3533d709a3-kube-api-access-ll7wn\") pod \"downloads-5bc67dcd46-xb5k7\" (UID: \"d0e09800-a4bc-4d51-aa75-2a3533d709a3\") " pod="openshift-console/downloads-5bc67dcd46-xb5k7" Jul 19 14:51:30.721410 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:30.721348 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-xb5k7" Jul 19 14:51:31.472472 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:31.472442 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-xb5k7"] Jul 19 14:51:31.475944 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:31.475923 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e09800_a4bc_4d51_aa75_2a3533d709a3.slice/crio-db4bee37f73fea47860906c23033219bb222c6ec92ded70f3aa306e70993e2c4 WatchSource:0}: Error finding container db4bee37f73fea47860906c23033219bb222c6ec92ded70f3aa306e70993e2c4: Status 404 returned error can't find the container with id db4bee37f73fea47860906c23033219bb222c6ec92ded70f3aa306e70993e2c4 Jul 19 14:51:31.658393 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:31.658360 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-xb5k7" event={"ID":"d0e09800-a4bc-4d51-aa75-2a3533d709a3","Type":"ContainerStarted","Data":"db4bee37f73fea47860906c23033219bb222c6ec92ded70f3aa306e70993e2c4"} Jul 19 14:51:31.659861 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:31.659838 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d2fpq" event={"ID":"6f9410b2-9e8d-4725-bc3c-7200501992f8","Type":"ContainerStarted","Data":"23b1225cedd9180372d9439ef81e72d65fb13d882caff651516867c829d0cdb9"} Jul 19 14:51:35.636240 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:35.636209 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z5g48" Jul 19 14:51:35.679757 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:35.679724 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d2fpq" event={"ID":"6f9410b2-9e8d-4725-bc3c-7200501992f8","Type":"ContainerStarted","Data":"ba443fee3b23ff1485866bb4d35f00e988b4f456be28ef1947b04492c49109f6"} Jul 19 14:51:35.696955 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:35.696908 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d2fpq" podStartSLOduration=17.767605104 podStartE2EDuration="29.696889241s" totalImagesPullingTime="11.929284137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:51:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:35.695643067 +0000 UTC m=+300.409755348" watchObservedRunningTime="2026-07-19 14:51:35.696889241 +0000 UTC m=+300.411001524" Jul 19 14:51:35.727992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:35.727964 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 14:51:35.728577 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:35.728556 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 14:51:35.741672 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:35.741655 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 19 14:51:37.671415 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:37.671382 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4"] Jul 19 14:51:37.674639 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:37.674613 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" Jul 19 14:51:37.676842 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:37.676819 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 19 14:51:37.676970 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:37.676933 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bp56r\"" Jul 19 14:51:37.682216 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:37.682155 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4"] Jul 19 14:51:37.764377 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:37.764343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e7caeaae-ba2d-46c0-90db-28bcf39e8009-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zj8b4\" (UID: \"e7caeaae-ba2d-46c0-90db-28bcf39e8009\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" Jul 19 14:51:37.864783 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:37.864751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e7caeaae-ba2d-46c0-90db-28bcf39e8009-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zj8b4\" (UID: \"e7caeaae-ba2d-46c0-90db-28bcf39e8009\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" Jul 19 14:51:37.864920 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:37.864888 2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 19 14:51:37.864989 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:37.864977 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7caeaae-ba2d-46c0-90db-28bcf39e8009-tls-certificates podName:e7caeaae-ba2d-46c0-90db-28bcf39e8009 nodeName:}" failed. No retries permitted until 2026-07-19 14:51:38.364958619 +0000 UTC m=+303.079070897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e7caeaae-ba2d-46c0-90db-28bcf39e8009-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-zj8b4" (UID: "e7caeaae-ba2d-46c0-90db-28bcf39e8009") : secret "prometheus-operator-admission-webhook-tls" not found Jul 19 14:51:38.368709 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:38.368676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e7caeaae-ba2d-46c0-90db-28bcf39e8009-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zj8b4\" (UID: \"e7caeaae-ba2d-46c0-90db-28bcf39e8009\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" Jul 19 14:51:38.371159 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:38.371119 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e7caeaae-ba2d-46c0-90db-28bcf39e8009-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zj8b4\" (UID: \"e7caeaae-ba2d-46c0-90db-28bcf39e8009\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" Jul 19 14:51:38.584739 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:38.584706 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" Jul 19 14:51:38.748694 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:38.748663 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4"] Jul 19 14:51:38.752260 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:38.752229 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7caeaae_ba2d_46c0_90db_28bcf39e8009.slice/crio-04a913878551202933cb613648854446380d8037d49a2985cfb851077fe3bada WatchSource:0}: Error finding container 04a913878551202933cb613648854446380d8037d49a2985cfb851077fe3bada: Status 404 returned error can't find the container with id 04a913878551202933cb613648854446380d8037d49a2985cfb851077fe3bada Jul 19 14:51:38.754758 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:38.754736 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 19 14:51:39.696803 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:39.696763 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" event={"ID":"e7caeaae-ba2d-46c0-90db-28bcf39e8009","Type":"ContainerStarted","Data":"04a913878551202933cb613648854446380d8037d49a2985cfb851077fe3bada"} Jul 19 14:51:40.702210 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:40.702165 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" event={"ID":"e7caeaae-ba2d-46c0-90db-28bcf39e8009","Type":"ContainerStarted","Data":"4c54574ac69cdc2e2230ce3952633bf7fe2c9ad6cb91c649a35404e9ce60a4cc"} Jul 19 14:51:40.702635 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:40.702470 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" Jul 19 14:51:40.707957 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:40.707936 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" Jul 19 14:51:40.716959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:40.716912 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj8b4" podStartSLOduration=2.112053732 podStartE2EDuration="3.716894731s" totalImagesPullingTime="1.604840999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:40.716429169 +0000 UTC m=+305.430541448" watchObservedRunningTime="2026-07-19 14:51:40.716894731 +0000 UTC m=+305.431007012" Jul 19 14:51:40.781652 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:40.781629 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:51:41.597061 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.596991 2580 patch_prober.go:28] interesting pod/image-registry-64d74c75f7-ctv5x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 19 14:51:41.597229 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.597067 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" podUID="7ab6e450-5a6b-4791-b1f0-a1f3605eca41" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 19 14:51:41.725355 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.725321 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp"] Jul 19 14:51:41.728269 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.728248 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:41.730454 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.730434 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 19 14:51:41.730587 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.730484 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 19 14:51:41.730587 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.730487 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 19 14:51:41.730587 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.730582 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 19 14:51:41.731410 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.731341 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7p2rw\"" Jul 19 14:51:41.731410 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.731377 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 19 14:51:41.737296 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.737277 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp"] Jul 19 14:51:41.898090 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.898059 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bn27\" (UniqueName: \"kubernetes.io/projected/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-kube-api-access-6bn27\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:41.898278 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.898111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:41.898278 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.898215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:41.898278 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.898254 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:41.999275 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.999233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bn27\" (UniqueName: \"kubernetes.io/projected/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-kube-api-access-6bn27\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:41.999430 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.999369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:41.999486 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.999459 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:41.999568 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:41.999544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:42.000206 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:42.000181 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:42.002046 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:42.001997 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:42.002192 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:42.002166 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:42.006734 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:42.006707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bn27\" (UniqueName: \"kubernetes.io/projected/65ff5cf1-5ce1-4218-ae0b-00b48848c9c3-kube-api-access-6bn27\") pod \"prometheus-operator-5945b5cfd-6mbwp\" (UID: \"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:42.039569 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:42.039547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" Jul 19 14:51:43.624762 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:43.624716 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:51:48.234272 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:48.234246 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp"] Jul 19 14:51:48.291516 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:48.291473 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ff5cf1_5ce1_4218_ae0b_00b48848c9c3.slice/crio-b2c8088e087d3b59b7ac9c9ec399a567be477bc12b252c41d9be970040214e0b WatchSource:0}: Error finding container b2c8088e087d3b59b7ac9c9ec399a567be477bc12b252c41d9be970040214e0b: Status 404 returned error can't find the container with id b2c8088e087d3b59b7ac9c9ec399a567be477bc12b252c41d9be970040214e0b Jul 19 14:51:48.737237 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:48.737134 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-xb5k7" event={"ID":"d0e09800-a4bc-4d51-aa75-2a3533d709a3","Type":"ContainerStarted","Data":"0a756d9ffa87e56ca758249e38b8b1df6c37fb61ad06d0adc92079dfeb7752ff"} Jul 19 14:51:48.737408 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:48.737352 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-xb5k7" Jul 19 14:51:48.738716 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:48.738683 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" event={"ID":"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3","Type":"ContainerStarted","Data":"b2c8088e087d3b59b7ac9c9ec399a567be477bc12b252c41d9be970040214e0b"} Jul 19 14:51:48.755791 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:48.755763 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-xb5k7" Jul 19 14:51:48.756662 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:48.756621 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-xb5k7" podStartSLOduration=1.8844252400000001 podStartE2EDuration="18.756607932s" totalImagesPullingTime="16.872182692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:48.755055541 +0000 UTC m=+313.469167822" watchObservedRunningTime="2026-07-19 14:51:48.756607932 +0000 UTC m=+313.470720210" Jul 19 14:51:50.748751 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:50.748709 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" event={"ID":"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3","Type":"ContainerStarted","Data":"2558261001edbce27a699e88c0f8fa9aa329da142cf67e42adb358e0208de7c5"} Jul 19 14:51:50.749232 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:50.748782 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" event={"ID":"65ff5cf1-5ce1-4218-ae0b-00b48848c9c3","Type":"ContainerStarted","Data":"07c0a17b0ea37988182c8b4c3c95ce1c83c7a483ba119d54cb49ae66df7e94ec"} Jul 19 14:51:50.771402 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:50.771356 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-6mbwp" podStartSLOduration=7.821208301 podStartE2EDuration="9.77134121s" totalImagesPullingTime="1.950132909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:50.770594412 +0000 UTC m=+315.484706692" watchObservedRunningTime="2026-07-19 14:51:50.77134121 +0000 UTC m=+315.485453489" Jul 19 14:51:53.141599 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.141562 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f6r8c"] Jul 19 14:51:53.181593 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.181565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.184150 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.184123 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 19 14:51:53.184484 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.184465 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 19 14:51:53.184484 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.184467 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tfpqx\"" Jul 19 14:51:53.184700 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.184565 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 19 14:51:53.202500 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.202475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-metrics-client-ca\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.202619 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.202516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-tls\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.202619 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.202577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-textfile\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.202619 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.202611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-wtmp\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.202771 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.202669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-sys\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.202771 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.202712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-root\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.202771 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.202734 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f46nz\" (UniqueName: \"kubernetes.io/projected/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-kube-api-access-f46nz\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.202771 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.202764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.202954 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.202785 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.303381 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-root\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.303544 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f46nz\" (UniqueName: \"kubernetes.io/projected/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-kube-api-access-f46nz\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.303544 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303421 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.303544 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303450 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.303544 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303471 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-root\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.303544 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303518 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-metrics-client-ca\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.303801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-tls\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.303801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303590 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-textfile\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.303801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-wtmp\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.303801 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-sys\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.304002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303828 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-wtmp\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.304002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.303870 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-sys\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.304132 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.304059 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.304192 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.304133 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-textfile\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.304655 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.304634 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-metrics-client-ca\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.306179 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.306156 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.306445 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.306425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-node-exporter-tls\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.311676 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.311635 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f46nz\" (UniqueName: \"kubernetes.io/projected/2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82-kube-api-access-f46nz\") pod \"node-exporter-f6r8c\" (UID: \"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82\") " pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.493484 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.493405 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f6r8c" Jul 19 14:51:53.545560 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:53.545530 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4c9769_2e7b_49f6_9eb5_e54fb0bf9c82.slice/crio-8db46788f3f0e1706d3334a0cd21b6584185f4b1e99999e929d549f8f1aa1eab WatchSource:0}: Error finding container 8db46788f3f0e1706d3334a0cd21b6584185f4b1e99999e929d549f8f1aa1eab: Status 404 returned error can't find the container with id 8db46788f3f0e1706d3334a0cd21b6584185f4b1e99999e929d549f8f1aa1eab Jul 19 14:51:53.764285 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.764202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6r8c" event={"ID":"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82","Type":"ContainerStarted","Data":"8db46788f3f0e1706d3334a0cd21b6584185f4b1e99999e929d549f8f1aa1eab"} Jul 19 14:51:53.786513 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:53.786480 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64d74c75f7-ctv5x"] Jul 19 14:51:54.145934 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.145896 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 14:51:54.172580 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.172544 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 14:51:54.172802 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.172776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.175564 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.175540 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 19 14:51:54.176228 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.175859 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 19 14:51:54.176228 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.176093 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 19 14:51:54.180039 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.176463 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tj664\"" Jul 19 14:51:54.180039 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.176685 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 19 14:51:54.180039 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.177323 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 19 14:51:54.180039 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.178634 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 19 14:51:54.180039 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.178819 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 19 14:51:54.180039 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.179044 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 19 14:51:54.180039 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.179278 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 19 14:51:54.211481 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.211609 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211501 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-config-volume\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.211609 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211556 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.211746 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.211746 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-config-out\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.211746 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.211894 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211745 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.211894 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211769 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkxx6\" (UniqueName: \"kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-kube-api-access-jkxx6\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.211894 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-web-config\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.211894 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.211894 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211867 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.212226 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.212226 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.211923 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313306 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313306 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313310 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-config-volume\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313538 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313597 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313653 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-config-out\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313653 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313653 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313645 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313809 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkxx6\" (UniqueName: \"kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-kube-api-access-jkxx6\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313809 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-web-config\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313809 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313809 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.313809 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.314094 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.313821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.314818 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.314792 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.314913 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:54.314878 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-trusted-ca-bundle podName:aba13878-b119-4552-8b07-c4cbe113e21e nodeName:}" failed. No retries permitted until 2026-07-19 14:51:54.81484993 +0000 UTC m=+319.528962192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e") : configmap references non-existent config key: ca-bundle.crt Jul 19 14:51:54.315531 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:54.315165 2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 19 14:51:54.315531 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:51:54.315213 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-main-tls podName:aba13878-b119-4552-8b07-c4cbe113e21e nodeName:}" failed. No retries permitted until 2026-07-19 14:51:54.815200144 +0000 UTC m=+319.529312402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e") : secret "alertmanager-main-tls" not found Jul 19 14:51:54.316273 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.315933 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.317787 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.317760 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.318559 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.318509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.319318 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.319271 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-config-out\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.319417 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.319376 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.319476 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.319442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.320890 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.320865 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-web-config\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.321631 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.321602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.322341 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.322247 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-config-volume\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.323885 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.323863 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkxx6\" (UniqueName: \"kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-kube-api-access-jkxx6\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.818841 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.818802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.819037 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.818853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.819774 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.819747 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:54.821529 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:54.821501 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:55.086822 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:55.086740 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:51:55.275076 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:55.275050 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 14:51:55.277637 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:55.277606 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba13878_b119_4552_8b07_c4cbe113e21e.slice/crio-08c4782652023a64ddcb693f89c856f065a527d25950a90d52128b17456f55a5 WatchSource:0}: Error finding container 08c4782652023a64ddcb693f89c856f065a527d25950a90d52128b17456f55a5: Status 404 returned error can't find the container with id 08c4782652023a64ddcb693f89c856f065a527d25950a90d52128b17456f55a5 Jul 19 14:51:55.774336 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:55.774300 2580 generic.go:356] "Generic (PLEG): container finished" podID="2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82" containerID="1d5a07ee3d45d488c022ba3e95a2473e9c3e8ee26b4016d302e834bf472d21d4" exitCode=0 Jul 19 14:51:55.774599 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:55.774395 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6r8c" event={"ID":"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82","Type":"ContainerDied","Data":"1d5a07ee3d45d488c022ba3e95a2473e9c3e8ee26b4016d302e834bf472d21d4"} Jul 19 14:51:55.775830 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:55.775796 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerStarted","Data":"08c4782652023a64ddcb693f89c856f065a527d25950a90d52128b17456f55a5"} Jul 19 14:51:56.782777 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:56.782731 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6r8c" event={"ID":"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82","Type":"ContainerStarted","Data":"207f599a02c585fa10c3d7a32ad527886d37905f3cabe6195e2e4ff4edd1917b"} Jul 19 14:51:56.783219 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:56.782794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6r8c" event={"ID":"2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82","Type":"ContainerStarted","Data":"f18300248aa99993263e78407e825dd93a782e78220800e96c57648d03f4f387"} Jul 19 14:51:56.801980 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:56.801932 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f6r8c" podStartSLOduration=2.144235607 podStartE2EDuration="3.801918508s" totalImagesPullingTime="1.573198555s" totalInitContainerRuntime="84.484346ms" isStatefulPod=true podCreationTimestamp="2026-07-19 14:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:51:56.801184677 +0000 UTC m=+321.515296995" watchObservedRunningTime="2026-07-19 14:51:56.801918508 +0000 UTC m=+321.516030786" Jul 19 14:51:57.787647 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.787614 2580 generic.go:356] "Generic (PLEG): container finished" podID="aba13878-b119-4552-8b07-c4cbe113e21e" containerID="04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53" exitCode=0 Jul 19 14:51:57.788051 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.787693 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerDied","Data":"04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53"} Jul 19 14:51:57.869335 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.869304 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8566f859cc-8q4gj"] Jul 19 14:51:57.899776 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.899737 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8566f859cc-8q4gj"] Jul 19 14:51:57.899937 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.899861 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:57.904279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.904068 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 19 14:51:57.904279 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.904122 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 19 14:51:57.904470 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.904415 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 19 14:51:57.905619 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.904699 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 19 14:51:57.905619 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.904733 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 19 14:51:57.905619 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.905040 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7m7q9\"" Jul 19 14:51:57.909110 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.909087 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 19 14:51:57.956330 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.956307 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-serving-cert\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:57.956464 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.956349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn2ht\" (UniqueName: \"kubernetes.io/projected/b058e014-3a77-4954-907b-8f2fec390494-kube-api-access-cn2ht\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:57.956464 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.956385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-service-ca\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:57.956464 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.956400 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-trusted-ca-bundle\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:57.956464 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.956418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-oauth-config\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:57.956464 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.956461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-console-config\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:57.956649 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:57.956523 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-oauth-serving-cert\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.057133 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.057065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-oauth-serving-cert\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.057133 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.057099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-serving-cert\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.057133 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.057125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn2ht\" (UniqueName: \"kubernetes.io/projected/b058e014-3a77-4954-907b-8f2fec390494-kube-api-access-cn2ht\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.057303 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.057259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-service-ca\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.057303 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.057295 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-trusted-ca-bundle\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.057377 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.057320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-oauth-config\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.057412 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.057382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-console-config\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.057888 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.057862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-oauth-serving-cert\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.058004 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.057905 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-service-ca\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.058131 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.058105 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-console-config\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.058228 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.058174 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-trusted-ca-bundle\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.059645 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.059626 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-serving-cert\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.059745 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.059684 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-oauth-config\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.064262 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.064244 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn2ht\" (UniqueName: \"kubernetes.io/projected/b058e014-3a77-4954-907b-8f2fec390494-kube-api-access-cn2ht\") pod \"console-8566f859cc-8q4gj\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.213105 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.213084 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:51:58.359623 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.359598 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8566f859cc-8q4gj"] Jul 19 14:51:58.361413 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:51:58.361380 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb058e014_3a77_4954_907b_8f2fec390494.slice/crio-3bfc14db272ab2661a104277a444558000d9bc696f59816240dbb583b0bc7d86 WatchSource:0}: Error finding container 3bfc14db272ab2661a104277a444558000d9bc696f59816240dbb583b0bc7d86: Status 404 returned error can't find the container with id 3bfc14db272ab2661a104277a444558000d9bc696f59816240dbb583b0bc7d86 Jul 19 14:51:58.792515 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:58.792482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8566f859cc-8q4gj" event={"ID":"b058e014-3a77-4954-907b-8f2fec390494","Type":"ContainerStarted","Data":"3bfc14db272ab2661a104277a444558000d9bc696f59816240dbb583b0bc7d86"} Jul 19 14:51:59.315368 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.315041 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 19 14:51:59.340082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.339034 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 19 14:51:59.340082 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.339207 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.351268 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.351497 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.351682 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.351993 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.352216 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9ftd6\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.352914 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.353133 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.353331 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7f1noah7d96jt\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.353633 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.353822 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.354034 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.354234 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 19 14:51:59.357796 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.354403 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 19 14:51:59.368489 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.359078 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 19 14:51:59.368489 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.359308 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 19 14:51:59.368489 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.359463 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 19 14:51:59.368489 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.364362 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 19 14:51:59.469173 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469187 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469213 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-web-config\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469344 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469423 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrd2g\" (UniqueName: \"kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-kube-api-access-hrd2g\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469617 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config-out\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469757 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.469924 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.469808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.570871 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.570789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.570871 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.570832 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.570871 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.570860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.570883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.570909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.570936 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.570960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-web-config\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.570986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrd2g\" (UniqueName: \"kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-kube-api-access-hrd2g\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config-out\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571297 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.574234 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.571411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.575137 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.572092 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.575137 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.572521 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.575137 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.572893 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.576125 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.575692 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.579582 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.578860 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.579582 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.579126 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.579582 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.579439 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.580396 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.579881 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-web-config\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.580396 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.579942 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config-out\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.580396 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.580358 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.580594 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.580562 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.581648 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.581618 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.581764 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.581741 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.582391 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.582350 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.583617 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.583497 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.583617 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.583591 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.584411 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.584299 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.585233 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.585150 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.586150 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.585987 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrd2g\" (UniqueName: \"kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-kube-api-access-hrd2g\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.586547 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.586496 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.675605 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.675340 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:51:59.895868 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:51:59.895843 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 19 14:52:00.019874 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:52:00.019843 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7258c92f_c61e_4dbf_ab22_fb4b7006c003.slice/crio-78fa337262e855c61b1eb167788abbd1062cd6cb21e91cccfecb3d0321262d02 WatchSource:0}: Error finding container 78fa337262e855c61b1eb167788abbd1062cd6cb21e91cccfecb3d0321262d02: Status 404 returned error can't find the container with id 78fa337262e855c61b1eb167788abbd1062cd6cb21e91cccfecb3d0321262d02 Jul 19 14:52:00.805758 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:00.805725 2580 generic.go:356] "Generic (PLEG): container finished" podID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerID="f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46" exitCode=0 Jul 19 14:52:00.806031 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:00.805817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerDied","Data":"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46"} Jul 19 14:52:00.806031 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:00.805933 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerStarted","Data":"78fa337262e855c61b1eb167788abbd1062cd6cb21e91cccfecb3d0321262d02"} Jul 19 14:52:00.808950 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:00.808926 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerStarted","Data":"c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f"} Jul 19 14:52:00.809078 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:00.808981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerStarted","Data":"58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025"} Jul 19 14:52:00.809078 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:00.809041 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerStarted","Data":"d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be"} Jul 19 14:52:01.814577 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:01.814545 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerStarted","Data":"edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c"} Jul 19 14:52:01.814959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:01.814606 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerStarted","Data":"1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af"} Jul 19 14:52:02.819892 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:02.819858 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8566f859cc-8q4gj" event={"ID":"b058e014-3a77-4954-907b-8f2fec390494","Type":"ContainerStarted","Data":"4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec"} Jul 19 14:52:02.837329 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:02.837286 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8566f859cc-8q4gj" podStartSLOduration=2.362553354 podStartE2EDuration="5.837271112s" totalImagesPullingTime="3.474717758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:52:02.836274494 +0000 UTC m=+327.550386765" watchObservedRunningTime="2026-07-19 14:52:02.837271112 +0000 UTC m=+327.551383390" Jul 19 14:52:03.827914 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:03.827829 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerStarted","Data":"cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce"} Jul 19 14:52:03.854259 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:03.853804 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.137843887 podStartE2EDuration="9.853783542s" totalImagesPullingTime="5.698995705s" totalInitContainerRuntime="16.94395ms" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:52:03.852248481 +0000 UTC m=+328.566360783" watchObservedRunningTime="2026-07-19 14:52:03.853783542 +0000 UTC m=+328.567895821" Jul 19 14:52:05.837786 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:05.837755 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerStarted","Data":"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715"} Jul 19 14:52:05.838138 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:05.837815 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerStarted","Data":"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9"} Jul 19 14:52:08.213995 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:08.213965 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:52:08.214382 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:08.214059 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:52:08.220944 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:08.220920 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:52:08.234544 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:08.234515 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:52:08.853170 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:08.853132 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerStarted","Data":"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85"} Jul 19 14:52:08.853355 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:08.853197 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerStarted","Data":"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a"} Jul 19 14:52:08.853355 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:08.853234 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerStarted","Data":"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368"} Jul 19 14:52:08.853355 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:08.853259 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerStarted","Data":"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9"} Jul 19 14:52:08.879183 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:08.879140 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.085572446 podStartE2EDuration="9.879123972s" totalImagesPullingTime="6.776564499s" totalInitContainerRuntime="16.987027ms" isStatefulPod=false podCreationTimestamp="2026-07-19 14:51:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:52:08.877036196 +0000 UTC m=+333.591148475" watchObservedRunningTime="2026-07-19 14:52:08.879123972 +0000 UTC m=+333.593236250" Jul 19 14:52:09.675964 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:09.675933 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:52:11.865748 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:11.865714 2580 generic.go:356] "Generic (PLEG): container finished" podID="aff56ccc-99a3-41c9-8cfb-0533ffcb0274" containerID="f3df3cf479850725e632f064c1224d5d5e82e309d078bc0c1db9bf7a611faaf4" exitCode=0 Jul 19 14:52:11.866128 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:11.865780 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" event={"ID":"aff56ccc-99a3-41c9-8cfb-0533ffcb0274","Type":"ContainerDied","Data":"f3df3cf479850725e632f064c1224d5d5e82e309d078bc0c1db9bf7a611faaf4"} Jul 19 14:52:11.866128 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:11.866073 2580 scope.go:117] "RemoveContainer" containerID="f3df3cf479850725e632f064c1224d5d5e82e309d078bc0c1db9bf7a611faaf4" Jul 19 14:52:12.871487 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:12.871456 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-npbsb" event={"ID":"aff56ccc-99a3-41c9-8cfb-0533ffcb0274","Type":"ContainerStarted","Data":"c0cc2d93b28798e85c0f5241fee976424e1612f5d31bc2d30937d2286374d251"} Jul 19 14:52:18.810721 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:18.810679 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" podUID="7ab6e450-5a6b-4791-b1f0-a1f3605eca41" containerName="registry" containerID="cri-o://b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e" gracePeriod=30 Jul 19 14:52:19.083641 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.083593 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:52:19.249151 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.249125 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-bound-sa-token\") pod \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " Jul 19 14:52:19.249281 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.249159 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-certificates\") pod \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " Jul 19 14:52:19.249281 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.249228 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") pod \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " Jul 19 14:52:19.249281 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.249258 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-ca-trust-extracted\") pod \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " Jul 19 14:52:19.249434 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.249286 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vkx8\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-kube-api-access-9vkx8\") pod \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " Jul 19 14:52:19.249434 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.249326 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-trusted-ca\") pod \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " Jul 19 14:52:19.249434 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.249361 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-installation-pull-secrets\") pod \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " Jul 19 14:52:19.249434 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.249413 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-image-registry-private-configuration\") pod \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\" (UID: \"7ab6e450-5a6b-4791-b1f0-a1f3605eca41\") " Jul 19 14:52:19.249709 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.249680 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7ab6e450-5a6b-4791-b1f0-a1f3605eca41" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:52:19.250118 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.250075 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7ab6e450-5a6b-4791-b1f0-a1f3605eca41" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:52:19.251761 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.251733 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7ab6e450-5a6b-4791-b1f0-a1f3605eca41" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 14:52:19.251881 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.251855 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-kube-api-access-9vkx8" (OuterVolumeSpecName: "kube-api-access-9vkx8") pod "7ab6e450-5a6b-4791-b1f0-a1f3605eca41" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41"). InnerVolumeSpecName "kube-api-access-9vkx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 14:52:19.251963 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.251944 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7ab6e450-5a6b-4791-b1f0-a1f3605eca41" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 14:52:19.252157 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.252126 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7ab6e450-5a6b-4791-b1f0-a1f3605eca41" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:52:19.252260 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.252177 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7ab6e450-5a6b-4791-b1f0-a1f3605eca41" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:52:19.257842 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.257818 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7ab6e450-5a6b-4791-b1f0-a1f3605eca41" (UID: "7ab6e450-5a6b-4791-b1f0-a1f3605eca41"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 14:52:19.350332 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.350283 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-tls\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:52:19.350332 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.350305 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-ca-trust-extracted\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:52:19.350332 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.350315 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vkx8\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-kube-api-access-9vkx8\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:52:19.350332 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.350323 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-trusted-ca\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:52:19.350332 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.350332 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-installation-pull-secrets\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:52:19.350531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.350342 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-image-registry-private-configuration\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:52:19.350531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.350352 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-bound-sa-token\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:52:19.350531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.350360 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ab6e450-5a6b-4791-b1f0-a1f3605eca41-registry-certificates\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:52:19.903105 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.903068 2580 generic.go:356] "Generic (PLEG): container finished" podID="7ab6e450-5a6b-4791-b1f0-a1f3605eca41" containerID="b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e" exitCode=0 Jul 19 14:52:19.903442 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.903132 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" Jul 19 14:52:19.903442 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.903136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" event={"ID":"7ab6e450-5a6b-4791-b1f0-a1f3605eca41","Type":"ContainerDied","Data":"b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e"} Jul 19 14:52:19.903442 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.903181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64d74c75f7-ctv5x" event={"ID":"7ab6e450-5a6b-4791-b1f0-a1f3605eca41","Type":"ContainerDied","Data":"c2be5239b476c7d70e749e4190a78f619e361dca7c6211f07608378fdc74c346"} Jul 19 14:52:19.903442 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.903208 2580 scope.go:117] "RemoveContainer" containerID="b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e" Jul 19 14:52:19.911582 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.911551 2580 scope.go:117] "RemoveContainer" containerID="b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e" Jul 19 14:52:19.911841 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:52:19.911821 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e\": container with ID starting with b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e not found: ID does not exist" containerID="b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e" Jul 19 14:52:19.911885 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.911848 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e"} err="failed to get container status \"b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e\": rpc error: code = NotFound desc = could not find container \"b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e\": container with ID starting with b3b7398e756ded6476184662f8a14b62b65e3d190b5993ad22a1fa1c334e3c4e not found: ID does not exist" Jul 19 14:52:19.919385 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.919364 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64d74c75f7-ctv5x"] Jul 19 14:52:19.922188 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:19.922158 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64d74c75f7-ctv5x"] Jul 19 14:52:21.786417 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:21.786389 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ab6e450-5a6b-4791-b1f0-a1f3605eca41" path="/var/lib/kubelet/pods/7ab6e450-5a6b-4791-b1f0-a1f3605eca41/volumes" Jul 19 14:52:31.952216 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:31.952183 2580 generic.go:356] "Generic (PLEG): container finished" podID="e8e5f751-5f2d-4255-9d36-725c766e8c25" containerID="0109a2411405069a097c202967cf58984562cca1ee7f1394b58fbac2a6ef0b3b" exitCode=0 Jul 19 14:52:31.952216 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:31.952217 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7vbh4" event={"ID":"e8e5f751-5f2d-4255-9d36-725c766e8c25","Type":"ContainerDied","Data":"0109a2411405069a097c202967cf58984562cca1ee7f1394b58fbac2a6ef0b3b"} Jul 19 14:52:31.952693 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:31.952451 2580 scope.go:117] "RemoveContainer" containerID="0109a2411405069a097c202967cf58984562cca1ee7f1394b58fbac2a6ef0b3b" Jul 19 14:52:32.957670 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:32.957633 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7vbh4" event={"ID":"e8e5f751-5f2d-4255-9d36-725c766e8c25","Type":"ContainerStarted","Data":"28fccffa584d0e3a6fe2c9484127c50917237ff64d59dd6ba26bd5306b665e9e"} Jul 19 14:52:49.578568 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:49.578525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:52:49.580888 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:49.580853 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3467f795-87e7-46aa-821b-f854cdc83634-metrics-certs\") pod \"network-metrics-daemon-r28nx\" (UID: \"3467f795-87e7-46aa-821b-f854cdc83634\") " pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:52:49.784946 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:49.784921 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p5rq\"" Jul 19 14:52:49.792859 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:49.792835 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r28nx" Jul 19 14:52:49.917870 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:49.917849 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r28nx"] Jul 19 14:52:49.919909 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:52:49.919886 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3467f795_87e7_46aa_821b_f854cdc83634.slice/crio-b25789ded720e5c5536dbc46fde8e4c752cd233a0ab38e874ad19c1bc0ecad6b WatchSource:0}: Error finding container b25789ded720e5c5536dbc46fde8e4c752cd233a0ab38e874ad19c1bc0ecad6b: Status 404 returned error can't find the container with id b25789ded720e5c5536dbc46fde8e4c752cd233a0ab38e874ad19c1bc0ecad6b Jul 19 14:52:50.029283 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:50.029255 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r28nx" event={"ID":"3467f795-87e7-46aa-821b-f854cdc83634","Type":"ContainerStarted","Data":"b25789ded720e5c5536dbc46fde8e4c752cd233a0ab38e874ad19c1bc0ecad6b"} Jul 19 14:52:52.038860 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:52.038821 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r28nx" event={"ID":"3467f795-87e7-46aa-821b-f854cdc83634","Type":"ContainerStarted","Data":"37aa887e9d3102192c4d21a66fc04b235a2a61d9c1957a1e7d8cb8a82df79647"} Jul 19 14:52:52.039261 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:52.038880 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r28nx" event={"ID":"3467f795-87e7-46aa-821b-f854cdc83634","Type":"ContainerStarted","Data":"1bce0c6731206eb21d0451234f15f913a56eb2df2d8de4e2d38e31d74775310f"} Jul 19 14:52:52.054195 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:52.054143 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r28nx" podStartSLOduration=375.97553751 podStartE2EDuration="6m17.054128065s" totalImagesPullingTime="1.078590555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:52:52.052686524 +0000 UTC m=+376.766798811" watchObservedRunningTime="2026-07-19 14:52:52.054128065 +0000 UTC m=+376.768240344" Jul 19 14:52:59.676247 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:59.676217 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:52:59.695699 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:52:59.695671 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:00.086294 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:00.086222 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:13.353281 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:13.353244 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 14:53:13.353727 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:13.353601 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="alertmanager" containerID="cri-o://d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be" gracePeriod=120 Jul 19 14:53:13.353727 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:13.353642 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy-metric" containerID="cri-o://edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c" gracePeriod=120 Jul 19 14:53:13.353727 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:13.353670 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="prom-label-proxy" containerID="cri-o://cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce" gracePeriod=120 Jul 19 14:53:13.353908 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:13.353707 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="config-reloader" containerID="cri-o://58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025" gracePeriod=120 Jul 19 14:53:13.353908 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:13.353768 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy" containerID="cri-o://1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af" gracePeriod=120 Jul 19 14:53:13.354044 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:13.353685 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy-web" containerID="cri-o://c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f" gracePeriod=120 Jul 19 14:53:14.128486 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.128451 2580 generic.go:356] "Generic (PLEG): container finished" podID="aba13878-b119-4552-8b07-c4cbe113e21e" containerID="cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce" exitCode=0 Jul 19 14:53:14.128486 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.128478 2580 generic.go:356] "Generic (PLEG): container finished" podID="aba13878-b119-4552-8b07-c4cbe113e21e" containerID="1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af" exitCode=0 Jul 19 14:53:14.128486 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.128486 2580 generic.go:356] "Generic (PLEG): container finished" podID="aba13878-b119-4552-8b07-c4cbe113e21e" containerID="58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025" exitCode=0 Jul 19 14:53:14.128486 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.128493 2580 generic.go:356] "Generic (PLEG): container finished" podID="aba13878-b119-4552-8b07-c4cbe113e21e" containerID="d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be" exitCode=0 Jul 19 14:53:14.128755 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.128519 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerDied","Data":"cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce"} Jul 19 14:53:14.128755 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.128575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerDied","Data":"1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af"} Jul 19 14:53:14.128755 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.128600 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerDied","Data":"58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025"} Jul 19 14:53:14.128755 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.128625 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerDied","Data":"d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be"} Jul 19 14:53:14.591868 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.591845 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:14.655646 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655618 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.655787 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655654 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-tls-assets\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.655787 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655678 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-cluster-tls-config\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.655787 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655713 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-config-out\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.655787 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655752 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkxx6\" (UniqueName: \"kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-kube-api-access-jkxx6\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.655787 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655783 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-main-tls\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.656075 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655815 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-web-config\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.656075 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655838 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-web\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.656075 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655875 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.656075 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655901 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-trusted-ca-bundle\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.656075 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655929 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-config-volume\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.656075 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655963 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-metrics-client-ca\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.656075 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.655994 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-main-db\") pod \"aba13878-b119-4552-8b07-c4cbe113e21e\" (UID: \"aba13878-b119-4552-8b07-c4cbe113e21e\") " Jul 19 14:53:14.656617 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.656592 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 14:53:14.657172 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.657124 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:14.657660 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.657636 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:14.659115 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.659074 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:14.659704 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.659655 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 14:53:14.659704 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.659670 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-config-out" (OuterVolumeSpecName: "config-out") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 14:53:14.659704 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.659682 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:14.659704 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.659695 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:14.660536 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.660503 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-kube-api-access-jkxx6" (OuterVolumeSpecName: "kube-api-access-jkxx6") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "kube-api-access-jkxx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 14:53:14.661170 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.661146 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-config-volume" (OuterVolumeSpecName: "config-volume") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:14.661457 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.661436 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:14.663687 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.663632 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:14.670042 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.670003 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-web-config" (OuterVolumeSpecName: "web-config") pod "aba13878-b119-4552-8b07-c4cbe113e21e" (UID: "aba13878-b119-4552-8b07-c4cbe113e21e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:14.757371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757338 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757370 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757381 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-config-volume\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757391 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aba13878-b119-4552-8b07-c4cbe113e21e-metrics-client-ca\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757400 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-alertmanager-main-db\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757409 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757418 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-tls-assets\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757426 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-cluster-tls-config\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757434 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aba13878-b119-4552-8b07-c4cbe113e21e-config-out\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757441 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkxx6\" (UniqueName: \"kubernetes.io/projected/aba13878-b119-4552-8b07-c4cbe113e21e-kube-api-access-jkxx6\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757450 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-main-tls\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757458 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-web-config\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:14.757532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:14.757466 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aba13878-b119-4552-8b07-c4cbe113e21e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:15.136078 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.136043 2580 generic.go:356] "Generic (PLEG): container finished" podID="aba13878-b119-4552-8b07-c4cbe113e21e" containerID="edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c" exitCode=0 Jul 19 14:53:15.136078 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.136071 2580 generic.go:356] "Generic (PLEG): container finished" podID="aba13878-b119-4552-8b07-c4cbe113e21e" containerID="c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f" exitCode=0 Jul 19 14:53:15.136257 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.136155 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerDied","Data":"edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c"} Jul 19 14:53:15.136257 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.136170 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.136257 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.136227 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerDied","Data":"c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f"} Jul 19 14:53:15.136257 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.136257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aba13878-b119-4552-8b07-c4cbe113e21e","Type":"ContainerDied","Data":"08c4782652023a64ddcb693f89c856f065a527d25950a90d52128b17456f55a5"} Jul 19 14:53:15.136396 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.136287 2580 scope.go:117] "RemoveContainer" containerID="cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce" Jul 19 14:53:15.145453 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.145435 2580 scope.go:117] "RemoveContainer" containerID="edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c" Jul 19 14:53:15.152766 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.152750 2580 scope.go:117] "RemoveContainer" containerID="1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af" Jul 19 14:53:15.159343 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.159299 2580 scope.go:117] "RemoveContainer" containerID="c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f" Jul 19 14:53:15.161853 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.161833 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 14:53:15.165397 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.165377 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 14:53:15.167121 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.167107 2580 scope.go:117] "RemoveContainer" containerID="58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025" Jul 19 14:53:15.175562 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.175542 2580 scope.go:117] "RemoveContainer" containerID="d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be" Jul 19 14:53:15.182718 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.182702 2580 scope.go:117] "RemoveContainer" containerID="04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53" Jul 19 14:53:15.189853 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.189837 2580 scope.go:117] "RemoveContainer" containerID="cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce" Jul 19 14:53:15.190127 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:15.190105 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce\": container with ID starting with cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce not found: ID does not exist" containerID="cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce" Jul 19 14:53:15.190219 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190133 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce"} err="failed to get container status \"cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce\": rpc error: code = NotFound desc = could not find container \"cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce\": container with ID starting with cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce not found: ID does not exist" Jul 19 14:53:15.190219 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190150 2580 scope.go:117] "RemoveContainer" containerID="edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c" Jul 19 14:53:15.190437 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:15.190422 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c\": container with ID starting with edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c not found: ID does not exist" containerID="edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c" Jul 19 14:53:15.190495 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190442 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c"} err="failed to get container status \"edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c\": rpc error: code = NotFound desc = could not find container \"edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c\": container with ID starting with edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c not found: ID does not exist" Jul 19 14:53:15.190495 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190455 2580 scope.go:117] "RemoveContainer" containerID="1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af" Jul 19 14:53:15.190612 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190596 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 14:53:15.190655 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:15.190644 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af\": container with ID starting with 1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af not found: ID does not exist" containerID="1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af" Jul 19 14:53:15.190691 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190663 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af"} err="failed to get container status \"1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af\": rpc error: code = NotFound desc = could not find container \"1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af\": container with ID starting with 1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af not found: ID does not exist" Jul 19 14:53:15.190691 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190679 2580 scope.go:117] "RemoveContainer" containerID="c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f" Jul 19 14:53:15.190877 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:15.190861 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f\": container with ID starting with c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f not found: ID does not exist" containerID="c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f" Jul 19 14:53:15.190915 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190881 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f"} err="failed to get container status \"c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f\": rpc error: code = NotFound desc = could not find container \"c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f\": container with ID starting with c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f not found: ID does not exist" Jul 19 14:53:15.190915 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190894 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy-web" Jul 19 14:53:15.190915 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190912 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy-web" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190926 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="init-config-reloader" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190932 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="init-config-reloader" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190939 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="config-reloader" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190945 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="config-reloader" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190957 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy-metric" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190963 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy-metric" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190969 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190975 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190984 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ab6e450-5a6b-4791-b1f0-a1f3605eca41" containerName="registry" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190989 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ab6e450-5a6b-4791-b1f0-a1f3605eca41" containerName="registry" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190995 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="alertmanager" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191000 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="alertmanager" Jul 19 14:53:15.191002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.190897 2580 scope.go:117] "RemoveContainer" containerID="58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191030 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="prom-label-proxy" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191037 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="prom-label-proxy" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191086 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy-metric" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191093 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ab6e450-5a6b-4791-b1f0-a1f3605eca41" containerName="registry" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191099 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="alertmanager" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191105 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="prom-label-proxy" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191114 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy-web" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191123 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="config-reloader" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191128 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" containerName="kube-rbac-proxy" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:15.191202 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025\": container with ID starting with 58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025 not found: ID does not exist" containerID="58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191221 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025"} err="failed to get container status \"58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025\": rpc error: code = NotFound desc = could not find container \"58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025\": container with ID starting with 58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025 not found: ID does not exist" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191232 2580 scope.go:117] "RemoveContainer" containerID="d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:15.191433 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be\": container with ID starting with d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be not found: ID does not exist" containerID="d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191449 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be"} err="failed to get container status \"d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be\": rpc error: code = NotFound desc = could not find container \"d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be\": container with ID starting with d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be not found: ID does not exist" Jul 19 14:53:15.191466 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191462 2580 scope.go:117] "RemoveContainer" containerID="04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53" Jul 19 14:53:15.191961 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:15.191689 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53\": container with ID starting with 04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53 not found: ID does not exist" containerID="04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53" Jul 19 14:53:15.191961 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191706 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53"} err="failed to get container status \"04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53\": rpc error: code = NotFound desc = could not find container \"04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53\": container with ID starting with 04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53 not found: ID does not exist" Jul 19 14:53:15.191961 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191720 2580 scope.go:117] "RemoveContainer" containerID="cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce" Jul 19 14:53:15.191961 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191920 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce"} err="failed to get container status \"cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce\": rpc error: code = NotFound desc = could not find container \"cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce\": container with ID starting with cebd63122557c1ecd2d983b0cf59d6f080b293b945ee46bdeb26ad76643f47ce not found: ID does not exist" Jul 19 14:53:15.191961 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.191934 2580 scope.go:117] "RemoveContainer" containerID="edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c" Jul 19 14:53:15.192155 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.192125 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c"} err="failed to get container status \"edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c\": rpc error: code = NotFound desc = could not find container \"edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c\": container with ID starting with edcb358fa9178b7dc776f3887b15797a4a40786d1dc2615834f6008152ac8b1c not found: ID does not exist" Jul 19 14:53:15.192155 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.192139 2580 scope.go:117] "RemoveContainer" containerID="1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af" Jul 19 14:53:15.192335 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.192316 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af"} err="failed to get container status \"1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af\": rpc error: code = NotFound desc = could not find container \"1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af\": container with ID starting with 1340b5d5651b507fde5d2ef600c944274160c4fa9e41c328e2e3ffcd3bca12af not found: ID does not exist" Jul 19 14:53:15.192382 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.192335 2580 scope.go:117] "RemoveContainer" containerID="c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f" Jul 19 14:53:15.192545 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.192527 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f"} err="failed to get container status \"c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f\": rpc error: code = NotFound desc = could not find container \"c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f\": container with ID starting with c00d0ffab26198df2dd4f6ea931dae47b47b582bc24439fa9afcb903f1a5921f not found: ID does not exist" Jul 19 14:53:15.192589 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.192546 2580 scope.go:117] "RemoveContainer" containerID="58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025" Jul 19 14:53:15.192742 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.192727 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025"} err="failed to get container status \"58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025\": rpc error: code = NotFound desc = could not find container \"58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025\": container with ID starting with 58517b46c744152bbe92cd3bbb45a105366a2ae1880bb1127f1897e187c54025 not found: ID does not exist" Jul 19 14:53:15.192785 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.192742 2580 scope.go:117] "RemoveContainer" containerID="d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be" Jul 19 14:53:15.192954 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.192934 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be"} err="failed to get container status \"d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be\": rpc error: code = NotFound desc = could not find container \"d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be\": container with ID starting with d72c67ce256ed022e2956a067f4799c9514de0a14ee8cfd6a1e7ec4a35c8b8be not found: ID does not exist" Jul 19 14:53:15.193050 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.192955 2580 scope.go:117] "RemoveContainer" containerID="04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53" Jul 19 14:53:15.193209 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.193192 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53"} err="failed to get container status \"04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53\": rpc error: code = NotFound desc = could not find container \"04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53\": container with ID starting with 04189b251bf89f4a2e912b17ddd5d8a670d0a110a8b407b8854f5a2346756b53 not found: ID does not exist" Jul 19 14:53:15.194770 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.194754 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.196956 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.196939 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 19 14:53:15.197076 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.196942 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 19 14:53:15.197206 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.197192 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 19 14:53:15.197345 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.197327 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 19 14:53:15.197431 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.197407 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 19 14:53:15.197544 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.197513 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 19 14:53:15.197713 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.197694 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 19 14:53:15.197794 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.197744 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tj664\"" Jul 19 14:53:15.197885 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.197861 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 19 14:53:15.202727 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.202709 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 19 14:53:15.207371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.207352 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 14:53:15.260435 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260403 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-web-config\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260435 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260436 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-config-volume\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260607 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260460 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4p66\" (UniqueName: \"kubernetes.io/projected/360af916-00aa-421b-8066-1dbf5ba2039d-kube-api-access-f4p66\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260607 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260607 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260522 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260697 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260602 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260697 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260633 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/360af916-00aa-421b-8066-1dbf5ba2039d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260697 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/360af916-00aa-421b-8066-1dbf5ba2039d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260785 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/360af916-00aa-421b-8066-1dbf5ba2039d-config-out\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260785 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260738 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260785 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260785 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/360af916-00aa-421b-8066-1dbf5ba2039d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.260897 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.260828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/360af916-00aa-421b-8066-1dbf5ba2039d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.361521 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361494 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-web-config\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.361521 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-config-volume\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.361681 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4p66\" (UniqueName: \"kubernetes.io/projected/360af916-00aa-421b-8066-1dbf5ba2039d-kube-api-access-f4p66\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.361681 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.361846 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.361846 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361741 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.361846 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/360af916-00aa-421b-8066-1dbf5ba2039d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.361846 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/360af916-00aa-421b-8066-1dbf5ba2039d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.362037 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/360af916-00aa-421b-8066-1dbf5ba2039d-config-out\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.362037 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.362037 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361914 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.362037 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/360af916-00aa-421b-8066-1dbf5ba2039d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.362037 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.361983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/360af916-00aa-421b-8066-1dbf5ba2039d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.362631 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.362602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/360af916-00aa-421b-8066-1dbf5ba2039d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.363079 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.363053 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/360af916-00aa-421b-8066-1dbf5ba2039d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.363173 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.363136 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/360af916-00aa-421b-8066-1dbf5ba2039d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.364729 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.364703 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-web-config\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.364819 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.364742 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-config-volume\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.365164 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.365143 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/360af916-00aa-421b-8066-1dbf5ba2039d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.365314 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.365292 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.365384 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.365321 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.365384 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.365324 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/360af916-00aa-421b-8066-1dbf5ba2039d-config-out\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.365476 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.365420 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.365671 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.365652 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.366201 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.366185 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/360af916-00aa-421b-8066-1dbf5ba2039d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.369165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.369146 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4p66\" (UniqueName: \"kubernetes.io/projected/360af916-00aa-421b-8066-1dbf5ba2039d-kube-api-access-f4p66\") pod \"alertmanager-main-0\" (UID: \"360af916-00aa-421b-8066-1dbf5ba2039d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.505164 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.505143 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 19 14:53:15.637185 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.637128 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 19 14:53:15.639418 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:53:15.639379 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360af916_00aa_421b_8066_1dbf5ba2039d.slice/crio-00dc6a8dd3652a38a6f58383eacd838399af84366d09234830a9c2eaf8bc12e3 WatchSource:0}: Error finding container 00dc6a8dd3652a38a6f58383eacd838399af84366d09234830a9c2eaf8bc12e3: Status 404 returned error can't find the container with id 00dc6a8dd3652a38a6f58383eacd838399af84366d09234830a9c2eaf8bc12e3 Jul 19 14:53:15.786397 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:15.786361 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba13878-b119-4552-8b07-c4cbe113e21e" path="/var/lib/kubelet/pods/aba13878-b119-4552-8b07-c4cbe113e21e/volumes" Jul 19 14:53:16.141537 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:16.141506 2580 generic.go:356] "Generic (PLEG): container finished" podID="360af916-00aa-421b-8066-1dbf5ba2039d" containerID="841827be3c49ca8fab7a95a5081ab763f51594abf682a08e5bc3c0d8afd1c909" exitCode=0 Jul 19 14:53:16.141642 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:16.141593 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"360af916-00aa-421b-8066-1dbf5ba2039d","Type":"ContainerDied","Data":"841827be3c49ca8fab7a95a5081ab763f51594abf682a08e5bc3c0d8afd1c909"} Jul 19 14:53:16.141698 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:16.141679 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"360af916-00aa-421b-8066-1dbf5ba2039d","Type":"ContainerStarted","Data":"00dc6a8dd3652a38a6f58383eacd838399af84366d09234830a9c2eaf8bc12e3"} Jul 19 14:53:17.150557 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.150516 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"360af916-00aa-421b-8066-1dbf5ba2039d","Type":"ContainerStarted","Data":"5df2a1ad79ca28835d087e11ccc454489ecf2d5d180ab4679577cbea746820b8"} Jul 19 14:53:17.150917 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.150583 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"360af916-00aa-421b-8066-1dbf5ba2039d","Type":"ContainerStarted","Data":"24d62d8270192c94737467e1d2cf77cffa0eae53e14c90e39a807a88ff8016bf"} Jul 19 14:53:17.150917 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.150611 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"360af916-00aa-421b-8066-1dbf5ba2039d","Type":"ContainerStarted","Data":"a4a5c55e6ec3417aa59624903a7e58bc6d1a723e1839cb37f812ebb44607da82"} Jul 19 14:53:17.150917 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.150635 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"360af916-00aa-421b-8066-1dbf5ba2039d","Type":"ContainerStarted","Data":"00d51d071c51cb3221466c11fe5a7167b53fea051869dc4278a0cdc614e4173a"} Jul 19 14:53:17.150917 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.150662 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"360af916-00aa-421b-8066-1dbf5ba2039d","Type":"ContainerStarted","Data":"32abcfc1796599aa6ae575701f1b49ba936e7fa231d0515f55f4d04f1f21f1f5"} Jul 19 14:53:17.150917 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.150685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"360af916-00aa-421b-8066-1dbf5ba2039d","Type":"ContainerStarted","Data":"bfd612570f0547d37ec331311ae7c25c00c764dd14e617eb98fa2c7b73d8826c"} Jul 19 14:53:17.181929 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.181875 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.16642027 podStartE2EDuration="2.181859173s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.438903ms" isStatefulPod=false podCreationTimestamp="2026-07-19 14:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:53:17.180494586 +0000 UTC m=+401.894606899" watchObservedRunningTime="2026-07-19 14:53:17.181859173 +0000 UTC m=+401.895971465" Jul 19 14:53:17.664981 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.664935 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 19 14:53:17.665286 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.665249 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="prometheus" containerID="cri-o://b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9" gracePeriod=600 Jul 19 14:53:17.665404 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.665297 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="config-reloader" containerID="cri-o://31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715" gracePeriod=600 Jul 19 14:53:17.665404 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.665322 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy-thanos" containerID="cri-o://134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85" gracePeriod=600 Jul 19 14:53:17.665404 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.665296 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="thanos-sidecar" containerID="cri-o://53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9" gracePeriod=600 Jul 19 14:53:17.665576 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.665294 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy-web" containerID="cri-o://250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368" gracePeriod=600 Jul 19 14:53:17.665576 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.665325 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy" containerID="cri-o://6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a" gracePeriod=600 Jul 19 14:53:17.920671 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.920610 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:17.983003 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.982975 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrd2g\" (UniqueName: \"kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-kube-api-access-hrd2g\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983178 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983035 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-trusted-ca-bundle\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983178 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983058 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-web-config\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983178 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983084 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983178 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983105 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-0\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983178 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983131 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-thanos-prometheus-http-client-file\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983178 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983159 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-tls\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983467 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983290 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-kube-rbac-proxy\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983467 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983333 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983467 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983370 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-tls-assets\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983467 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983396 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config-out\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983467 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983406 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:17.983467 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983424 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-grpc-tls\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983786 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983481 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-metrics-client-certs\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983786 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983520 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-db\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983786 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983545 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-metrics-client-ca\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983786 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983578 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-1\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983786 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983621 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983786 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983649 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-kubelet-serving-ca-bundle\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983786 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983709 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-2\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.983786 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.983736 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-serving-certs-ca-bundle\") pod \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\" (UID: \"7258c92f-c61e-4dbf-ab22-fb4b7006c003\") " Jul 19 14:53:17.984192 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.984106 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:17.984823 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.984325 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:17.984823 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.984454 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:17.986134 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.985516 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:17.986134 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.985675 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:17.986134 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.985782 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:17.986354 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.986212 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config" (OuterVolumeSpecName: "config") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:17.986651 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.986505 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 14:53:17.986651 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.986578 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:17.987480 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.987426 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config-out" (OuterVolumeSpecName: "config-out") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 14:53:17.987600 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.987560 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:17.987930 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.987889 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 14:53:17.988035 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.987987 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:17.988293 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.988258 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:17.988445 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.988423 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:17.988506 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.988463 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:17.988761 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.988725 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:17.989694 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.989673 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-kube-api-access-hrd2g" (OuterVolumeSpecName: "kube-api-access-hrd2g") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "kube-api-access-hrd2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 14:53:17.989921 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.989902 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:17.998486 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:17.998461 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-web-config" (OuterVolumeSpecName: "web-config") pod "7258c92f-c61e-4dbf-ab22-fb4b7006c003" (UID: "7258c92f-c61e-4dbf-ab22-fb4b7006c003"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:18.084737 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084713 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-metrics-client-certs\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084737 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084732 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-db\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084742 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-metrics-client-ca\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084752 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084761 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084771 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084780 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084789 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084798 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrd2g\" (UniqueName: \"kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-kube-api-access-hrd2g\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084806 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-web-config\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084814 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084821 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7258c92f-c61e-4dbf-ab22-fb4b7006c003-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084829 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084837 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084846 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-kube-rbac-proxy\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.084851 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084854 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.085263 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084862 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7258c92f-c61e-4dbf-ab22-fb4b7006c003-tls-assets\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.085263 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084872 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7258c92f-c61e-4dbf-ab22-fb4b7006c003-config-out\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.085263 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.084879 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7258c92f-c61e-4dbf-ab22-fb4b7006c003-secret-grpc-tls\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:18.157532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157509 2580 generic.go:356] "Generic (PLEG): container finished" podID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerID="134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85" exitCode=0 Jul 19 14:53:18.157532 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157530 2580 generic.go:356] "Generic (PLEG): container finished" podID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerID="6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a" exitCode=0 Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157537 2580 generic.go:356] "Generic (PLEG): container finished" podID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerID="250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368" exitCode=0 Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157543 2580 generic.go:356] "Generic (PLEG): container finished" podID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerID="53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9" exitCode=0 Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157548 2580 generic.go:356] "Generic (PLEG): container finished" podID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerID="31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715" exitCode=0 Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157553 2580 generic.go:356] "Generic (PLEG): container finished" podID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerID="b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9" exitCode=0 Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157590 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157595 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerDied","Data":"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85"} Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157666 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerDied","Data":"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a"} Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157696 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerDied","Data":"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368"} Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157722 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerDied","Data":"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9"} Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157751 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerDied","Data":"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715"} Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157754 2580 scope.go:117] "RemoveContainer" containerID="134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85" Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerDied","Data":"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9"} Jul 19 14:53:18.157848 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.157801 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7258c92f-c61e-4dbf-ab22-fb4b7006c003","Type":"ContainerDied","Data":"78fa337262e855c61b1eb167788abbd1062cd6cb21e91cccfecb3d0321262d02"} Jul 19 14:53:18.166779 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.166609 2580 scope.go:117] "RemoveContainer" containerID="6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a" Jul 19 14:53:18.174909 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.174893 2580 scope.go:117] "RemoveContainer" containerID="250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368" Jul 19 14:53:18.181430 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.181408 2580 scope.go:117] "RemoveContainer" containerID="53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9" Jul 19 14:53:18.183931 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.183909 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 19 14:53:18.188270 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.188250 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 19 14:53:18.188930 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.188915 2580 scope.go:117] "RemoveContainer" containerID="31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715" Jul 19 14:53:18.195349 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.195334 2580 scope.go:117] "RemoveContainer" containerID="b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9" Jul 19 14:53:18.202336 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.202319 2580 scope.go:117] "RemoveContainer" containerID="f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46" Jul 19 14:53:18.208596 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.208577 2580 scope.go:117] "RemoveContainer" containerID="134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85" Jul 19 14:53:18.208847 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:18.208827 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": container with ID starting with 134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85 not found: ID does not exist" containerID="134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85" Jul 19 14:53:18.208903 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.208855 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85"} err="failed to get container status \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": rpc error: code = NotFound desc = could not find container \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": container with ID starting with 134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85 not found: ID does not exist" Jul 19 14:53:18.208903 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.208871 2580 scope.go:117] "RemoveContainer" containerID="6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a" Jul 19 14:53:18.209106 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:18.209089 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": container with ID starting with 6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a not found: ID does not exist" containerID="6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a" Jul 19 14:53:18.209221 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.209111 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a"} err="failed to get container status \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": rpc error: code = NotFound desc = could not find container \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": container with ID starting with 6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a not found: ID does not exist" Jul 19 14:53:18.209221 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.209127 2580 scope.go:117] "RemoveContainer" containerID="250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368" Jul 19 14:53:18.209371 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:18.209354 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": container with ID starting with 250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368 not found: ID does not exist" containerID="250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368" Jul 19 14:53:18.209422 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.209374 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368"} err="failed to get container status \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": rpc error: code = NotFound desc = could not find container \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": container with ID starting with 250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368 not found: ID does not exist" Jul 19 14:53:18.209422 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.209389 2580 scope.go:117] "RemoveContainer" containerID="53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9" Jul 19 14:53:18.209630 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:18.209614 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": container with ID starting with 53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9 not found: ID does not exist" containerID="53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9" Jul 19 14:53:18.209665 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.209638 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9"} err="failed to get container status \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": rpc error: code = NotFound desc = could not find container \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": container with ID starting with 53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9 not found: ID does not exist" Jul 19 14:53:18.209703 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.209664 2580 scope.go:117] "RemoveContainer" containerID="31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715" Jul 19 14:53:18.209910 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:18.209895 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": container with ID starting with 31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715 not found: ID does not exist" containerID="31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715" Jul 19 14:53:18.209951 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.209914 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715"} err="failed to get container status \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": rpc error: code = NotFound desc = could not find container \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": container with ID starting with 31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715 not found: ID does not exist" Jul 19 14:53:18.209951 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.209927 2580 scope.go:117] "RemoveContainer" containerID="b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9" Jul 19 14:53:18.210142 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:18.210121 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": container with ID starting with b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9 not found: ID does not exist" containerID="b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9" Jul 19 14:53:18.210182 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.210147 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9"} err="failed to get container status \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": rpc error: code = NotFound desc = could not find container \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": container with ID starting with b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9 not found: ID does not exist" Jul 19 14:53:18.210182 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.210161 2580 scope.go:117] "RemoveContainer" containerID="f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46" Jul 19 14:53:18.210435 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:18.210407 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": container with ID starting with f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46 not found: ID does not exist" containerID="f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46" Jul 19 14:53:18.210435 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.210443 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46"} err="failed to get container status \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": rpc error: code = NotFound desc = could not find container \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": container with ID starting with f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46 not found: ID does not exist" Jul 19 14:53:18.210603 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.210461 2580 scope.go:117] "RemoveContainer" containerID="134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85" Jul 19 14:53:18.210913 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.210822 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85"} err="failed to get container status \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": rpc error: code = NotFound desc = could not find container \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": container with ID starting with 134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85 not found: ID does not exist" Jul 19 14:53:18.210913 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.210870 2580 scope.go:117] "RemoveContainer" containerID="6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a" Jul 19 14:53:18.211172 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.211152 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a"} err="failed to get container status \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": rpc error: code = NotFound desc = could not find container \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": container with ID starting with 6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a not found: ID does not exist" Jul 19 14:53:18.211251 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.211173 2580 scope.go:117] "RemoveContainer" containerID="250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368" Jul 19 14:53:18.211440 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.211393 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368"} err="failed to get container status \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": rpc error: code = NotFound desc = could not find container \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": container with ID starting with 250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368 not found: ID does not exist" Jul 19 14:53:18.211440 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.211416 2580 scope.go:117] "RemoveContainer" containerID="53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9" Jul 19 14:53:18.211704 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.211686 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9"} err="failed to get container status \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": rpc error: code = NotFound desc = could not find container \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": container with ID starting with 53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9 not found: ID does not exist" Jul 19 14:53:18.211757 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.211704 2580 scope.go:117] "RemoveContainer" containerID="31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715" Jul 19 14:53:18.211951 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.211933 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715"} err="failed to get container status \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": rpc error: code = NotFound desc = could not find container \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": container with ID starting with 31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715 not found: ID does not exist" Jul 19 14:53:18.211951 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.211951 2580 scope.go:117] "RemoveContainer" containerID="b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9" Jul 19 14:53:18.212182 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212158 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9"} err="failed to get container status \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": rpc error: code = NotFound desc = could not find container \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": container with ID starting with b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9 not found: ID does not exist" Jul 19 14:53:18.212248 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212185 2580 scope.go:117] "RemoveContainer" containerID="f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46" Jul 19 14:53:18.212371 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212358 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 19 14:53:18.212420 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212390 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46"} err="failed to get container status \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": rpc error: code = NotFound desc = could not find container \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": container with ID starting with f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46 not found: ID does not exist" Jul 19 14:53:18.212420 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212405 2580 scope.go:117] "RemoveContainer" containerID="134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85" Jul 19 14:53:18.212614 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212586 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85"} err="failed to get container status \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": rpc error: code = NotFound desc = could not find container \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": container with ID starting with 134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85 not found: ID does not exist" Jul 19 14:53:18.212614 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212613 2580 scope.go:117] "RemoveContainer" containerID="6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a" Jul 19 14:53:18.212695 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212646 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy-thanos" Jul 19 14:53:18.212695 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212656 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy-thanos" Jul 19 14:53:18.212695 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212669 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="thanos-sidecar" Jul 19 14:53:18.212695 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212676 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="thanos-sidecar" Jul 19 14:53:18.212695 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212683 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="init-config-reloader" Jul 19 14:53:18.212695 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212691 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="init-config-reloader" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212700 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy-web" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212706 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy-web" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212718 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="prometheus" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212723 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="prometheus" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212740 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212747 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212756 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="config-reloader" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212762 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="config-reloader" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212774 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a"} err="failed to get container status \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": rpc error: code = NotFound desc = could not find container \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": container with ID starting with 6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a not found: ID does not exist" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212787 2580 scope.go:117] "RemoveContainer" containerID="250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212805 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy-thanos" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212813 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="config-reloader" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212818 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="prometheus" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212825 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="thanos-sidecar" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212831 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy-web" Jul 19 14:53:18.212959 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212839 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" containerName="kube-rbac-proxy" Jul 19 14:53:18.213571 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212962 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368"} err="failed to get container status \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": rpc error: code = NotFound desc = could not find container \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": container with ID starting with 250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368 not found: ID does not exist" Jul 19 14:53:18.213571 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.212974 2580 scope.go:117] "RemoveContainer" containerID="53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9" Jul 19 14:53:18.213571 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.213140 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9"} err="failed to get container status \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": rpc error: code = NotFound desc = could not find container \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": container with ID starting with 53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9 not found: ID does not exist" Jul 19 14:53:18.213571 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.213154 2580 scope.go:117] "RemoveContainer" containerID="31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715" Jul 19 14:53:18.213571 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.213380 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715"} err="failed to get container status \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": rpc error: code = NotFound desc = could not find container \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": container with ID starting with 31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715 not found: ID does not exist" Jul 19 14:53:18.213571 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.213395 2580 scope.go:117] "RemoveContainer" containerID="b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9" Jul 19 14:53:18.213860 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.213586 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9"} err="failed to get container status \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": rpc error: code = NotFound desc = could not find container \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": container with ID starting with b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9 not found: ID does not exist" Jul 19 14:53:18.213860 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.213605 2580 scope.go:117] "RemoveContainer" containerID="f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46" Jul 19 14:53:18.213860 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.213798 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46"} err="failed to get container status \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": rpc error: code = NotFound desc = could not find container \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": container with ID starting with f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46 not found: ID does not exist" Jul 19 14:53:18.213860 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.213815 2580 scope.go:117] "RemoveContainer" containerID="134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85" Jul 19 14:53:18.214104 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.214079 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85"} err="failed to get container status \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": rpc error: code = NotFound desc = could not find container \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": container with ID starting with 134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85 not found: ID does not exist" Jul 19 14:53:18.214148 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.214105 2580 scope.go:117] "RemoveContainer" containerID="6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a" Jul 19 14:53:18.214406 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.214383 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a"} err="failed to get container status \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": rpc error: code = NotFound desc = could not find container \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": container with ID starting with 6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a not found: ID does not exist" Jul 19 14:53:18.214490 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.214406 2580 scope.go:117] "RemoveContainer" containerID="250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368" Jul 19 14:53:18.214708 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.214674 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368"} err="failed to get container status \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": rpc error: code = NotFound desc = could not find container \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": container with ID starting with 250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368 not found: ID does not exist" Jul 19 14:53:18.214799 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.214750 2580 scope.go:117] "RemoveContainer" containerID="53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9" Jul 19 14:53:18.215168 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.215077 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9"} err="failed to get container status \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": rpc error: code = NotFound desc = could not find container \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": container with ID starting with 53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9 not found: ID does not exist" Jul 19 14:53:18.215168 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.215100 2580 scope.go:117] "RemoveContainer" containerID="31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715" Jul 19 14:53:18.215463 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.215397 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715"} err="failed to get container status \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": rpc error: code = NotFound desc = could not find container \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": container with ID starting with 31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715 not found: ID does not exist" Jul 19 14:53:18.215463 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.215432 2580 scope.go:117] "RemoveContainer" containerID="b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9" Jul 19 14:53:18.216000 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.215975 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9"} err="failed to get container status \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": rpc error: code = NotFound desc = could not find container \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": container with ID starting with b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9 not found: ID does not exist" Jul 19 14:53:18.216597 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.216041 2580 scope.go:117] "RemoveContainer" containerID="f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46" Jul 19 14:53:18.216597 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.216350 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46"} err="failed to get container status \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": rpc error: code = NotFound desc = could not find container \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": container with ID starting with f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46 not found: ID does not exist" Jul 19 14:53:18.216597 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.216371 2580 scope.go:117] "RemoveContainer" containerID="134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85" Jul 19 14:53:18.216748 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.216677 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85"} err="failed to get container status \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": rpc error: code = NotFound desc = could not find container \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": container with ID starting with 134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85 not found: ID does not exist" Jul 19 14:53:18.216748 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.216698 2580 scope.go:117] "RemoveContainer" containerID="6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a" Jul 19 14:53:18.217054 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.217026 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a"} err="failed to get container status \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": rpc error: code = NotFound desc = could not find container \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": container with ID starting with 6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a not found: ID does not exist" Jul 19 14:53:18.217054 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.217054 2580 scope.go:117] "RemoveContainer" containerID="250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368" Jul 19 14:53:18.217235 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.217094 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.217314 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.217290 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368"} err="failed to get container status \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": rpc error: code = NotFound desc = could not find container \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": container with ID starting with 250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368 not found: ID does not exist" Jul 19 14:53:18.217353 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.217316 2580 scope.go:117] "RemoveContainer" containerID="53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9" Jul 19 14:53:18.218415 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.218390 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9"} err="failed to get container status \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": rpc error: code = NotFound desc = could not find container \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": container with ID starting with 53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9 not found: ID does not exist" Jul 19 14:53:18.218415 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.218414 2580 scope.go:117] "RemoveContainer" containerID="31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715" Jul 19 14:53:18.218733 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.218707 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715"} err="failed to get container status \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": rpc error: code = NotFound desc = could not find container \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": container with ID starting with 31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715 not found: ID does not exist" Jul 19 14:53:18.218807 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.218735 2580 scope.go:117] "RemoveContainer" containerID="b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9" Jul 19 14:53:18.218992 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.218974 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9"} err="failed to get container status \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": rpc error: code = NotFound desc = could not find container \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": container with ID starting with b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9 not found: ID does not exist" Jul 19 14:53:18.219098 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.218995 2580 scope.go:117] "RemoveContainer" containerID="f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46" Jul 19 14:53:18.219297 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.219263 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46"} err="failed to get container status \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": rpc error: code = NotFound desc = could not find container \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": container with ID starting with f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46 not found: ID does not exist" Jul 19 14:53:18.219297 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.219296 2580 scope.go:117] "RemoveContainer" containerID="134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85" Jul 19 14:53:18.219576 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.219553 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85"} err="failed to get container status \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": rpc error: code = NotFound desc = could not find container \"134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85\": container with ID starting with 134f01c6ede050fe24e588f8e93c8b0f0dacbdfd08b05b84a489b8373657ba85 not found: ID does not exist" Jul 19 14:53:18.219654 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.219583 2580 scope.go:117] "RemoveContainer" containerID="6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a" Jul 19 14:53:18.219654 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.219626 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 19 14:53:18.219868 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.219851 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7f1noah7d96jt\"" Jul 19 14:53:18.219868 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.219848 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a"} err="failed to get container status \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": rpc error: code = NotFound desc = could not find container \"6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a\": container with ID starting with 6e4314a7639b8a92062f201a9ae06f10a5a82bdd35b32c61c77ba13f993b908a not found: ID does not exist" Jul 19 14:53:18.219995 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.219879 2580 scope.go:117] "RemoveContainer" containerID="250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368" Jul 19 14:53:18.219995 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.219972 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 19 14:53:18.219995 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.219985 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9ftd6\"" Jul 19 14:53:18.220129 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.220034 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 19 14:53:18.220129 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.220062 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 19 14:53:18.221199 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.220544 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 19 14:53:18.221199 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.220564 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 19 14:53:18.221199 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.220577 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368"} err="failed to get container status \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": rpc error: code = NotFound desc = could not find container \"250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368\": container with ID starting with 250a73f15efc9657ec6c9f3854576e04b0fb6fee237a005de65ab58a51b55368 not found: ID does not exist" Jul 19 14:53:18.221199 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.220604 2580 scope.go:117] "RemoveContainer" containerID="53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9" Jul 19 14:53:18.221199 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.220882 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 19 14:53:18.221463 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.221295 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 19 14:53:18.221526 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.221500 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 19 14:53:18.222256 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.222065 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9"} err="failed to get container status \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": rpc error: code = NotFound desc = could not find container \"53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9\": container with ID starting with 53c32e69ee9fecbe8ca678d166871aab3124d524a35c78bb51293c43135e9ae9 not found: ID does not exist" Jul 19 14:53:18.222256 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.222096 2580 scope.go:117] "RemoveContainer" containerID="31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715" Jul 19 14:53:18.223367 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.222411 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 19 14:53:18.223367 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.222647 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715"} err="failed to get container status \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": rpc error: code = NotFound desc = could not find container \"31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715\": container with ID starting with 31e1d4546bf039daae9ad642965196b2eb38d738a6bea890ef9cb59f0012a715 not found: ID does not exist" Jul 19 14:53:18.223367 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.222677 2580 scope.go:117] "RemoveContainer" containerID="b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9" Jul 19 14:53:18.223367 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.222860 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 19 14:53:18.225945 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.223606 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 19 14:53:18.225945 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.223655 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9"} err="failed to get container status \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": rpc error: code = NotFound desc = could not find container \"b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9\": container with ID starting with b3ff2df5dd0e48b08f2125c72984af3ac736107200f0464e78ee93cd975351e9 not found: ID does not exist" Jul 19 14:53:18.225945 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.223679 2580 scope.go:117] "RemoveContainer" containerID="f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46" Jul 19 14:53:18.225945 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.224353 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 19 14:53:18.225945 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.225124 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46"} err="failed to get container status \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": rpc error: code = NotFound desc = could not find container \"f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46\": container with ID starting with f80aa97ff73e5e8e3e44999c15b28c00ce82be7c1a789ade2e4d8824d93efb46 not found: ID does not exist" Jul 19 14:53:18.231388 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.231344 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 19 14:53:18.231827 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.231805 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 19 14:53:18.232902 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.232881 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 19 14:53:18.286100 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-web-config\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286195 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286195 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286195 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286342 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286385 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286371 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286420 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286460 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286428 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-config\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286460 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286446 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286566 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286601 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286636 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286613 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsx4r\" (UniqueName: \"kubernetes.io/projected/41076f05-ce9c-4824-a256-c04c8f6bdfbd-kube-api-access-hsx4r\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286636 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286708 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41076f05-ce9c-4824-a256-c04c8f6bdfbd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286844 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41076f05-ce9c-4824-a256-c04c8f6bdfbd-config-out\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286933 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.286971 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.286956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.287040 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.287006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.287092 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.287055 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.387832 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.387811 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.387919 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.387842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.387919 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.387863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.387919 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.387886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.387919 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.387912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-web-config\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388113 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.387935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388113 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.387958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388113 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.387981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388113 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388113 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388113 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388403 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-config\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388403 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388403 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388403 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388192 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388403 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388403 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsx4r\" (UniqueName: \"kubernetes.io/projected/41076f05-ce9c-4824-a256-c04c8f6bdfbd-kube-api-access-hsx4r\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388403 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388403 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41076f05-ce9c-4824-a256-c04c8f6bdfbd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388403 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41076f05-ce9c-4824-a256-c04c8f6bdfbd-config-out\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388830 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388526 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.388830 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.389040 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.388996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.389547 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.389220 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.389547 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.389410 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.390396 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.390077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.390866 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.390840 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.391567 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.391543 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.391716 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.391691 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-web-config\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.391849 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.391824 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.391978 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.391958 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41076f05-ce9c-4824-a256-c04c8f6bdfbd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.392194 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.392175 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.392488 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.392463 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41076f05-ce9c-4824-a256-c04c8f6bdfbd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.393199 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.393175 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-config\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.393199 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.393189 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.393521 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.393505 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.393663 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.393641 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.393704 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.393664 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41076f05-ce9c-4824-a256-c04c8f6bdfbd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.394216 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.394200 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41076f05-ce9c-4824-a256-c04c8f6bdfbd-config-out\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.396435 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.396415 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsx4r\" (UniqueName: \"kubernetes.io/projected/41076f05-ce9c-4824-a256-c04c8f6bdfbd-kube-api-access-hsx4r\") pod \"prometheus-k8s-0\" (UID: \"41076f05-ce9c-4824-a256-c04c8f6bdfbd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.532721 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.532672 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:18.665977 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:18.665953 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 19 14:53:18.667291 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:53:18.667266 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41076f05_ce9c_4824_a256_c04c8f6bdfbd.slice/crio-c0d5e0adbf34b7267057b59ea62bd4528ccb9c58f5cb24b2cee4cab01766f7fc WatchSource:0}: Error finding container c0d5e0adbf34b7267057b59ea62bd4528ccb9c58f5cb24b2cee4cab01766f7fc: Status 404 returned error can't find the container with id c0d5e0adbf34b7267057b59ea62bd4528ccb9c58f5cb24b2cee4cab01766f7fc Jul 19 14:53:19.166233 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:19.166195 2580 generic.go:356] "Generic (PLEG): container finished" podID="41076f05-ce9c-4824-a256-c04c8f6bdfbd" containerID="13cc3b6dfa7cf63c34886ff1cbc872ca088574e89e94b55289d2e5c73f2522fe" exitCode=0 Jul 19 14:53:19.166621 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:19.166285 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41076f05-ce9c-4824-a256-c04c8f6bdfbd","Type":"ContainerDied","Data":"13cc3b6dfa7cf63c34886ff1cbc872ca088574e89e94b55289d2e5c73f2522fe"} Jul 19 14:53:19.166621 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:19.166377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41076f05-ce9c-4824-a256-c04c8f6bdfbd","Type":"ContainerStarted","Data":"c0d5e0adbf34b7267057b59ea62bd4528ccb9c58f5cb24b2cee4cab01766f7fc"} Jul 19 14:53:19.791345 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:19.788498 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7258c92f-c61e-4dbf-ab22-fb4b7006c003" path="/var/lib/kubelet/pods/7258c92f-c61e-4dbf-ab22-fb4b7006c003/volumes" Jul 19 14:53:20.175703 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:20.175668 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41076f05-ce9c-4824-a256-c04c8f6bdfbd","Type":"ContainerStarted","Data":"4ce7aa1038fd406936ff2f81850266126ab3c7940e95d1694e4b16b4baf73c33"} Jul 19 14:53:20.176154 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:20.175745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41076f05-ce9c-4824-a256-c04c8f6bdfbd","Type":"ContainerStarted","Data":"a10b4072178d2eb1b04e61c79bb05a26037a1332906605e55548e4567a8bc4c2"} Jul 19 14:53:20.176154 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:20.175789 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41076f05-ce9c-4824-a256-c04c8f6bdfbd","Type":"ContainerStarted","Data":"df577c9d0a969065abcab3dccd130aa5f6567dc6eebf982b35ea6390b777ece5"} Jul 19 14:53:20.176154 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:20.175834 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41076f05-ce9c-4824-a256-c04c8f6bdfbd","Type":"ContainerStarted","Data":"7e1bf1af538c63fe052acba625514dd7de33040b995b4c0dff2ed7f68a9475ad"} Jul 19 14:53:20.176154 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:20.175875 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41076f05-ce9c-4824-a256-c04c8f6bdfbd","Type":"ContainerStarted","Data":"6c557e8f4f7bda2d535b7ccb98baf9cf2cddd5f97b2c876d54c82c6c052b1cac"} Jul 19 14:53:20.176154 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:20.175921 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41076f05-ce9c-4824-a256-c04c8f6bdfbd","Type":"ContainerStarted","Data":"112cb6d99809bee722486a963d312093d601f125375b66ba6456d6e2886cad4e"} Jul 19 14:53:20.201507 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:20.201452 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.182842109 podStartE2EDuration="2.201434285s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.592176ms" isStatefulPod=false podCreationTimestamp="2026-07-19 14:53:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:53:20.199826807 +0000 UTC m=+404.913939086" watchObservedRunningTime="2026-07-19 14:53:20.201434285 +0000 UTC m=+404.915546597" Jul 19 14:53:23.533763 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:23.533727 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:53:33.092617 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:33.092575 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8566f859cc-8q4gj"] Jul 19 14:53:58.256896 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.256845 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8566f859cc-8q4gj" podUID="b058e014-3a77-4954-907b-8f2fec390494" containerName="console" containerID="cri-o://4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec" gracePeriod=15 Jul 19 14:53:58.495858 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.495832 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:53:58.588289 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588215 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-console-config\") pod \"b058e014-3a77-4954-907b-8f2fec390494\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " Jul 19 14:53:58.588289 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588268 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-service-ca\") pod \"b058e014-3a77-4954-907b-8f2fec390494\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " Jul 19 14:53:58.588476 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588319 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-oauth-serving-cert\") pod \"b058e014-3a77-4954-907b-8f2fec390494\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " Jul 19 14:53:58.588476 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588344 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-trusted-ca-bundle\") pod \"b058e014-3a77-4954-907b-8f2fec390494\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " Jul 19 14:53:58.588476 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588375 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-oauth-config\") pod \"b058e014-3a77-4954-907b-8f2fec390494\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " Jul 19 14:53:58.588476 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588407 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-serving-cert\") pod \"b058e014-3a77-4954-907b-8f2fec390494\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " Jul 19 14:53:58.588476 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588446 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn2ht\" (UniqueName: \"kubernetes.io/projected/b058e014-3a77-4954-907b-8f2fec390494-kube-api-access-cn2ht\") pod \"b058e014-3a77-4954-907b-8f2fec390494\" (UID: \"b058e014-3a77-4954-907b-8f2fec390494\") " Jul 19 14:53:58.588703 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588674 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-console-config" (OuterVolumeSpecName: "console-config") pod "b058e014-3a77-4954-907b-8f2fec390494" (UID: "b058e014-3a77-4954-907b-8f2fec390494"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:58.588756 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588675 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-service-ca" (OuterVolumeSpecName: "service-ca") pod "b058e014-3a77-4954-907b-8f2fec390494" (UID: "b058e014-3a77-4954-907b-8f2fec390494"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:58.588823 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588806 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b058e014-3a77-4954-907b-8f2fec390494" (UID: "b058e014-3a77-4954-907b-8f2fec390494"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:58.589029 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.588987 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b058e014-3a77-4954-907b-8f2fec390494" (UID: "b058e014-3a77-4954-907b-8f2fec390494"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 14:53:58.590676 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.590649 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b058e014-3a77-4954-907b-8f2fec390494-kube-api-access-cn2ht" (OuterVolumeSpecName: "kube-api-access-cn2ht") pod "b058e014-3a77-4954-907b-8f2fec390494" (UID: "b058e014-3a77-4954-907b-8f2fec390494"). InnerVolumeSpecName "kube-api-access-cn2ht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 14:53:58.590767 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.590676 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b058e014-3a77-4954-907b-8f2fec390494" (UID: "b058e014-3a77-4954-907b-8f2fec390494"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:58.590767 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.590694 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b058e014-3a77-4954-907b-8f2fec390494" (UID: "b058e014-3a77-4954-907b-8f2fec390494"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:53:58.689237 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.689216 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-console-config\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:58.689237 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.689236 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-service-ca\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:58.689356 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.689244 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-oauth-serving-cert\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:58.689356 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.689253 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b058e014-3a77-4954-907b-8f2fec390494-trusted-ca-bundle\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:58.689356 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.689261 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-oauth-config\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:58.689356 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.689270 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b058e014-3a77-4954-907b-8f2fec390494-console-serving-cert\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:58.689356 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:58.689278 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn2ht\" (UniqueName: \"kubernetes.io/projected/b058e014-3a77-4954-907b-8f2fec390494-kube-api-access-cn2ht\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:53:59.357305 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:59.357262 2580 generic.go:356] "Generic (PLEG): container finished" podID="b058e014-3a77-4954-907b-8f2fec390494" containerID="4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec" exitCode=0 Jul 19 14:53:59.357718 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:59.357323 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8566f859cc-8q4gj" Jul 19 14:53:59.357718 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:59.357352 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8566f859cc-8q4gj" event={"ID":"b058e014-3a77-4954-907b-8f2fec390494","Type":"ContainerDied","Data":"4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec"} Jul 19 14:53:59.357718 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:59.357433 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8566f859cc-8q4gj" event={"ID":"b058e014-3a77-4954-907b-8f2fec390494","Type":"ContainerDied","Data":"3bfc14db272ab2661a104277a444558000d9bc696f59816240dbb583b0bc7d86"} Jul 19 14:53:59.357718 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:59.357457 2580 scope.go:117] "RemoveContainer" containerID="4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec" Jul 19 14:53:59.367207 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:59.367186 2580 scope.go:117] "RemoveContainer" containerID="4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec" Jul 19 14:53:59.367479 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:53:59.367459 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec\": container with ID starting with 4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec not found: ID does not exist" containerID="4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec" Jul 19 14:53:59.367533 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:59.367488 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec"} err="failed to get container status \"4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec\": rpc error: code = NotFound desc = could not find container \"4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec\": container with ID starting with 4e403034e94ee54cf2963bb203d66c48e250f3055a622f904da20356f8e847ec not found: ID does not exist" Jul 19 14:53:59.377807 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:59.377782 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8566f859cc-8q4gj"] Jul 19 14:53:59.381363 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:59.381335 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8566f859cc-8q4gj"] Jul 19 14:53:59.786921 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:53:59.786893 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b058e014-3a77-4954-907b-8f2fec390494" path="/var/lib/kubelet/pods/b058e014-3a77-4954-907b-8f2fec390494/volumes" Jul 19 14:54:18.533196 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:54:18.533161 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:54:18.548413 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:54:18.548382 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:54:19.458503 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:54:19.458472 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 19 14:55:43.959803 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:43.959770 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sng45"] Jul 19 14:55:43.960333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:43.960229 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b058e014-3a77-4954-907b-8f2fec390494" containerName="console" Jul 19 14:55:43.960333 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:43.960249 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b058e014-3a77-4954-907b-8f2fec390494" containerName="console" Jul 19 14:55:43.960448 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:43.960352 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b058e014-3a77-4954-907b-8f2fec390494" containerName="console" Jul 19 14:55:43.963282 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:43.963262 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" Jul 19 14:55:43.965544 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:43.965518 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 19 14:55:43.965632 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:43.965549 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 19 14:55:43.966452 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:43.966435 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cwsxm\"" Jul 19 14:55:43.974325 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:43.974295 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sng45"] Jul 19 14:55:44.041491 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:44.041463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrb7l\" (UniqueName: \"kubernetes.io/projected/da182802-c0f3-4c22-a610-30e4322d167b-kube-api-access-mrb7l\") pod \"cert-manager-webhook-6486ffd997-sng45\" (UID: \"da182802-c0f3-4c22-a610-30e4322d167b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" Jul 19 14:55:44.041598 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:44.041502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da182802-c0f3-4c22-a610-30e4322d167b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sng45\" (UID: \"da182802-c0f3-4c22-a610-30e4322d167b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" Jul 19 14:55:44.142855 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:44.142832 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrb7l\" (UniqueName: \"kubernetes.io/projected/da182802-c0f3-4c22-a610-30e4322d167b-kube-api-access-mrb7l\") pod \"cert-manager-webhook-6486ffd997-sng45\" (UID: \"da182802-c0f3-4c22-a610-30e4322d167b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" Jul 19 14:55:44.142950 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:44.142867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da182802-c0f3-4c22-a610-30e4322d167b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sng45\" (UID: \"da182802-c0f3-4c22-a610-30e4322d167b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" Jul 19 14:55:44.156812 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:44.156792 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrb7l\" (UniqueName: \"kubernetes.io/projected/da182802-c0f3-4c22-a610-30e4322d167b-kube-api-access-mrb7l\") pod \"cert-manager-webhook-6486ffd997-sng45\" (UID: \"da182802-c0f3-4c22-a610-30e4322d167b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" Jul 19 14:55:44.158192 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:44.158173 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da182802-c0f3-4c22-a610-30e4322d167b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sng45\" (UID: \"da182802-c0f3-4c22-a610-30e4322d167b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" Jul 19 14:55:44.281200 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:44.281147 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" Jul 19 14:55:44.421518 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:44.421489 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sng45"] Jul 19 14:55:44.423408 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:55:44.423369 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda182802_c0f3_4c22_a610_30e4322d167b.slice/crio-266b53fa7e7c99784fc40312c5ee410d2b57a69c5a60408dd8ee792464b33d25 WatchSource:0}: Error finding container 266b53fa7e7c99784fc40312c5ee410d2b57a69c5a60408dd8ee792464b33d25: Status 404 returned error can't find the container with id 266b53fa7e7c99784fc40312c5ee410d2b57a69c5a60408dd8ee792464b33d25 Jul 19 14:55:44.785982 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:44.785948 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" event={"ID":"da182802-c0f3-4c22-a610-30e4322d167b","Type":"ContainerStarted","Data":"266b53fa7e7c99784fc40312c5ee410d2b57a69c5a60408dd8ee792464b33d25"} Jul 19 14:55:47.799940 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:47.799905 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" event={"ID":"da182802-c0f3-4c22-a610-30e4322d167b","Type":"ContainerStarted","Data":"96a3d85a6bcc892a8295f81c54633581b7e5f81fa66d672364019754fe839fa5"} Jul 19 14:55:47.800424 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:47.799968 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" Jul 19 14:55:47.817057 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:47.816997 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" podStartSLOduration=1.89498688 podStartE2EDuration="4.816983497s" totalImagesPullingTime="2.921996617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:55:47.814714897 +0000 UTC m=+552.528827176" watchObservedRunningTime="2026-07-19 14:55:47.816983497 +0000 UTC m=+552.531095776" Jul 19 14:55:53.805811 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:55:53.805783 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sng45" Jul 19 14:56:17.969346 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:17.969311 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn"] Jul 19 14:56:17.972749 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:17.972730 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:17.975119 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:17.975095 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 19 14:56:17.975447 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:17.975429 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 19 14:56:17.975541 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:17.975429 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 19 14:56:17.976035 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:17.975992 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 19 14:56:17.976130 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:17.976114 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2qtz6\"" Jul 19 14:56:18.009870 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.009843 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn"] Jul 19 14:56:18.091160 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.091133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/10fa1d2a-65af-404b-ac04-faa19f84feb6-manifests\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.091263 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.091189 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10fa1d2a-65af-404b-ac04-faa19f84feb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.091263 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.091227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10fa1d2a-65af-404b-ac04-faa19f84feb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.091343 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.091261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgqbm\" (UniqueName: \"kubernetes.io/projected/10fa1d2a-65af-404b-ac04-faa19f84feb6-kube-api-access-dgqbm\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.091343 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.091302 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10fa1d2a-65af-404b-ac04-faa19f84feb6-tmp\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.191900 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.191874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10fa1d2a-65af-404b-ac04-faa19f84feb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.192102 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.191902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10fa1d2a-65af-404b-ac04-faa19f84feb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.192102 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.191919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgqbm\" (UniqueName: \"kubernetes.io/projected/10fa1d2a-65af-404b-ac04-faa19f84feb6-kube-api-access-dgqbm\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.192102 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.191936 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10fa1d2a-65af-404b-ac04-faa19f84feb6-tmp\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.192102 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.192079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/10fa1d2a-65af-404b-ac04-faa19f84feb6-manifests\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.192435 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.192410 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/10fa1d2a-65af-404b-ac04-faa19f84feb6-manifests\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.194115 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.194088 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10fa1d2a-65af-404b-ac04-faa19f84feb6-tmp\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.194373 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.194353 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/10fa1d2a-65af-404b-ac04-faa19f84feb6-webhook-cert\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.194439 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.194359 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/10fa1d2a-65af-404b-ac04-faa19f84feb6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.203586 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.203565 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgqbm\" (UniqueName: \"kubernetes.io/projected/10fa1d2a-65af-404b-ac04-faa19f84feb6-kube-api-access-dgqbm\") pod \"opendatahub-operator-controller-manager-c7885d785-krlbn\" (UID: \"10fa1d2a-65af-404b-ac04-faa19f84feb6\") " pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.282416 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.282358 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:18.418276 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.418224 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn"] Jul 19 14:56:18.420649 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:56:18.420622 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fa1d2a_65af_404b_ac04_faa19f84feb6.slice/crio-c032fd5611b11454b3d1b1467b569e45877fbe1a98381760c19bd0b44675da83 WatchSource:0}: Error finding container c032fd5611b11454b3d1b1467b569e45877fbe1a98381760c19bd0b44675da83: Status 404 returned error can't find the container with id c032fd5611b11454b3d1b1467b569e45877fbe1a98381760c19bd0b44675da83 Jul 19 14:56:18.932284 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:18.932252 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" event={"ID":"10fa1d2a-65af-404b-ac04-faa19f84feb6","Type":"ContainerStarted","Data":"c032fd5611b11454b3d1b1467b569e45877fbe1a98381760c19bd0b44675da83"} Jul 19 14:56:21.950376 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:21.950342 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" event={"ID":"10fa1d2a-65af-404b-ac04-faa19f84feb6","Type":"ContainerStarted","Data":"768fc304f78c4117e344025b712136ffc4db2953c6473d3a0f74571e9022f4dd"} Jul 19 14:56:22.955979 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:22.955899 2580 generic.go:356] "Generic (PLEG): container finished" podID="10fa1d2a-65af-404b-ac04-faa19f84feb6" containerID="768fc304f78c4117e344025b712136ffc4db2953c6473d3a0f74571e9022f4dd" exitCode=0 Jul 19 14:56:22.955979 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:22.955948 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" event={"ID":"10fa1d2a-65af-404b-ac04-faa19f84feb6","Type":"ContainerDied","Data":"768fc304f78c4117e344025b712136ffc4db2953c6473d3a0f74571e9022f4dd"} Jul 19 14:56:23.961957 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:23.961922 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" event={"ID":"10fa1d2a-65af-404b-ac04-faa19f84feb6","Type":"ContainerStarted","Data":"11888d5bdc2894731f19ee86de6b7e97c5b85711d230cce489890436c51fe7c5"} Jul 19 14:56:23.962334 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:23.962037 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:23.981878 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:23.981833 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" podStartSLOduration=2.398676329 podStartE2EDuration="6.981818863s" totalImagesPullingTime="3.51556518s" totalInitContainerRuntime="1.067577354s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:56:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:56:23.980086802 +0000 UTC m=+588.694199084" watchObservedRunningTime="2026-07-19 14:56:23.981818863 +0000 UTC m=+588.695931141" Jul 19 14:56:34.968022 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:34.967976 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c7885d785-krlbn" Jul 19 14:56:35.760465 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:35.760436 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 14:56:35.761360 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:35.761337 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 14:56:44.423824 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.423793 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl"] Jul 19 14:56:44.427093 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.427072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.429586 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.429565 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 19 14:56:44.429586 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.429581 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 19 14:56:44.430543 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.430527 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 19 14:56:44.430642 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.430625 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 19 14:56:44.430736 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.430719 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 19 14:56:44.430810 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.430793 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-74w5g\"" Jul 19 14:56:44.436972 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.436951 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl"] Jul 19 14:56:44.588981 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.588947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aa71943-db6f-4d5c-b022-3ab25620a76e-cert\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.589152 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.589002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27d8b\" (UniqueName: \"kubernetes.io/projected/2aa71943-db6f-4d5c-b022-3ab25620a76e-kube-api-access-27d8b\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.589152 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.589109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2aa71943-db6f-4d5c-b022-3ab25620a76e-metrics-cert\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.589235 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.589155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2aa71943-db6f-4d5c-b022-3ab25620a76e-manager-config\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.689951 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.689878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aa71943-db6f-4d5c-b022-3ab25620a76e-cert\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.689951 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.689915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27d8b\" (UniqueName: \"kubernetes.io/projected/2aa71943-db6f-4d5c-b022-3ab25620a76e-kube-api-access-27d8b\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.690183 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.689953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2aa71943-db6f-4d5c-b022-3ab25620a76e-metrics-cert\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.690183 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.689981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2aa71943-db6f-4d5c-b022-3ab25620a76e-manager-config\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.690649 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.690628 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2aa71943-db6f-4d5c-b022-3ab25620a76e-manager-config\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.692343 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.692322 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aa71943-db6f-4d5c-b022-3ab25620a76e-cert\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.692467 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.692449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2aa71943-db6f-4d5c-b022-3ab25620a76e-metrics-cert\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.705312 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.705288 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27d8b\" (UniqueName: \"kubernetes.io/projected/2aa71943-db6f-4d5c-b022-3ab25620a76e-kube-api-access-27d8b\") pod \"lws-controller-manager-5cc4ccf5bd-498sl\" (UID: \"2aa71943-db6f-4d5c-b022-3ab25620a76e\") " pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.737281 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.737255 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:44.868834 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.868810 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl"] Jul 19 14:56:44.870711 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:56:44.870680 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa71943_db6f_4d5c_b022_3ab25620a76e.slice/crio-3d6324df1d6dc483dcd793b417efde996d031f18a0840365522ea2c4a8c1974d WatchSource:0}: Error finding container 3d6324df1d6dc483dcd793b417efde996d031f18a0840365522ea2c4a8c1974d: Status 404 returned error can't find the container with id 3d6324df1d6dc483dcd793b417efde996d031f18a0840365522ea2c4a8c1974d Jul 19 14:56:44.872611 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:44.872594 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 19 14:56:45.054828 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.054759 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" event={"ID":"2aa71943-db6f-4d5c-b022-3ab25620a76e","Type":"ContainerStarted","Data":"3d6324df1d6dc483dcd793b417efde996d031f18a0840365522ea2c4a8c1974d"} Jul 19 14:56:45.125914 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.125886 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz"] Jul 19 14:56:45.130623 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.130594 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.135138 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.133637 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 19 14:56:45.135138 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.133927 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 19 14:56:45.137241 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.137187 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 19 14:56:45.137377 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.137247 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-x2nq4\"" Jul 19 14:56:45.137490 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.137469 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 19 14:56:45.137620 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.137600 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 19 14:56:45.137905 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.137884 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 19 14:56:45.141424 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.141399 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz"] Jul 19 14:56:45.294527 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.294496 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1b721f6-e794-4229-8de4-662e412cf65c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.294527 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.294528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1b721f6-e794-4229-8de4-662e412cf65c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.294742 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.294547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5f46\" (UniqueName: \"kubernetes.io/projected/f1b721f6-e794-4229-8de4-662e412cf65c-kube-api-access-f5f46\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.294742 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.294566 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1b721f6-e794-4229-8de4-662e412cf65c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.294742 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.294652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1b721f6-e794-4229-8de4-662e412cf65c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.294742 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.294688 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1b721f6-e794-4229-8de4-662e412cf65c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.294742 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.294713 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1b721f6-e794-4229-8de4-662e412cf65c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.395555 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.395527 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1b721f6-e794-4229-8de4-662e412cf65c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.395698 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.395562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5f46\" (UniqueName: \"kubernetes.io/projected/f1b721f6-e794-4229-8de4-662e412cf65c-kube-api-access-f5f46\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.395698 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.395596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1b721f6-e794-4229-8de4-662e412cf65c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.395698 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.395632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1b721f6-e794-4229-8de4-662e412cf65c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.395698 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.395660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1b721f6-e794-4229-8de4-662e412cf65c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.395698 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.395685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1b721f6-e794-4229-8de4-662e412cf65c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.395954 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.395798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1b721f6-e794-4229-8de4-662e412cf65c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.396239 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.396213 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1b721f6-e794-4229-8de4-662e412cf65c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.398088 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.398059 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1b721f6-e794-4229-8de4-662e412cf65c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.398218 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.398199 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1b721f6-e794-4229-8de4-662e412cf65c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.398287 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.398233 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1b721f6-e794-4229-8de4-662e412cf65c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.398287 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.398265 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1b721f6-e794-4229-8de4-662e412cf65c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.403961 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.403933 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1b721f6-e794-4229-8de4-662e412cf65c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.404083 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.403993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5f46\" (UniqueName: \"kubernetes.io/projected/f1b721f6-e794-4229-8de4-662e412cf65c-kube-api-access-f5f46\") pod \"istiod-openshift-gateway-94bb8fbfd-nltlz\" (UID: \"f1b721f6-e794-4229-8de4-662e412cf65c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.445933 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.445913 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:45.651893 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:45.651774 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz"] Jul 19 14:56:45.657484 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:56:45.657453 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b721f6_e794_4229_8de4_662e412cf65c.slice/crio-a4fadc6d7672638aaf86b299070904c52ef8ffb04b4099c656ff489f8741349f WatchSource:0}: Error finding container a4fadc6d7672638aaf86b299070904c52ef8ffb04b4099c656ff489f8741349f: Status 404 returned error can't find the container with id a4fadc6d7672638aaf86b299070904c52ef8ffb04b4099c656ff489f8741349f Jul 19 14:56:46.061380 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:46.061304 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" event={"ID":"f1b721f6-e794-4229-8de4-662e412cf65c","Type":"ContainerStarted","Data":"a4fadc6d7672638aaf86b299070904c52ef8ffb04b4099c656ff489f8741349f"} Jul 19 14:56:48.549163 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:48.549127 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 19 14:56:48.549527 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:48.549194 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 19 14:56:49.079785 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:49.079746 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" event={"ID":"f1b721f6-e794-4229-8de4-662e412cf65c","Type":"ContainerStarted","Data":"1b8069c8496e6ec1b5ae73603ac1e9a163792d9e34047552b91bae29b031e5a7"} Jul 19 14:56:49.080068 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:49.079815 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:56:49.081609 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:49.081578 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" event={"ID":"2aa71943-db6f-4d5c-b022-3ab25620a76e","Type":"ContainerStarted","Data":"6e4eec4511721e34c7df36e6d49840adb107ae7e19f7269b3504f193df0f7490"} Jul 19 14:56:49.081749 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:49.081721 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:56:49.081942 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:49.081912 2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-nltlz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 19 14:56:49.082071 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:49.081968 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" podUID="f1b721f6-e794-4229-8de4-662e412cf65c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 19 14:56:49.104005 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:49.103961 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" podStartSLOduration=1.217576179 podStartE2EDuration="4.103945389s" totalImagesPullingTime="2.88636921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:56:49.103901746 +0000 UTC m=+613.818014026" watchObservedRunningTime="2026-07-19 14:56:49.103945389 +0000 UTC m=+613.818057667" Jul 19 14:56:49.127780 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:49.127734 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" podStartSLOduration=1.5019167150000001 podStartE2EDuration="5.127720311s" totalImagesPullingTime="3.625803596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:56:49.125949825 +0000 UTC m=+613.840062105" watchObservedRunningTime="2026-07-19 14:56:49.127720311 +0000 UTC m=+613.841832590" Jul 19 14:56:50.086540 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:56:50.086510 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nltlz" Jul 19 14:57:00.088432 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:57:00.088341 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cc4ccf5bd-498sl" Jul 19 14:58:24.998024 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:24.997973 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85f9f64c47-6vp6g"] Jul 19 14:58:25.001668 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.001644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.004034 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.003991 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 19 14:58:25.004163 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.004051 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 19 14:58:25.004346 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.004325 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7m7q9\"" Jul 19 14:58:25.005291 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.005081 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 19 14:58:25.005291 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.005116 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 19 14:58:25.005470 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.005312 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 19 14:58:25.008958 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.008812 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 19 14:58:25.011503 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.011476 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f9f64c47-6vp6g"] Jul 19 14:58:25.058634 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.058612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-trusted-ca-bundle\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.058772 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.058645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcjqh\" (UniqueName: \"kubernetes.io/projected/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-kube-api-access-dcjqh\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.058772 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.058681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-oauth-serving-cert\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.058772 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.058748 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-console-oauth-config\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.058923 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.058781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-service-ca\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.058923 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.058824 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-console-serving-cert\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.058923 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.058849 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-console-config\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.159520 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.159484 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-trusted-ca-bundle\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.159685 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.159527 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcjqh\" (UniqueName: \"kubernetes.io/projected/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-kube-api-access-dcjqh\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.159685 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.159561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-oauth-serving-cert\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.159685 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.159600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-console-oauth-config\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.159685 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.159635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-service-ca\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.159899 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.159774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-console-serving-cert\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.159899 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.159813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-console-config\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.160313 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.160290 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-oauth-serving-cert\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.160474 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.160381 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-service-ca\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.160592 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.160524 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-console-config\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.160592 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.160535 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-trusted-ca-bundle\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.162089 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.162071 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-console-oauth-config\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.162202 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.162181 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-console-serving-cert\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.167779 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.167761 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcjqh\" (UniqueName: \"kubernetes.io/projected/346b2231-58b1-4ab4-ad98-4af5a4bb2c3e-kube-api-access-dcjqh\") pod \"console-85f9f64c47-6vp6g\" (UID: \"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e\") " pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.312798 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.312715 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:25.442958 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.442936 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f9f64c47-6vp6g"] Jul 19 14:58:25.445382 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:58:25.445353 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346b2231_58b1_4ab4_ad98_4af5a4bb2c3e.slice/crio-1318ee04bee07f4a729c9ac45a68413d2ed095bae269e62507b354eda77bbd95 WatchSource:0}: Error finding container 1318ee04bee07f4a729c9ac45a68413d2ed095bae269e62507b354eda77bbd95: Status 404 returned error can't find the container with id 1318ee04bee07f4a729c9ac45a68413d2ed095bae269e62507b354eda77bbd95 Jul 19 14:58:25.514342 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.514314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f9f64c47-6vp6g" event={"ID":"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e","Type":"ContainerStarted","Data":"22137d28076d41c3a7c2bd283c5079064f0395331ab65d97363a9b379dddb730"} Jul 19 14:58:25.514422 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:25.514367 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f9f64c47-6vp6g" event={"ID":"346b2231-58b1-4ab4-ad98-4af5a4bb2c3e","Type":"ContainerStarted","Data":"1318ee04bee07f4a729c9ac45a68413d2ed095bae269e62507b354eda77bbd95"} Jul 19 14:58:29.131671 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.131573 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85f9f64c47-6vp6g" podStartSLOduration=5.131555785 podStartE2EDuration="5.131555785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:58:25.533934262 +0000 UTC m=+710.248046563" watchObservedRunningTime="2026-07-19 14:58:29.131555785 +0000 UTC m=+713.845668064" Jul 19 14:58:29.132002 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.131803 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg"] Jul 19 14:58:29.135266 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.135249 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 14:58:29.137804 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.137765 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 19 14:58:29.137931 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.137818 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hjf4n\"" Jul 19 14:58:29.138047 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.138032 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 19 14:58:29.146245 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.146225 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg"] Jul 19 14:58:29.190121 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.190094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppkpv\" (UniqueName: \"kubernetes.io/projected/b60209ca-7baf-426e-8a93-413bdf9f05af-kube-api-access-ppkpv\") pod \"kuadrant-operator-controller-manager-86878c769f-c8qhg\" (UID: \"b60209ca-7baf-426e-8a93-413bdf9f05af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 14:58:29.190206 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.190150 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b60209ca-7baf-426e-8a93-413bdf9f05af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c8qhg\" (UID: \"b60209ca-7baf-426e-8a93-413bdf9f05af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 14:58:29.290471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.290445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppkpv\" (UniqueName: \"kubernetes.io/projected/b60209ca-7baf-426e-8a93-413bdf9f05af-kube-api-access-ppkpv\") pod \"kuadrant-operator-controller-manager-86878c769f-c8qhg\" (UID: \"b60209ca-7baf-426e-8a93-413bdf9f05af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 14:58:29.290570 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.290490 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b60209ca-7baf-426e-8a93-413bdf9f05af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c8qhg\" (UID: \"b60209ca-7baf-426e-8a93-413bdf9f05af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 14:58:29.290791 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.290776 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b60209ca-7baf-426e-8a93-413bdf9f05af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c8qhg\" (UID: \"b60209ca-7baf-426e-8a93-413bdf9f05af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 14:58:29.298282 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.298256 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppkpv\" (UniqueName: \"kubernetes.io/projected/b60209ca-7baf-426e-8a93-413bdf9f05af-kube-api-access-ppkpv\") pod \"kuadrant-operator-controller-manager-86878c769f-c8qhg\" (UID: \"b60209ca-7baf-426e-8a93-413bdf9f05af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 14:58:29.446928 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.446861 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 14:58:29.587439 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:29.587413 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg"] Jul 19 14:58:29.589998 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:58:29.589965 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60209ca_7baf_426e_8a93_413bdf9f05af.slice/crio-54ff0578d20e6b1d1071e9068514eaa14ef3b690144e71ce6b1932f274927def WatchSource:0}: Error finding container 54ff0578d20e6b1d1071e9068514eaa14ef3b690144e71ce6b1932f274927def: Status 404 returned error can't find the container with id 54ff0578d20e6b1d1071e9068514eaa14ef3b690144e71ce6b1932f274927def Jul 19 14:58:30.543412 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:30.543377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" event={"ID":"b60209ca-7baf-426e-8a93-413bdf9f05af","Type":"ContainerStarted","Data":"54ff0578d20e6b1d1071e9068514eaa14ef3b690144e71ce6b1932f274927def"} Jul 19 14:58:34.564455 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:34.564424 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" event={"ID":"b60209ca-7baf-426e-8a93-413bdf9f05af","Type":"ContainerStarted","Data":"aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16"} Jul 19 14:58:34.564815 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:34.564498 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 14:58:34.593145 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:34.593100 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" podStartSLOduration=1.297261375 podStartE2EDuration="5.593077347s" totalImagesPullingTime="4.295815972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:58:34.591491633 +0000 UTC m=+719.305603889" watchObservedRunningTime="2026-07-19 14:58:34.593077347 +0000 UTC m=+719.307189625" Jul 19 14:58:35.313551 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:35.313519 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:35.313742 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:35.313570 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:35.318388 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:35.318364 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:35.573342 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:35.573270 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85f9f64c47-6vp6g" Jul 19 14:58:45.571471 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:58:45.571441 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 14:59:44.476524 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.476491 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c4dbd5f98-f76cx"] Jul 19 14:59:44.479238 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.479215 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:44.481946 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.481925 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 19 14:59:44.482108 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.482080 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hbc4m\"" Jul 19 14:59:44.482522 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.482506 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 19 14:59:44.491523 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.491503 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4dbd5f98-f76cx"] Jul 19 14:59:44.573578 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.573549 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-webhook-cert\") pod \"maas-controller-6c4dbd5f98-f76cx\" (UID: \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\") " pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:44.573691 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.573583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t4kk\" (UniqueName: \"kubernetes.io/projected/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-kube-api-access-4t4kk\") pod \"maas-controller-6c4dbd5f98-f76cx\" (UID: \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\") " pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:44.674549 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.674526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-webhook-cert\") pod \"maas-controller-6c4dbd5f98-f76cx\" (UID: \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\") " pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:44.674674 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.674556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t4kk\" (UniqueName: \"kubernetes.io/projected/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-kube-api-access-4t4kk\") pod \"maas-controller-6c4dbd5f98-f76cx\" (UID: \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\") " pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:44.674742 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:59:44.674675 2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 19 14:59:44.674794 ip-10-0-139-202 kubenswrapper[2580]: E0719 14:59:44.674756 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-webhook-cert podName:939e3a5a-d6e2-44d0-904e-cd1bf256cadf nodeName:}" failed. No retries permitted until 2026-07-19 14:59:45.174735045 +0000 UTC m=+789.888847319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-webhook-cert") pod "maas-controller-6c4dbd5f98-f76cx" (UID: "939e3a5a-d6e2-44d0-904e-cd1bf256cadf") : secret "maas-controller-webhook-cert" not found Jul 19 14:59:44.683567 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:44.683544 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t4kk\" (UniqueName: \"kubernetes.io/projected/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-kube-api-access-4t4kk\") pod \"maas-controller-6c4dbd5f98-f76cx\" (UID: \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\") " pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:45.178654 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:45.178626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-webhook-cert\") pod \"maas-controller-6c4dbd5f98-f76cx\" (UID: \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\") " pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:45.180909 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:45.180887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-webhook-cert\") pod \"maas-controller-6c4dbd5f98-f76cx\" (UID: \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\") " pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:45.390227 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:45.390179 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:45.517116 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:45.517094 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4dbd5f98-f76cx"] Jul 19 14:59:45.519547 ip-10-0-139-202 kubenswrapper[2580]: W0719 14:59:45.519518 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939e3a5a_d6e2_44d0_904e_cd1bf256cadf.slice/crio-fb447d5e1dab050cdba3c782322f6afa67759be6f91a687d611ca275cca878f1 WatchSource:0}: Error finding container fb447d5e1dab050cdba3c782322f6afa67759be6f91a687d611ca275cca878f1: Status 404 returned error can't find the container with id fb447d5e1dab050cdba3c782322f6afa67759be6f91a687d611ca275cca878f1 Jul 19 14:59:45.883081 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:45.883044 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" event={"ID":"939e3a5a-d6e2-44d0-904e-cd1bf256cadf","Type":"ContainerStarted","Data":"fb447d5e1dab050cdba3c782322f6afa67759be6f91a687d611ca275cca878f1"} Jul 19 14:59:47.894327 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:47.894296 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" event={"ID":"939e3a5a-d6e2-44d0-904e-cd1bf256cadf","Type":"ContainerStarted","Data":"3ae9a1c4d9aab27d1f878d5ce26db01fdffd6fa30fbd1ffaab9d469660d08d65"} Jul 19 14:59:47.894637 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:47.894362 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:47.911597 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:47.911556 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" podStartSLOduration=1.6066948970000001 podStartE2EDuration="3.911540911s" totalImagesPullingTime="2.304846014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:59:47.909779093 +0000 UTC m=+792.623891372" watchObservedRunningTime="2026-07-19 14:59:47.911540911 +0000 UTC m=+792.625653189" Jul 19 14:59:58.706531 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:58.706454 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c4dbd5f98-f76cx"] Jul 19 14:59:58.706921 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:58.706675 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" podUID="939e3a5a-d6e2-44d0-904e-cd1bf256cadf" containerName="manager" containerID="cri-o://3ae9a1c4d9aab27d1f878d5ce26db01fdffd6fa30fbd1ffaab9d469660d08d65" gracePeriod=30 Jul 19 14:59:58.708438 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:58.708416 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:58.943833 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:58.943805 2580 generic.go:356] "Generic (PLEG): container finished" podID="939e3a5a-d6e2-44d0-904e-cd1bf256cadf" containerID="3ae9a1c4d9aab27d1f878d5ce26db01fdffd6fa30fbd1ffaab9d469660d08d65" exitCode=0 Jul 19 14:59:58.943954 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:58.943852 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" event={"ID":"939e3a5a-d6e2-44d0-904e-cd1bf256cadf","Type":"ContainerDied","Data":"3ae9a1c4d9aab27d1f878d5ce26db01fdffd6fa30fbd1ffaab9d469660d08d65"} Jul 19 14:59:58.943954 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:58.943909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" event={"ID":"939e3a5a-d6e2-44d0-904e-cd1bf256cadf","Type":"ContainerDied","Data":"fb447d5e1dab050cdba3c782322f6afa67759be6f91a687d611ca275cca878f1"} Jul 19 14:59:58.943954 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:58.943931 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb447d5e1dab050cdba3c782322f6afa67759be6f91a687d611ca275cca878f1" Jul 19 14:59:58.949700 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:58.949682 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:59.102406 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:59.102343 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-webhook-cert\") pod \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\" (UID: \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\") " Jul 19 14:59:59.102517 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:59.102440 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t4kk\" (UniqueName: \"kubernetes.io/projected/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-kube-api-access-4t4kk\") pod \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\" (UID: \"939e3a5a-d6e2-44d0-904e-cd1bf256cadf\") " Jul 19 14:59:59.104387 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:59.104362 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "939e3a5a-d6e2-44d0-904e-cd1bf256cadf" (UID: "939e3a5a-d6e2-44d0-904e-cd1bf256cadf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 19 14:59:59.104490 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:59.104395 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-kube-api-access-4t4kk" (OuterVolumeSpecName: "kube-api-access-4t4kk") pod "939e3a5a-d6e2-44d0-904e-cd1bf256cadf" (UID: "939e3a5a-d6e2-44d0-904e-cd1bf256cadf"). InnerVolumeSpecName "kube-api-access-4t4kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 14:59:59.203165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:59.203135 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-webhook-cert\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:59:59.203165 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:59.203164 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t4kk\" (UniqueName: \"kubernetes.io/projected/939e3a5a-d6e2-44d0-904e-cd1bf256cadf-kube-api-access-4t4kk\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 14:59:59.948568 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:59.948539 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4dbd5f98-f76cx" Jul 19 14:59:59.964119 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:59.964092 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c4dbd5f98-f76cx"] Jul 19 14:59:59.968179 ip-10-0-139-202 kubenswrapper[2580]: I0719 14:59:59.968159 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c4dbd5f98-f76cx"] Jul 19 15:00:01.787876 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:01.787839 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="939e3a5a-d6e2-44d0-904e-cd1bf256cadf" path="/var/lib/kubelet/pods/939e3a5a-d6e2-44d0-904e-cd1bf256cadf/volumes" Jul 19 15:00:21.025701 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.025669 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-94ddk"] Jul 19 15:00:21.026158 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.026002 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="939e3a5a-d6e2-44d0-904e-cd1bf256cadf" containerName="manager" Jul 19 15:00:21.026158 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.026026 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="939e3a5a-d6e2-44d0-904e-cd1bf256cadf" containerName="manager" Jul 19 15:00:21.026158 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.026112 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="939e3a5a-d6e2-44d0-904e-cd1bf256cadf" containerName="manager" Jul 19 15:00:21.029272 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.029255 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" Jul 19 15:00:21.032467 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.032445 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 19 15:00:21.032776 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.032504 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-htknr\"" Jul 19 15:00:21.040633 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.040611 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-94ddk"] Jul 19 15:00:21.080636 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.080605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd7jn\" (UniqueName: \"kubernetes.io/projected/79941e82-4b6f-4ce1-b89f-eaaae1199501-kube-api-access-zd7jn\") pod \"payload-processing-5bf47cd988-94ddk\" (UID: \"79941e82-4b6f-4ce1-b89f-eaaae1199501\") " pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" Jul 19 15:00:21.080786 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.080685 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79941e82-4b6f-4ce1-b89f-eaaae1199501-plugins-config-volume\") pod \"payload-processing-5bf47cd988-94ddk\" (UID: \"79941e82-4b6f-4ce1-b89f-eaaae1199501\") " pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" Jul 19 15:00:21.181740 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.181700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79941e82-4b6f-4ce1-b89f-eaaae1199501-plugins-config-volume\") pod \"payload-processing-5bf47cd988-94ddk\" (UID: \"79941e82-4b6f-4ce1-b89f-eaaae1199501\") " pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" Jul 19 15:00:21.181897 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.181861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd7jn\" (UniqueName: \"kubernetes.io/projected/79941e82-4b6f-4ce1-b89f-eaaae1199501-kube-api-access-zd7jn\") pod \"payload-processing-5bf47cd988-94ddk\" (UID: \"79941e82-4b6f-4ce1-b89f-eaaae1199501\") " pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" Jul 19 15:00:21.182445 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.182426 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79941e82-4b6f-4ce1-b89f-eaaae1199501-plugins-config-volume\") pod \"payload-processing-5bf47cd988-94ddk\" (UID: \"79941e82-4b6f-4ce1-b89f-eaaae1199501\") " pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" Jul 19 15:00:21.191461 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.191441 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd7jn\" (UniqueName: \"kubernetes.io/projected/79941e82-4b6f-4ce1-b89f-eaaae1199501-kube-api-access-zd7jn\") pod \"payload-processing-5bf47cd988-94ddk\" (UID: \"79941e82-4b6f-4ce1-b89f-eaaae1199501\") " pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" Jul 19 15:00:21.339658 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.339590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" Jul 19 15:00:21.474169 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:21.474139 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-94ddk"] Jul 19 15:00:21.476994 ip-10-0-139-202 kubenswrapper[2580]: W0719 15:00:21.476964 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79941e82_4b6f_4ce1_b89f_eaaae1199501.slice/crio-afae073630d4c3ebf5ff5f5c1efadfd94c21369eb9f0cea022e71860eac88bc3 WatchSource:0}: Error finding container afae073630d4c3ebf5ff5f5c1efadfd94c21369eb9f0cea022e71860eac88bc3: Status 404 returned error can't find the container with id afae073630d4c3ebf5ff5f5c1efadfd94c21369eb9f0cea022e71860eac88bc3 Jul 19 15:00:22.053567 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:22.053529 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" event={"ID":"79941e82-4b6f-4ce1-b89f-eaaae1199501","Type":"ContainerStarted","Data":"afae073630d4c3ebf5ff5f5c1efadfd94c21369eb9f0cea022e71860eac88bc3"} Jul 19 15:00:24.064745 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:24.064708 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" event={"ID":"79941e82-4b6f-4ce1-b89f-eaaae1199501","Type":"ContainerStarted","Data":"7c240dc6d092fc02d829e680b0c61e0d233422e074091deac74df0c6258fb596"} Jul 19 15:00:24.065135 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:24.064772 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" Jul 19 15:00:24.080055 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:24.079987 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" podStartSLOduration=1.5218744499999999 podStartE2EDuration="3.079972397s" totalImagesPullingTime="1.558097947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:00:24.079032409 +0000 UTC m=+828.793144683" watchObservedRunningTime="2026-07-19 15:00:24.079972397 +0000 UTC m=+828.794084676" Jul 19 15:00:35.071198 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:00:35.071163 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-94ddk" Jul 19 15:01:01.787138 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.787106 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9"] Jul 19 15:01:01.790588 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.790565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.793682 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.793660 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 19 15:01:01.794546 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.794522 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9"] Jul 19 15:01:01.794660 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.794588 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bfqdt\"" Jul 19 15:01:01.794660 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.794610 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 19 15:01:01.794961 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.794943 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 19 15:01:01.893209 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.893185 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.893325 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.893213 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.893325 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.893244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.893325 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.893267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.893325 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.893288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653625d0-9941-4fe4-ba6d-a897d9f1ad33-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.893325 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.893305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tvkp\" (UniqueName: \"kubernetes.io/projected/653625d0-9941-4fe4-ba6d-a897d9f1ad33-kube-api-access-6tvkp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.994333 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.994308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.994485 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.994342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.994485 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.994393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.994485 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.994421 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.994485 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.994456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653625d0-9941-4fe4-ba6d-a897d9f1ad33-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.994485 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.994480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tvkp\" (UniqueName: \"kubernetes.io/projected/653625d0-9941-4fe4-ba6d-a897d9f1ad33-kube-api-access-6tvkp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.994817 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.994793 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.994873 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.994826 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.994873 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.994849 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.996558 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.996532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653625d0-9941-4fe4-ba6d-a897d9f1ad33-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:01.997070 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:01.997050 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653625d0-9941-4fe4-ba6d-a897d9f1ad33-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:02.001895 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:02.001870 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tvkp\" (UniqueName: \"kubernetes.io/projected/653625d0-9941-4fe4-ba6d-a897d9f1ad33-kube-api-access-6tvkp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9\" (UID: \"653625d0-9941-4fe4-ba6d-a897d9f1ad33\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:02.103905 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:02.103823 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:02.235411 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:02.235385 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9"] Jul 19 15:01:02.237623 ip-10-0-139-202 kubenswrapper[2580]: W0719 15:01:02.237588 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653625d0_9941_4fe4_ba6d_a897d9f1ad33.slice/crio-f4e1b5396b8a378ca20cedf29846a5a971faef577537a781750907e0ce397d71 WatchSource:0}: Error finding container f4e1b5396b8a378ca20cedf29846a5a971faef577537a781750907e0ce397d71: Status 404 returned error can't find the container with id f4e1b5396b8a378ca20cedf29846a5a971faef577537a781750907e0ce397d71 Jul 19 15:01:02.247831 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:02.247806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" event={"ID":"653625d0-9941-4fe4-ba6d-a897d9f1ad33","Type":"ContainerStarted","Data":"f4e1b5396b8a378ca20cedf29846a5a971faef577537a781750907e0ce397d71"} Jul 19 15:01:04.259812 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:04.259778 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" event={"ID":"653625d0-9941-4fe4-ba6d-a897d9f1ad33","Type":"ContainerStarted","Data":"6509ddc0cffff60703d0298bb6a274e809f0d7284cae39df03885e446775a3bf"} Jul 19 15:01:04.276484 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:04.276438 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" podStartSLOduration=2.152749226 podStartE2EDuration="3.276426457s" totalImagesPullingTime="1.123677231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:01:04.27640569 +0000 UTC m=+868.990517969" watchObservedRunningTime="2026-07-19 15:01:04.276426457 +0000 UTC m=+868.990538736" Jul 19 15:01:12.104133 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:12.104092 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:12.104619 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:12.104163 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:12.116908 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:12.116879 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:12.306943 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:12.306912 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9" Jul 19 15:01:19.075253 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.075213 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x"] Jul 19 15:01:19.078959 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.078939 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.081707 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.081687 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 19 15:01:19.087183 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.087161 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x"] Jul 19 15:01:19.135843 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.135819 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.135967 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.135855 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8hfn\" (UniqueName: \"kubernetes.io/projected/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-kube-api-access-p8hfn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.135967 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.135898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.135967 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.135949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.136200 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.135988 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.136200 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.136005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.236925 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.236898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.237078 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.236933 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.237078 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.236967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.237078 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.236984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.237078 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.237033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.237078 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.237059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8hfn\" (UniqueName: \"kubernetes.io/projected/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-kube-api-access-p8hfn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.237415 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.237395 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.237479 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.237443 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.237535 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.237473 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.239140 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.239121 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.239391 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.239376 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.244500 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.244477 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8hfn\" (UniqueName: \"kubernetes.io/projected/15ecf58a-4bdd-4eaf-a837-b24bb10563cc-kube-api-access-p8hfn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5zx7x\" (UID: \"15ecf58a-4bdd-4eaf-a837-b24bb10563cc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.390327 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.390292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:19.529351 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:19.529314 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x"] Jul 19 15:01:19.532163 ip-10-0-139-202 kubenswrapper[2580]: W0719 15:01:19.532131 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ecf58a_4bdd_4eaf_a837_b24bb10563cc.slice/crio-4a88ed4c78cfaa906f700395f378bff3bc3ccabe69234a0e88aec015d6b30ab1 WatchSource:0}: Error finding container 4a88ed4c78cfaa906f700395f378bff3bc3ccabe69234a0e88aec015d6b30ab1: Status 404 returned error can't find the container with id 4a88ed4c78cfaa906f700395f378bff3bc3ccabe69234a0e88aec015d6b30ab1 Jul 19 15:01:20.336638 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:20.336608 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" event={"ID":"15ecf58a-4bdd-4eaf-a837-b24bb10563cc","Type":"ContainerStarted","Data":"879ab7d3eeb8b123acbfc5f67c2917e15233147b0cac6a2943966144f63a709b"} Jul 19 15:01:20.336995 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:20.336658 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" event={"ID":"15ecf58a-4bdd-4eaf-a837-b24bb10563cc","Type":"ContainerStarted","Data":"4a88ed4c78cfaa906f700395f378bff3bc3ccabe69234a0e88aec015d6b30ab1"} Jul 19 15:01:20.353755 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:20.353707 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" podStartSLOduration=1.191757761 podStartE2EDuration="1.353692577s" totalImagesPullingTime="161.934816ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:01:20.351998171 +0000 UTC m=+885.066110450" watchObservedRunningTime="2026-07-19 15:01:20.353692577 +0000 UTC m=+885.067804856" Jul 19 15:01:29.391188 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:29.391105 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:29.391188 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:29.391170 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:29.404316 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:29.404291 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:30.396533 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:30.396505 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5zx7x" Jul 19 15:01:35.791949 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:35.791918 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:01:35.793657 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:01:35.793637 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:02:25.877369 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:25.877327 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c"] Jul 19 15:02:25.887754 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:25.887728 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c"] Jul 19 15:02:25.887905 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:25.887837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:25.890072 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:25.890049 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 19 15:02:25.962794 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:25.962766 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:25.962916 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:25.962802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7tbv\" (UniqueName: \"kubernetes.io/projected/1f70642b-c90b-45f5-879f-3250043246be-kube-api-access-l7tbv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:25.962916 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:25.962831 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:25.962916 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:25.962902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:25.963047 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:25.962965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f70642b-c90b-45f5-879f-3250043246be-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:25.963047 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:25.962995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.063840 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.063815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.063961 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.063870 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f70642b-c90b-45f5-879f-3250043246be-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.063961 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.063910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.063961 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.063953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.064117 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.063984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7tbv\" (UniqueName: \"kubernetes.io/projected/1f70642b-c90b-45f5-879f-3250043246be-kube-api-access-l7tbv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.064117 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.064071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.064302 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.064281 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.064381 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.064307 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.064381 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.064349 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.066134 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.066118 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f70642b-c90b-45f5-879f-3250043246be-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.066317 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.066300 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f70642b-c90b-45f5-879f-3250043246be-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.070904 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.070887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7tbv\" (UniqueName: \"kubernetes.io/projected/1f70642b-c90b-45f5-879f-3250043246be-kube-api-access-l7tbv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kb95c\" (UID: \"1f70642b-c90b-45f5-879f-3250043246be\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.198364 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.198307 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:26.328180 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.328155 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c"] Jul 19 15:02:26.330041 ip-10-0-139-202 kubenswrapper[2580]: W0719 15:02:26.329989 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f70642b_c90b_45f5_879f_3250043246be.slice/crio-40f853fba0aa0682b8ca5394cb1d34473b027c5b6d47beeb07a49c6cc4890c89 WatchSource:0}: Error finding container 40f853fba0aa0682b8ca5394cb1d34473b027c5b6d47beeb07a49c6cc4890c89: Status 404 returned error can't find the container with id 40f853fba0aa0682b8ca5394cb1d34473b027c5b6d47beeb07a49c6cc4890c89 Jul 19 15:02:26.331322 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.331302 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 19 15:02:26.657165 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.657133 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" event={"ID":"1f70642b-c90b-45f5-879f-3250043246be","Type":"ContainerStarted","Data":"0393cae126bd44241089fb86d48c3cb4b4f84303091ed2645f329e4d81852da8"} Jul 19 15:02:26.657340 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.657187 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" event={"ID":"1f70642b-c90b-45f5-879f-3250043246be","Type":"ContainerStarted","Data":"40f853fba0aa0682b8ca5394cb1d34473b027c5b6d47beeb07a49c6cc4890c89"} Jul 19 15:02:26.672848 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:26.672807 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" podStartSLOduration=1.5141109419999998 podStartE2EDuration="1.672793177s" totalImagesPullingTime="158.682235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:02:26.672079907 +0000 UTC m=+951.386192185" watchObservedRunningTime="2026-07-19 15:02:26.672793177 +0000 UTC m=+951.386905503" Jul 19 15:02:36.198495 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:36.198453 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:36.198956 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:36.198508 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:36.210989 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:36.210965 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:02:36.717736 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:02:36.717710 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kb95c" Jul 19 15:06:35.823236 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:06:35.823205 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:06:35.830497 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:06:35.830475 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:06:35.834154 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:06:35.834125 2580 scope.go:117] "RemoveContainer" containerID="3ae9a1c4d9aab27d1f878d5ce26db01fdffd6fa30fbd1ffaab9d469660d08d65" Jul 19 15:10:26.039267 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:26.039227 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg"] Jul 19 15:10:26.041501 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:26.039447 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" podUID="b60209ca-7baf-426e-8a93-413bdf9f05af" containerName="manager" containerID="cri-o://aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16" gracePeriod=10 Jul 19 15:10:28.589689 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.589667 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 15:10:28.675160 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.675098 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b60209ca-7baf-426e-8a93-413bdf9f05af-extensions-socket-volume\") pod \"b60209ca-7baf-426e-8a93-413bdf9f05af\" (UID: \"b60209ca-7baf-426e-8a93-413bdf9f05af\") " Jul 19 15:10:28.675160 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.675137 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppkpv\" (UniqueName: \"kubernetes.io/projected/b60209ca-7baf-426e-8a93-413bdf9f05af-kube-api-access-ppkpv\") pod \"b60209ca-7baf-426e-8a93-413bdf9f05af\" (UID: \"b60209ca-7baf-426e-8a93-413bdf9f05af\") " Jul 19 15:10:28.675504 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.675481 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b60209ca-7baf-426e-8a93-413bdf9f05af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b60209ca-7baf-426e-8a93-413bdf9f05af" (UID: "b60209ca-7baf-426e-8a93-413bdf9f05af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 19 15:10:28.677149 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.677132 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b60209ca-7baf-426e-8a93-413bdf9f05af-kube-api-access-ppkpv" (OuterVolumeSpecName: "kube-api-access-ppkpv") pod "b60209ca-7baf-426e-8a93-413bdf9f05af" (UID: "b60209ca-7baf-426e-8a93-413bdf9f05af"). InnerVolumeSpecName "kube-api-access-ppkpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 19 15:10:28.776785 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.776756 2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b60209ca-7baf-426e-8a93-413bdf9f05af-extensions-socket-volume\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 15:10:28.776785 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.776783 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppkpv\" (UniqueName: \"kubernetes.io/projected/b60209ca-7baf-426e-8a93-413bdf9f05af-kube-api-access-ppkpv\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 15:10:28.983308 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.983249 2580 generic.go:356] "Generic (PLEG): container finished" podID="b60209ca-7baf-426e-8a93-413bdf9f05af" containerID="aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16" exitCode=0 Jul 19 15:10:28.983308 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.983301 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" Jul 19 15:10:28.983427 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.983333 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" event={"ID":"b60209ca-7baf-426e-8a93-413bdf9f05af","Type":"ContainerDied","Data":"aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16"} Jul 19 15:10:28.983427 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.983398 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg" event={"ID":"b60209ca-7baf-426e-8a93-413bdf9f05af","Type":"ContainerDied","Data":"54ff0578d20e6b1d1071e9068514eaa14ef3b690144e71ce6b1932f274927def"} Jul 19 15:10:28.983427 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.983419 2580 scope.go:117] "RemoveContainer" containerID="aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16" Jul 19 15:10:28.993795 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.993777 2580 scope.go:117] "RemoveContainer" containerID="aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16" Jul 19 15:10:28.994115 ip-10-0-139-202 kubenswrapper[2580]: E0719 15:10:28.994095 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16\": container with ID starting with aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16 not found: ID does not exist" containerID="aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16" Jul 19 15:10:28.994203 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:28.994122 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16"} err="failed to get container status \"aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16\": rpc error: code = NotFound desc = could not find container \"aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16\": container with ID starting with aa959274e1d18ccb590407ad785802cab2bbc5df44bbf7d0dfaefb01291fce16 not found: ID does not exist" Jul 19 15:10:29.004144 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:29.004116 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg"] Jul 19 15:10:29.007239 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:29.007218 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c8qhg"] Jul 19 15:10:29.787998 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:10:29.787965 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b60209ca-7baf-426e-8a93-413bdf9f05af" path="/var/lib/kubelet/pods/b60209ca-7baf-426e-8a93-413bdf9f05af/volumes" Jul 19 15:11:27.213321 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.213276 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f"] Jul 19 15:11:27.213861 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.213669 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b60209ca-7baf-426e-8a93-413bdf9f05af" containerName="manager" Jul 19 15:11:27.213861 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.213682 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b60209ca-7baf-426e-8a93-413bdf9f05af" containerName="manager" Jul 19 15:11:27.213861 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.213756 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b60209ca-7baf-426e-8a93-413bdf9f05af" containerName="manager" Jul 19 15:11:27.216854 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.216834 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" Jul 19 15:11:27.219560 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.219532 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 19 15:11:27.219696 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.219629 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hjf4n\"" Jul 19 15:11:27.219696 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.219654 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 19 15:11:27.229282 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.229256 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f"] Jul 19 15:11:27.246210 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.246184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpcs7\" (UniqueName: \"kubernetes.io/projected/00f7d2cd-335d-4d07-a3d7-a27d85b616a3-kube-api-access-jpcs7\") pod \"kuadrant-operator-controller-manager-86878c769f-rgk2f\" (UID: \"00f7d2cd-335d-4d07-a3d7-a27d85b616a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" Jul 19 15:11:27.246325 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.246251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00f7d2cd-335d-4d07-a3d7-a27d85b616a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rgk2f\" (UID: \"00f7d2cd-335d-4d07-a3d7-a27d85b616a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" Jul 19 15:11:27.347163 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.347139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00f7d2cd-335d-4d07-a3d7-a27d85b616a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rgk2f\" (UID: \"00f7d2cd-335d-4d07-a3d7-a27d85b616a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" Jul 19 15:11:27.347259 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.347209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcs7\" (UniqueName: \"kubernetes.io/projected/00f7d2cd-335d-4d07-a3d7-a27d85b616a3-kube-api-access-jpcs7\") pod \"kuadrant-operator-controller-manager-86878c769f-rgk2f\" (UID: \"00f7d2cd-335d-4d07-a3d7-a27d85b616a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" Jul 19 15:11:27.347500 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.347483 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00f7d2cd-335d-4d07-a3d7-a27d85b616a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rgk2f\" (UID: \"00f7d2cd-335d-4d07-a3d7-a27d85b616a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" Jul 19 15:11:27.355057 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.355034 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcs7\" (UniqueName: \"kubernetes.io/projected/00f7d2cd-335d-4d07-a3d7-a27d85b616a3-kube-api-access-jpcs7\") pod \"kuadrant-operator-controller-manager-86878c769f-rgk2f\" (UID: \"00f7d2cd-335d-4d07-a3d7-a27d85b616a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" Jul 19 15:11:27.528111 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.528054 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" Jul 19 15:11:27.662261 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:27.662237 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f"] Jul 19 15:11:27.664458 ip-10-0-139-202 kubenswrapper[2580]: W0719 15:11:27.664431 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f7d2cd_335d_4d07_a3d7_a27d85b616a3.slice/crio-b345a88ddc163431131130d4c70698062b68fbfde0a123914b1021d097a79556 WatchSource:0}: Error finding container b345a88ddc163431131130d4c70698062b68fbfde0a123914b1021d097a79556: Status 404 returned error can't find the container with id b345a88ddc163431131130d4c70698062b68fbfde0a123914b1021d097a79556 Jul 19 15:11:28.277594 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:28.277563 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" event={"ID":"00f7d2cd-335d-4d07-a3d7-a27d85b616a3","Type":"ContainerStarted","Data":"d981f09aa2b6d3fbaf6bd34bf4587fd5fd6bb4bf04bcf185f743de4bdea8a9e5"} Jul 19 15:11:28.277953 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:28.277614 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" event={"ID":"00f7d2cd-335d-4d07-a3d7-a27d85b616a3","Type":"ContainerStarted","Data":"b345a88ddc163431131130d4c70698062b68fbfde0a123914b1021d097a79556"} Jul 19 15:11:28.277953 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:28.277677 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" Jul 19 15:11:28.302075 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:28.301992 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" podStartSLOduration=1.301979139 podStartE2EDuration="1.301979139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:11:28.299656295 +0000 UTC m=+1493.013768574" watchObservedRunningTime="2026-07-19 15:11:28.301979139 +0000 UTC m=+1493.016091417" Jul 19 15:11:35.855586 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:35.855557 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:11:35.862870 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:35.862848 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:11:39.285112 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:11:39.285081 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rgk2f" Jul 19 15:16:35.885814 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:16:35.885774 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:16:35.894046 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:16:35.894003 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:21:35.914846 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:21:35.914772 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:21:35.932477 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:21:35.932454 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:26:35.944465 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:26:35.944432 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:26:35.963229 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:26:35.963208 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:28:53.492773 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.492737 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7"] Jul 19 15:28:53.496162 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.496144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" Jul 19 15:28:53.498409 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.498384 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 19 15:28:53.498536 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.498437 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m8x6s\"" Jul 19 15:28:53.502694 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.502672 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7"] Jul 19 15:28:53.585702 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.585672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec9b015-cb4c-46c8-80f1-421b85a03155-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7\" (UID: \"6ec9b015-cb4c-46c8-80f1-421b85a03155\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" Jul 19 15:28:53.686617 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.686576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec9b015-cb4c-46c8-80f1-421b85a03155-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7\" (UID: \"6ec9b015-cb4c-46c8-80f1-421b85a03155\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" Jul 19 15:28:53.687232 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.687211 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec9b015-cb4c-46c8-80f1-421b85a03155-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7\" (UID: \"6ec9b015-cb4c-46c8-80f1-421b85a03155\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" Jul 19 15:28:53.809792 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.809707 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" Jul 19 15:28:53.944949 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.944916 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7"] Jul 19 15:28:53.945923 ip-10-0-139-202 kubenswrapper[2580]: W0719 15:28:53.945894 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec9b015_cb4c_46c8_80f1_421b85a03155.slice/crio-874082f7035c643d294cf3e00f328697d384acc9c03a998772c716ae3ae4c5fc WatchSource:0}: Error finding container 874082f7035c643d294cf3e00f328697d384acc9c03a998772c716ae3ae4c5fc: Status 404 returned error can't find the container with id 874082f7035c643d294cf3e00f328697d384acc9c03a998772c716ae3ae4c5fc Jul 19 15:28:53.948223 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:53.948205 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 19 15:28:54.282866 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:54.282830 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" event={"ID":"6ec9b015-cb4c-46c8-80f1-421b85a03155","Type":"ContainerStarted","Data":"874082f7035c643d294cf3e00f328697d384acc9c03a998772c716ae3ae4c5fc"} Jul 19 15:28:56.294689 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:56.294655 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" event={"ID":"6ec9b015-cb4c-46c8-80f1-421b85a03155","Type":"ContainerStarted","Data":"658ed3af9328ab797599967c88b055f5012c94789bbe443ab8a5c30c64d7990b"} Jul 19 15:28:56.309814 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:56.309766 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" podStartSLOduration=1.384774702 podStartE2EDuration="3.30975151s" totalImagesPullingTime="1.924976808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 15:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:28:56.307625932 +0000 UTC m=+2541.021738214" watchObservedRunningTime="2026-07-19 15:28:56.30975151 +0000 UTC m=+2541.023863789" Jul 19 15:28:57.301981 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:57.301942 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ec9b015-cb4c-46c8-80f1-421b85a03155" containerID="658ed3af9328ab797599967c88b055f5012c94789bbe443ab8a5c30c64d7990b" exitCode=0 Jul 19 15:28:57.302383 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:57.302046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" event={"ID":"6ec9b015-cb4c-46c8-80f1-421b85a03155","Type":"ContainerDied","Data":"658ed3af9328ab797599967c88b055f5012c94789bbe443ab8a5c30c64d7990b"} Jul 19 15:28:58.434928 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:58.434902 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" Jul 19 15:28:58.530783 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:58.530747 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec9b015-cb4c-46c8-80f1-421b85a03155-maas-api-service-ca\") pod \"6ec9b015-cb4c-46c8-80f1-421b85a03155\" (UID: \"6ec9b015-cb4c-46c8-80f1-421b85a03155\") " Jul 19 15:28:58.531104 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:58.531083 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ec9b015-cb4c-46c8-80f1-421b85a03155-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6ec9b015-cb4c-46c8-80f1-421b85a03155" (UID: "6ec9b015-cb4c-46c8-80f1-421b85a03155"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 19 15:28:58.631973 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:58.631943 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec9b015-cb4c-46c8-80f1-421b85a03155-maas-api-service-ca\") on node \"ip-10-0-139-202.ec2.internal\" DevicePath \"\"" Jul 19 15:28:59.313548 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:59.313512 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" Jul 19 15:28:59.313548 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:59.313540 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7" event={"ID":"6ec9b015-cb4c-46c8-80f1-421b85a03155","Type":"ContainerDied","Data":"874082f7035c643d294cf3e00f328697d384acc9c03a998772c716ae3ae4c5fc"} Jul 19 15:28:59.313804 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:28:59.313590 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="874082f7035c643d294cf3e00f328697d384acc9c03a998772c716ae3ae4c5fc" Jul 19 15:29:08.577539 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:29:08.577502 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7"] Jul 19 15:29:08.579216 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:29:08.579185 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9d5834-jpmf7"] Jul 19 15:29:09.788525 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:29:09.788487 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec9b015-cb4c-46c8-80f1-421b85a03155" path="/var/lib/kubelet/pods/6ec9b015-cb4c-46c8-80f1-421b85a03155/volumes" Jul 19 15:31:35.973144 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:31:35.973120 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:31:35.993408 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:31:35.993385 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:35:36.047913 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:35:36.047881 2580 scope.go:117] "RemoveContainer" containerID="658ed3af9328ab797599967c88b055f5012c94789bbe443ab8a5c30c64d7990b" Jul 19 15:36:36.004331 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:36:36.004300 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:36:36.023726 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:36:36.023705 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:38:01.227118 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:01.227091 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c7885d785-krlbn_10fa1d2a-65af-404b-ac04-faa19f84feb6/copy-manifests/0.log" Jul 19 15:38:01.233781 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:01.233754 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c7885d785-krlbn_10fa1d2a-65af-404b-ac04-faa19f84feb6/manager/0.log" Jul 19 15:38:03.870268 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:03.870239 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rgk2f_00f7d2cd-335d-4d07-a3d7-a27d85b616a3/manager/0.log" Jul 19 15:38:04.620166 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:04.620140 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nltlz_f1b721f6-e794-4229-8de4-662e412cf65c/discovery/0.log" Jul 19 15:38:05.275204 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:05.275173 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-94ddk_79941e82-4b6f-4ce1-b89f-eaaae1199501/payload-processing/0.log" Jul 19 15:38:05.753109 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:05.753079 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9c4x9_653625d0-9941-4fe4-ba6d-a897d9f1ad33/main/0.log" Jul 19 15:38:05.983900 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:05.983872 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5zx7x_15ecf58a-4bdd-4eaf-a837-b24bb10563cc/main/0.log" Jul 19 15:38:06.216443 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:06.216412 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-kb95c_1f70642b-c90b-45f5-879f-3250043246be/main/0.log" Jul 19 15:38:15.308054 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:15.308001 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rx596_be3f0910-7935-4f9d-bc8b-ac92026ecff8/global-pull-secret-syncer/0.log" Jul 19 15:38:15.432161 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:15.432133 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hwqs4_f1b180a8-170f-4693-b6ba-291db25b3a46/konnectivity-agent/0.log" Jul 19 15:38:15.485548 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:15.485524 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-202.ec2.internal_a2f86c374327211bfdc0d050c53cf8a9/haproxy/0.log" Jul 19 15:38:21.438512 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:21.438479 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rgk2f_00f7d2cd-335d-4d07-a3d7-a27d85b616a3/manager/0.log" Jul 19 15:38:23.255468 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.255435 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_360af916-00aa-421b-8066-1dbf5ba2039d/alertmanager/0.log" Jul 19 15:38:23.278813 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.278791 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_360af916-00aa-421b-8066-1dbf5ba2039d/config-reloader/0.log" Jul 19 15:38:23.302620 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.302598 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_360af916-00aa-421b-8066-1dbf5ba2039d/kube-rbac-proxy-web/0.log" Jul 19 15:38:23.332078 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.332029 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_360af916-00aa-421b-8066-1dbf5ba2039d/kube-rbac-proxy/0.log" Jul 19 15:38:23.359415 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.359393 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_360af916-00aa-421b-8066-1dbf5ba2039d/kube-rbac-proxy-metric/0.log" Jul 19 15:38:23.388045 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.388024 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_360af916-00aa-421b-8066-1dbf5ba2039d/prom-label-proxy/0.log" Jul 19 15:38:23.420404 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.420389 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_360af916-00aa-421b-8066-1dbf5ba2039d/init-config-reloader/0.log" Jul 19 15:38:23.641466 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.641440 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6r8c_2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82/node-exporter/0.log" Jul 19 15:38:23.664024 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.663992 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6r8c_2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82/kube-rbac-proxy/0.log" Jul 19 15:38:23.689799 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.689776 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6r8c_2c4c9769-2e7b-49f6-9eb5-e54fb0bf9c82/init-textfile/0.log" Jul 19 15:38:23.964592 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.964525 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41076f05-ce9c-4824-a256-c04c8f6bdfbd/prometheus/0.log" Jul 19 15:38:23.990124 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:23.990102 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41076f05-ce9c-4824-a256-c04c8f6bdfbd/config-reloader/0.log" Jul 19 15:38:24.014486 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:24.014319 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41076f05-ce9c-4824-a256-c04c8f6bdfbd/thanos-sidecar/0.log" Jul 19 15:38:24.038556 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:24.038537 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41076f05-ce9c-4824-a256-c04c8f6bdfbd/kube-rbac-proxy-web/0.log" Jul 19 15:38:24.063132 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:24.063104 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41076f05-ce9c-4824-a256-c04c8f6bdfbd/kube-rbac-proxy/0.log" Jul 19 15:38:24.088832 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:24.088814 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41076f05-ce9c-4824-a256-c04c8f6bdfbd/kube-rbac-proxy-thanos/0.log" Jul 19 15:38:24.111039 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:24.111021 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41076f05-ce9c-4824-a256-c04c8f6bdfbd/init-config-reloader/0.log" Jul 19 15:38:24.153000 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:24.152976 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-6mbwp_65ff5cf1-5ce1-4218-ae0b-00b48848c9c3/prometheus-operator/0.log" Jul 19 15:38:24.174400 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:24.174380 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-6mbwp_65ff5cf1-5ce1-4218-ae0b-00b48848c9c3/kube-rbac-proxy/0.log" Jul 19 15:38:24.204479 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:24.204457 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-zj8b4_e7caeaae-ba2d-46c0-90db-28bcf39e8009/prometheus-operator-admission-webhook/0.log" Jul 19 15:38:25.560731 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.560700 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-cqql5_f7aa48da-331e-47c7-b787-e034c4a24046/networking-console-plugin/0.log" Jul 19 15:38:25.832232 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.832148 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff"] Jul 19 15:38:25.832545 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.832531 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec9b015-cb4c-46c8-80f1-421b85a03155" containerName="revoke-keys" Jul 19 15:38:25.832588 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.832546 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec9b015-cb4c-46c8-80f1-421b85a03155" containerName="revoke-keys" Jul 19 15:38:25.832636 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.832626 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec9b015-cb4c-46c8-80f1-421b85a03155" containerName="revoke-keys" Jul 19 15:38:25.836146 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.836124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:25.838428 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.838406 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bxflm\"/\"kube-root-ca.crt\"" Jul 19 15:38:25.839247 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.839226 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bxflm\"/\"default-dockercfg-7krnv\"" Jul 19 15:38:25.839347 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.839254 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bxflm\"/\"openshift-service-ca.crt\"" Jul 19 15:38:25.844467 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.844108 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff"] Jul 19 15:38:25.949433 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.949408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-sys\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:25.949537 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.949444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-podres\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:25.949537 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.949478 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-lib-modules\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:25.949537 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.949511 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqcx4\" (UniqueName: \"kubernetes.io/projected/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-kube-api-access-sqcx4\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:25.949670 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:25.949550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-proc\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.050788 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.050763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-lib-modules\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.050921 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.050796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqcx4\" (UniqueName: \"kubernetes.io/projected/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-kube-api-access-sqcx4\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.050921 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.050828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-proc\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.050921 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.050906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-sys\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.051125 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.050932 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-lib-modules\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.051125 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.050941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-podres\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.051125 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.050959 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-proc\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.051125 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.051031 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-sys\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.051125 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.051094 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-podres\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.058948 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.058923 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqcx4\" (UniqueName: \"kubernetes.io/projected/02c6a0e7-9d80-4032-a8bc-1525ad877cdc-kube-api-access-sqcx4\") pod \"perf-node-gather-daemonset-mdrff\" (UID: \"02c6a0e7-9d80-4032-a8bc-1525ad877cdc\") " pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.148770 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.148752 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:26.241654 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.241626 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/1.log" Jul 19 15:38:26.248377 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.248352 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-q67m4_f36fa4ec-c3c3-425c-9289-badff93367a2/console-operator/2.log" Jul 19 15:38:26.285384 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.285360 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff"] Jul 19 15:38:26.287357 ip-10-0-139-202 kubenswrapper[2580]: W0719 15:38:26.287334 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod02c6a0e7_9d80_4032_a8bc_1525ad877cdc.slice/crio-b4fef2a6fc07eb13247f12e588a9d054ac793fe5402e131e2686cd33852fdc54 WatchSource:0}: Error finding container b4fef2a6fc07eb13247f12e588a9d054ac793fe5402e131e2686cd33852fdc54: Status 404 returned error can't find the container with id b4fef2a6fc07eb13247f12e588a9d054ac793fe5402e131e2686cd33852fdc54 Jul 19 15:38:26.814298 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.814219 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85f9f64c47-6vp6g_346b2231-58b1-4ab4-ad98-4af5a4bb2c3e/console/0.log" Jul 19 15:38:26.847348 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:26.847327 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-xb5k7_d0e09800-a4bc-4d51-aa75-2a3533d709a3/download-server/0.log" Jul 19 15:38:27.061874 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:27.061846 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" event={"ID":"02c6a0e7-9d80-4032-a8bc-1525ad877cdc","Type":"ContainerStarted","Data":"341c45750a448dacf3d574d77a98c82999d76ad886ae5b6ecf0c8bbff4fb592e"} Jul 19 15:38:27.062003 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:27.061894 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" event={"ID":"02c6a0e7-9d80-4032-a8bc-1525ad877cdc","Type":"ContainerStarted","Data":"b4fef2a6fc07eb13247f12e588a9d054ac793fe5402e131e2686cd33852fdc54"} Jul 19 15:38:27.062003 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:27.061930 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:27.078747 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:27.078660 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" podStartSLOduration=2.078644396 podStartE2EDuration="2.078644396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 15:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 15:38:27.078227407 +0000 UTC m=+3111.792339690" watchObservedRunningTime="2026-07-19 15:38:27.078644396 +0000 UTC m=+3111.792756676" Jul 19 15:38:27.422310 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:27.422283 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-588hr_dd9f7187-473c-4e1b-a90c-c7cebba24d45/volume-data-source-validator/0.log" Jul 19 15:38:28.577310 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:28.577284 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z5g48_c185d060-0ddf-4918-9330-8677891cdc3b/dns/0.log" Jul 19 15:38:28.599575 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:28.599553 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z5g48_c185d060-0ddf-4918-9330-8677891cdc3b/kube-rbac-proxy/0.log" Jul 19 15:38:28.649245 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:28.649222 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fmxxg_2d1fcdaa-1e73-4c4f-bea2-a7c02d7e376b/dns-node-resolver/0.log" Jul 19 15:38:29.360673 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:29.360644 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rhrjr_73a5d9ce-871b-4fc8-8642-3f931640aa86/node-ca/0.log" Jul 19 15:38:30.461185 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:30.461154 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nltlz_f1b721f6-e794-4229-8de4-662e412cf65c/discovery/0.log" Jul 19 15:38:30.658305 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:30.658278 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-94ddk_79941e82-4b6f-4ce1-b89f-eaaae1199501/payload-processing/0.log" Jul 19 15:38:31.407774 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:31.407745 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6r4tz_9654b2f6-3e26-4fdd-8ce3-a509a8753b8a/serve-healthcheck-canary/0.log" Jul 19 15:38:31.914637 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:31.914606 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-7vbh4_e8e5f751-5f2d-4255-9d36-725c766e8c25/insights-operator/0.log" Jul 19 15:38:31.915121 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:31.915104 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-7vbh4_e8e5f751-5f2d-4255-9d36-725c766e8c25/insights-operator/1.log" Jul 19 15:38:32.005401 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:32.005379 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d2fpq_6f9410b2-9e8d-4725-bc3c-7200501992f8/kube-rbac-proxy/0.log" Jul 19 15:38:32.027402 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:32.027383 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d2fpq_6f9410b2-9e8d-4725-bc3c-7200501992f8/exporter/0.log" Jul 19 15:38:32.049437 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:32.049418 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d2fpq_6f9410b2-9e8d-4725-bc3c-7200501992f8/extractor/0.log" Jul 19 15:38:33.075427 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:33.075402 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bxflm/perf-node-gather-daemonset-mdrff" Jul 19 15:38:35.233156 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:35.233091 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c7885d785-krlbn_10fa1d2a-65af-404b-ac04-faa19f84feb6/manager/0.log" Jul 19 15:38:35.256194 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:35.256168 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c7885d785-krlbn_10fa1d2a-65af-404b-ac04-faa19f84feb6/copy-manifests/0.log" Jul 19 15:38:36.572964 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:36.572934 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cc4ccf5bd-498sl_2aa71943-db6f-4d5c-b022-3ab25620a76e/manager/0.log" Jul 19 15:38:36.578534 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:36.578506 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nltlz_f1b721f6-e794-4229-8de4-662e412cf65c/discovery/0.log" Jul 19 15:38:36.718357 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:36.718328 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-94ddk_79941e82-4b6f-4ce1-b89f-eaaae1199501/payload-processing/0.log" Jul 19 15:38:38.129414 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:38.129382 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nltlz_f1b721f6-e794-4229-8de4-662e412cf65c/discovery/0.log" Jul 19 15:38:38.294527 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:38.294497 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-94ddk_79941e82-4b6f-4ce1-b89f-eaaae1199501/payload-processing/0.log" Jul 19 15:38:41.705064 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:41.705035 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-frlb6_30e77c07-9afa-4f7f-b163-ffaa6d232954/migrator/0.log" Jul 19 15:38:41.744548 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:41.744522 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-frlb6_30e77c07-9afa-4f7f-b163-ffaa6d232954/graceful-termination/0.log" Jul 19 15:38:42.157340 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:42.157311 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-npbsb_aff56ccc-99a3-41c9-8cfb-0533ffcb0274/kube-storage-version-migrator-operator/1.log" Jul 19 15:38:42.158340 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:42.158323 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-npbsb_aff56ccc-99a3-41c9-8cfb-0533ffcb0274/kube-storage-version-migrator-operator/0.log" Jul 19 15:38:43.338928 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:43.338902 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fmvzq_2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c/kube-multus-additional-cni-plugins/0.log" Jul 19 15:38:43.363129 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:43.363108 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fmvzq_2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c/egress-router-binary-copy/0.log" Jul 19 15:38:43.384374 ip-10-0-139-202 kubenswrapper[2580]: I0719 15:38:43.384357 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fmvzq_2f5e74bc-ae0d-46ed-8b93-821aaf1aba8c/cni-plugins/0.log"