Jul 01 20:17:13.677355 ip-10-0-140-83 systemd[1]: Starting Kubernetes Kubelet... Jul 01 20:17:14.073139 ip-10-0-140-83 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:17:14.073139 ip-10-0-140-83 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 20:17:14.073139 ip-10-0-140-83 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:17:14.073139 ip-10-0-140-83 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 20:17:14.073139 ip-10-0-140-83 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:17:14.075010 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.074944 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 20:17:14.081526 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081512 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:14.081526 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081527 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081530 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081533 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081536 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081540 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081543 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081546 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081549 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081552 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081554 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081557 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081559 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081562 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081564 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081567 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081569 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081572 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081574 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081578 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:14.081588 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081581 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081584 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081586 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081589 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081592 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081595 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081597 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081600 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081603 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081606 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081608 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081611 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081613 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081615 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081618 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081621 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081623 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081626 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081629 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081631 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:14.082047 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081634 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081636 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081638 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081641 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081643 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081646 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081648 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081650 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081653 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081655 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081657 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081660 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081662 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081665 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081668 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081671 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081673 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081677 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081679 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081682 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:14.082548 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081685 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081687 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081689 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081692 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081694 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081697 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081700 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081702 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081705 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081707 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081710 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081713 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081716 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081718 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081721 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081727 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081732 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081736 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081740 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:14.083023 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081745 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081752 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081756 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081759 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081761 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081763 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081767 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081771 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081774 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081776 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081779 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081782 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081785 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081788 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081790 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081792 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081795 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081797 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081800 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.081803 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:14.083493 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082564 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082571 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082574 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082576 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082580 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082584 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082587 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082589 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082592 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082595 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082597 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082601 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082604 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082607 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082610 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082613 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082616 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082618 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082621 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:14.084031 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082623 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082627 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082631 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082647 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082652 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082656 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082658 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082661 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082663 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082666 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082669 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082671 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082674 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082676 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082679 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082681 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082684 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082686 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082688 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082692 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:14.084616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082694 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082697 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082699 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082701 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082704 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082706 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082709 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082713 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082716 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082720 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082724 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082728 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082732 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082737 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082740 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082742 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082745 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082748 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082750 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082752 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:14.085409 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082755 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082757 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082760 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082762 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082765 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082767 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082770 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082772 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082774 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082777 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082780 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082782 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082787 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082791 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082794 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082799 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082804 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082808 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082813 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:14.085921 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082817 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082820 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082823 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082826 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082828 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082831 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082833 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082837 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082840 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082843 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082846 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082849 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082851 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082855 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082857 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082860 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082863 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082865 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082867 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:14.086403 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082870 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.082872 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083272 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083278 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083282 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083287 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083292 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083298 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083302 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083305 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083308 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083311 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083314 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083317 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083319 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083322 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083324 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083327 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083329 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083332 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:14.086859 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083334 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083337 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083339 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083342 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083344 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083347 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083349 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083352 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083354 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083356 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083359 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083362 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083366 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083369 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083373 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083377 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083381 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083384 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083387 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083390 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:14.087339 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083392 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083395 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083397 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083399 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083402 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083404 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083407 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083410 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083412 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083415 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083417 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083420 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083422 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083424 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083427 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083429 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083432 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083437 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083440 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083444 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:14.087808 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083448 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083452 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083456 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083460 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083463 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083466 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083469 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083472 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083474 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083478 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083480 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083483 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083487 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083489 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083492 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083494 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083497 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083500 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083503 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:14.088293 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083506 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083508 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083511 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083513 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083516 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083518 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083522 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083527 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083532 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083537 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083541 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083545 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083548 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083550 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083553 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083556 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083558 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083561 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083564 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:14.088779 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083567 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083571 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.083574 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083650 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083657 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083667 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083672 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083676 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083679 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083683 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083688 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083695 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083700 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083705 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083709 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083712 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083715 2578 flags.go:64] FLAG: --cgroup-root="" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083718 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083721 2578 flags.go:64] FLAG: --client-ca-file="" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083724 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083726 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083730 2578 flags.go:64] FLAG: --cluster-domain="" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083732 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083736 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 20:17:14.089230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083738 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083742 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083745 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083748 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083751 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083754 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083757 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083760 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083762 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083765 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083771 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083780 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083785 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083790 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083792 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083795 2578 flags.go:64] FLAG: --enable-server="true" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083799 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083803 2578 flags.go:64] FLAG: --event-burst="100" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083806 2578 flags.go:64] FLAG: --event-qps="50" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083812 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083815 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083817 2578 flags.go:64] FLAG: --eviction-hard="" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083822 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083824 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083828 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 20:17:14.089889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083830 2578 flags.go:64] FLAG: --eviction-soft="" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083833 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083836 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083839 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083841 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083844 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083847 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083850 2578 flags.go:64] FLAG: --feature-gates="" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083856 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083861 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083866 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083870 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083873 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083877 2578 flags.go:64] FLAG: --help="false" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083880 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083883 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083886 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083890 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083893 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083897 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083899 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083902 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083905 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 20:17:14.090484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083907 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083911 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083914 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083918 2578 flags.go:64] FLAG: --kube-reserved="" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083920 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083923 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083926 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083929 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083932 2578 flags.go:64] FLAG: --lock-file="" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083937 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083941 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083946 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083953 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083956 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083959 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083961 2578 flags.go:64] FLAG: --logging-format="text" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083964 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083967 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083970 2578 flags.go:64] FLAG: --manifest-url="" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083972 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083976 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083979 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083983 2578 flags.go:64] FLAG: --max-pods="110" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083986 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083989 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 20:17:14.091114 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083992 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083996 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.083999 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084002 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084005 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084012 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084017 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084021 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084026 2578 flags.go:64] FLAG: --pod-cidr="" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084031 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084036 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084040 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084043 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084046 2578 flags.go:64] FLAG: --port="10250" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084049 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084052 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fed3af816fdd741e" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084067 2578 flags.go:64] FLAG: --qos-reserved="" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084070 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084073 2578 flags.go:64] FLAG: --register-node="true" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084076 2578 flags.go:64] FLAG: --register-with-taints="" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084080 2578 flags.go:64] FLAG: --registry-burst="10" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084082 2578 flags.go:64] FLAG: --registry-qps="5" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084085 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084088 2578 flags.go:64] FLAG: --reserved-memory="" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084092 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 20:17:14.091731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084096 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084100 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084104 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084109 2578 flags.go:64] FLAG: --runonce="false" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084113 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084117 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084119 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084122 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084126 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084129 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084132 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084135 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084138 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084141 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084144 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084146 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084149 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084153 2578 flags.go:64] FLAG: --system-cgroups="" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084157 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084162 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084165 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084168 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084171 2578 flags.go:64] FLAG: --tls-min-version="" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084174 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084178 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 20:17:14.092374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084182 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084186 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084191 2578 flags.go:64] FLAG: --v="2" Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084196 2578 flags.go:64] FLAG: --version="false" Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084200 2578 flags.go:64] FLAG: --vmodule="" Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084204 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.084207 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084582 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084595 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084601 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084605 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084610 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084614 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084619 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084624 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084632 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084642 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084647 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084651 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084656 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084661 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:14.092965 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084665 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084670 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084674 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084679 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084686 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084690 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084695 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084699 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084708 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084712 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084717 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084721 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084726 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084730 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084734 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084740 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084744 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084748 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084752 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084756 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:14.093479 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084765 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084770 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084774 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084778 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084782 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084786 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084792 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084796 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084800 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084805 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084809 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084813 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084818 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084827 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084831 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084835 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084841 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084846 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084851 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084855 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:14.093971 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084859 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084864 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084870 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084875 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084880 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084888 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084892 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084896 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084901 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084905 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084910 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084924 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084929 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084932 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084937 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084941 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084946 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084955 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084961 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:14.094467 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084965 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084969 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084973 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084977 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084984 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084990 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.084995 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085000 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085005 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085010 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085015 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085028 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085033 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085038 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085042 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085049 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085070 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085077 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085082 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:14.094930 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085087 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085091 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085096 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085100 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085109 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085113 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.085118 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.085657 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.092252 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.092267 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.092286 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.092292 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092344 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092348 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092351 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:14.095444 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092355 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092358 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092361 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092364 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092367 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092369 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092372 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092374 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092379 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092383 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092386 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092390 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092393 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092396 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092399 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092402 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092405 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092407 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092410 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092412 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:14.095821 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092415 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092418 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092420 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092423 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092426 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092429 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092433 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092436 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092438 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092441 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092443 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092446 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092449 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092452 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092455 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092458 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092460 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092463 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092465 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092468 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:14.096319 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092471 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092473 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092476 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092479 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092482 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092484 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092487 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092489 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092492 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092494 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092497 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092499 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092502 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092504 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092507 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092509 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092512 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092515 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092518 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092521 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:14.096819 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092524 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092527 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092529 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092532 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092535 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092539 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092543 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092546 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092549 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092551 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092553 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092556 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092559 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092561 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092564 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092566 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092569 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092571 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092575 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:14.097310 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092577 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092580 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092582 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092585 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092588 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092590 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092594 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092598 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092600 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092603 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092606 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092609 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092612 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092615 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092617 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092620 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:14.097771 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092622 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.092627 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092734 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092738 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092741 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092744 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092747 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092749 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092752 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092755 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092758 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092760 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092763 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092765 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092768 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:17:14.098156 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092771 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092773 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092776 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092778 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092781 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092784 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092786 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092789 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092791 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092793 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092796 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092798 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092802 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092804 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092807 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092810 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092813 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092815 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092818 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092821 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:17:14.098513 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092825 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092827 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092830 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092832 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092835 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092838 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092840 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092842 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092845 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092848 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092850 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092852 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092856 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092858 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092861 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092863 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092866 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092869 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092873 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:17:14.099000 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092876 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092878 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092881 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092884 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092887 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092891 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092893 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092896 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092899 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092901 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092904 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092906 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092909 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092912 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092914 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092916 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092919 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092921 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092924 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092926 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:17:14.099552 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092928 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092931 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092933 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092936 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092938 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092941 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092944 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092946 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092949 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092951 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092954 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092956 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092959 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092961 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092964 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092966 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092969 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092972 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092975 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092978 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:17:14.100011 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092981 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092983 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092987 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092990 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092993 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092996 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:14.092998 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.093003 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.093115 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.095119 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.096643 2578 server.go:1019] "Starting client certificate rotation" Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.096734 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.096770 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 20:17:14.100504 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.099287 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 20:17:14.104643 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.104627 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 20:17:14.116737 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.116717 2578 log.go:25] "Validated CRI v1 runtime API" Jul 01 20:17:14.119269 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.119249 2578 log.go:25] "Validated CRI v1 image API" Jul 01 20:17:14.120444 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.120429 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 20:17:14.122749 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.122732 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bd9498f5-3cbb-4d37-9523-2cf021e8fb04:/dev/nvme0n1p3 fa90c6dd-779d-4c2d-ab8b-58ccec94490d:/dev/nvme0n1p4] Jul 01 20:17:14.122812 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.122749 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 20:17:14.127474 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.127452 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 20:17:14.129799 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.129696 2578 manager.go:216] Machine: {Timestamp:2026-07-01 20:17:14.128199056 +0000 UTC m=+0.336508290 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106038 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20da826357504ff410df987938d3ae SystemUUID:ec20da82-6357-504f-f410-df987938d3ae BootID:cb5f551e-4d82-4d5c-98df-a1848fe7560d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:9f:f1:63:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:9f:f1:63:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:34:f6:36:ae:ec Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 20:17:14.129799 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.129791 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 20:17:14.129928 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.129866 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 20:17:14.132493 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.132472 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 20:17:14.132627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.132497 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-83.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 20:17:14.133756 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.133746 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 20:17:14.133789 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.133759 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 20:17:14.133789 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.133767 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 20:17:14.134344 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.134334 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 20:17:14.135153 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.135143 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 20:17:14.138246 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.138235 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 01 20:17:14.138353 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.138344 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 20:17:14.138386 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.138372 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 01 20:17:14.138386 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.138381 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 20:17:14.138442 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.138398 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 20:17:14.138442 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.138410 2578 kubelet.go:398] "Adding apiserver pod source" Jul 01 20:17:14.138442 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.138419 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 20:17:14.138769 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.138754 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 20:17:14.138809 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.138773 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 20:17:14.140832 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.140815 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 20:17:14.142211 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.142197 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 20:17:14.142270 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.142235 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 20:17:14.142853 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.142843 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 20:17:14.142885 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.142860 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 20:17:14.142885 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.142868 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 20:17:14.142885 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.142875 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 20:17:14.142996 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.142888 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 20:17:14.142996 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.142896 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 20:17:14.143075 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.143039 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 20:17:14.143075 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.143047 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 20:17:14.143075 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.143052 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 20:17:14.143150 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.143080 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 20:17:14.143150 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.143096 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 20:17:14.143150 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.143105 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 20:17:14.143616 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.143607 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 20:17:14.143616 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.143615 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 20:17:14.146560 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.146539 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-83.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 20:17:14.146643 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.146586 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 20:17:14.146643 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.146586 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 20:17:14.146707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.146676 2578 server.go:1268] "Started kubelet" Jul 01 20:17:14.146821 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.146796 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 20:17:14.146942 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.146879 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 20:17:14.147005 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.146989 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 20:17:14.147578 ip-10-0-140-83 systemd[1]: Started Kubernetes Kubelet. Jul 01 20:17:14.148272 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.148209 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 20:17:14.149090 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.149078 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 01 20:17:14.152178 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.152125 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-db2xq" Jul 01 20:17:14.152534 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.152518 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 20:17:14.153745 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.152785 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-83.ec2.internal.18be43c941333352 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-83.ec2.internal,UID:ip-10-0-140-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-83.ec2.internal,},FirstTimestamp:2026-07-01 20:17:14.146657106 +0000 UTC m=+0.354966341,LastTimestamp:2026-07-01 20:17:14.146657106 +0000 UTC m=+0.354966341,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-83.ec2.internal,}" Jul 01 20:17:14.154115 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.154096 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 20:17:14.154184 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.154092 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 20:17:14.154311 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.154274 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:14.154871 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.154846 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 20:17:14.154871 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.154851 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 20:17:14.154994 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.154883 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 20:17:14.155071 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.155043 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 01 20:17:14.155071 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.155070 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 01 20:17:14.155183 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.155120 2578 factory.go:55] Registering systemd factory Jul 01 20:17:14.155183 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.155156 2578 factory.go:223] Registration of the systemd container factory successfully Jul 01 20:17:14.155431 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.155415 2578 factory.go:153] Registering CRI-O factory Jul 01 20:17:14.155431 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.155432 2578 factory.go:223] Registration of the crio container factory successfully Jul 01 20:17:14.155548 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.155473 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 20:17:14.155548 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.155493 2578 factory.go:103] Registering Raw factory Jul 01 20:17:14.155548 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.155510 2578 manager.go:1196] Started watching for new ooms in manager Jul 01 20:17:14.155983 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.155964 2578 manager.go:349] Starting recovery of all containers Jul 01 20:17:14.160904 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.160881 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-db2xq" Jul 01 20:17:14.163376 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.163343 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 20:17:14.163376 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.163348 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 20:17:14.169582 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.169568 2578 manager.go:354] Recovery completed Jul 01 20:17:14.170996 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.170972 2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 01 20:17:14.173900 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.173888 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:14.175559 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.175545 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:14.175625 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.175569 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:14.175625 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.175579 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:14.176026 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.176013 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 20:17:14.176117 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.176026 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 20:17:14.176117 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.176035 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:14.176117 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.176043 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 01 20:17:14.176672 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.176659 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:14.176715 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.176682 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:14.176715 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.176691 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:14.177181 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.177164 2578 policy_none.go:49] "None policy: Start" Jul 01 20:17:14.177271 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.177202 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 20:17:14.177271 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.177216 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 20:17:14.177382 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.177309 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-83.ec2.internal.18be43c942ec2e16 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-83.ec2.internal,UID:ip-10-0-140-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-83.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-83.ec2.internal,},FirstTimestamp:2026-07-01 20:17:14.175557142 +0000 UTC m=+0.383866375,LastTimestamp:2026-07-01 20:17:14.175557142 +0000 UTC m=+0.383866375,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-83.ec2.internal,}" Jul 01 20:17:14.178268 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.178256 2578 policy_none.go:47] "Start" Jul 01 20:17:14.207765 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.207650 2578 manager.go:337] "Starting Device Plugin manager" Jul 01 20:17:14.207861 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.207795 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 20:17:14.207861 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.207808 2578 server.go:87] "Starting device plugin registration server" Jul 01 20:17:14.208030 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.208018 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 20:17:14.208236 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.208040 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 20:17:14.208236 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.208128 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 20:17:14.208236 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.208198 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 20:17:14.208236 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.208207 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 20:17:14.208674 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.208654 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 20:17:14.208754 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.208705 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:14.219554 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.219524 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 20:17:14.220614 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.220598 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 20:17:14.220675 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.220632 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 20:17:14.220675 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.220650 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 20:17:14.220746 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.220680 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 20:17:14.223005 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.222990 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:14.309015 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.308997 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:14.309807 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.309785 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:14.309889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.309814 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:14.309889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.309828 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:14.309889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.309853 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.318568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.318551 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.318626 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.318570 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-83.ec2.internal\": node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:14.321386 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.321364 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal"] Jul 01 20:17:14.321450 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.321433 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:14.322130 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.322115 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:14.322206 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.322142 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:14.322206 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.322156 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:14.323416 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.323376 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:14.323494 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.323477 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.323551 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.323505 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:14.324023 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.323998 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:14.324023 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.324014 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:14.324164 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.324033 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:14.324164 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.324037 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:14.324164 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.324044 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:14.324164 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.324049 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:14.325293 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.325278 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.325349 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.325306 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:17:14.325895 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.325883 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:17:14.325971 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.325909 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:17:14.325971 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.325924 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:17:14.340594 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.340575 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-83.ec2.internal\" not found" node="ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.340817 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.340798 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:14.344453 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.344437 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-83.ec2.internal\" not found" node="ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.356345 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.356323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb5792393d0580e10fa2b70bbe5f92f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"cb5792393d0580e10fa2b70bbe5f92f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.356414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.356362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb5792393d0580e10fa2b70bbe5f92f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"cb5792393d0580e10fa2b70bbe5f92f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.356414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.356386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b8636df1471c502dd21f18b789ab0075-config\") pod \"kube-apiserver-proxy-ip-10-0-140-83.ec2.internal\" (UID: \"b8636df1471c502dd21f18b789ab0075\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.441870 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.441842 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:14.457090 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.457050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b8636df1471c502dd21f18b789ab0075-config\") pod \"kube-apiserver-proxy-ip-10-0-140-83.ec2.internal\" (UID: \"b8636df1471c502dd21f18b789ab0075\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.457189 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.457095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb5792393d0580e10fa2b70bbe5f92f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"cb5792393d0580e10fa2b70bbe5f92f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.457189 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.457113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb5792393d0580e10fa2b70bbe5f92f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"cb5792393d0580e10fa2b70bbe5f92f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.457189 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.457163 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b8636df1471c502dd21f18b789ab0075-config\") pod \"kube-apiserver-proxy-ip-10-0-140-83.ec2.internal\" (UID: \"b8636df1471c502dd21f18b789ab0075\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.457319 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.457226 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb5792393d0580e10fa2b70bbe5f92f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"cb5792393d0580e10fa2b70bbe5f92f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.457319 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.457257 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb5792393d0580e10fa2b70bbe5f92f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal\" (UID: \"cb5792393d0580e10fa2b70bbe5f92f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.543001 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.542971 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:14.643094 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.643028 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:14.644208 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.644189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.647643 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.647448 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" Jul 01 20:17:14.748725 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.748703 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:14.856010 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.855979 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:14.961227 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:14.961168 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:14.991075 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:14.991053 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:15.061491 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:15.061468 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:15.095784 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.095759 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 20:17:15.096266 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.095864 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 20:17:15.096266 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.095892 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 20:17:15.161786 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:15.161761 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-83.ec2.internal\" not found" Jul 01 20:17:15.165174 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.165147 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 20:12:14 +0000 UTC" deadline="2027-12-13 22:35:52.130154536 +0000 UTC" Jul 01 20:17:15.165252 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.165174 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12722h18m36.964983879s" Jul 01 20:17:15.217101 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.217034 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:15.254790 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.254762 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" Jul 01 20:17:15.266654 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.266630 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 20:17:15.267691 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.267675 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" Jul 01 20:17:15.279764 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.279742 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 20:17:15.380056 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:15.380025 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5792393d0580e10fa2b70bbe5f92f8.slice/crio-30e0c2611557e87b85666039f5986fdec4496f5fa4661f3ae80ba40223959156 WatchSource:0}: Error finding container 30e0c2611557e87b85666039f5986fdec4496f5fa4661f3ae80ba40223959156: Status 404 returned error can't find the container with id 30e0c2611557e87b85666039f5986fdec4496f5fa4661f3ae80ba40223959156 Jul 01 20:17:15.380598 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:15.380572 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8636df1471c502dd21f18b789ab0075.slice/crio-2a96e6d939a076dfaab59ba04e2662d93ff98f293b950834c203907a2469034c WatchSource:0}: Error finding container 2a96e6d939a076dfaab59ba04e2662d93ff98f293b950834c203907a2469034c: Status 404 returned error can't find the container with id 2a96e6d939a076dfaab59ba04e2662d93ff98f293b950834c203907a2469034c Jul 01 20:17:15.386386 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.386371 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:17:15.700193 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.700128 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:15.990956 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:15.990872 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:16.141214 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.141183 2578 apiserver.go:52] "Watching apiserver" Jul 01 20:17:16.153038 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.153005 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 20:17:16.153654 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.153490 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-xnxmc","openshift-cluster-node-tuning-operator/tuned-4xnb7","openshift-dns/node-resolver-cs9mh","openshift-multus/multus-additional-cni-plugins-4mpdp","openshift-multus/network-metrics-daemon-5dbjk","openshift-network-diagnostics/network-check-target-vx9mb","openshift-network-operator/iptables-alerter-6g64x","kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz","openshift-image-registry/node-ca-qfzbq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal","openshift-multus/multus-wv2q7","openshift-ovn-kubernetes/ovnkube-node-b74d4","kube-system/global-pull-secret-syncer-bcwn6"] Jul 01 20:17:16.155522 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.155271 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 20:17:16.155522 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.155437 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.156970 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.156937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:16.158819 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.158485 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 20:17:16.158819 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.158695 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 20:17:16.158819 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.158728 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.159603 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.159343 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 20:17:16.159603 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.159364 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5wd7k\"" Jul 01 20:17:16.159603 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.159347 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 20:17:16.159889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.159763 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.160024 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.159955 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 20:17:16.160403 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.160385 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 20:17:16.160479 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.160434 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 20:17:16.161493 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.161474 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:16.161592 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.161554 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:16.161996 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.161977 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:17:16.162069 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.162012 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n2zsl\"" Jul 01 20:17:16.162122 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.162111 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 20:17:16.162198 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.162166 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-29mqj\"" Jul 01 20:17:16.162277 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.162260 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 20:17:16.162644 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.162627 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:16.162725 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.162696 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:16.163079 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.163060 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 20:17:16.164870 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.164775 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.165606 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.165586 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 20:17:16.165842 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.165817 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6dl8q\"" Jul 01 20:17:16.167579 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.167557 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:17:16.167914 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.167895 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kmd5d\"" Jul 01 20:17:16.168240 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168222 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 20:17:16.168571 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsg95\" (UniqueName: \"kubernetes.io/projected/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-kube-api-access-bsg95\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.168655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2f84134-907d-4db8-8791-0c83da22f474-konnectivity-ca\") pod \"konnectivity-agent-xnxmc\" (UID: \"f2f84134-907d-4db8-8791-0c83da22f474\") " pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:16.168723 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-os-release\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.168723 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.168826 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.168876 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2f84134-907d-4db8-8791-0c83da22f474-agent-certs\") pod \"konnectivity-agent-xnxmc\" (UID: \"f2f84134-907d-4db8-8791-0c83da22f474\") " pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:16.168926 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-system-cni-dir\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.168984 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-cnibin\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.168984 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.169079 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.168993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.171663 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.171627 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.172688 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.172668 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 20:17:16.172783 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.172718 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.174677 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.174425 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.175338 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.174934 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4cbdc\"" Jul 01 20:17:16.175338 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.174967 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 20:17:16.175338 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.175187 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 20:17:16.175338 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.175296 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 20:17:16.177580 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.176390 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cqr67\"" Jul 01 20:17:16.177580 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.176601 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 20:17:16.177580 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.176663 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 20:17:16.177580 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.176603 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 20:17:16.177580 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.177162 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.178576 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.178085 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 20:17:16.178576 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.178181 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zvp9w\"" Jul 01 20:17:16.178576 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.178459 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:16.178576 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.178518 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:16.181479 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.181411 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 20:17:16.181479 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.181426 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 20:17:16.181629 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.181581 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d9htx\"" Jul 01 20:17:16.181707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.181687 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 20:17:16.182016 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.181897 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 20:17:16.182016 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.181926 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 20:17:16.182016 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.181951 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 20:17:16.198638 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.198615 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xvfz9" Jul 01 20:17:16.206895 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.206875 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xvfz9" Jul 01 20:17:16.227347 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.227302 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" event={"ID":"b8636df1471c502dd21f18b789ab0075","Type":"ContainerStarted","Data":"2a96e6d939a076dfaab59ba04e2662d93ff98f293b950834c203907a2469034c"} Jul 01 20:17:16.230367 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.230341 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" event={"ID":"cb5792393d0580e10fa2b70bbe5f92f8","Type":"ContainerStarted","Data":"30e0c2611557e87b85666039f5986fdec4496f5fa4661f3ae80ba40223959156"} Jul 01 20:17:16.257150 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.257098 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b7a756d-f983-45af-9dfe-6df81ac07903-cni-binary-copy\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-var-lib-kubelet\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-kubernetes\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/95b6f23d-fd06-4986-b91b-45e323a8ba3f-kubelet-config\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-cnibin\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-system-cni-dir\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsg95\" (UniqueName: \"kubernetes.io/projected/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-kube-api-access-bsg95\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccc8h\" (UniqueName: \"kubernetes.io/projected/d3998883-33f1-48fb-b9a4-865d09b95594-kube-api-access-ccc8h\") pod \"iptables-alerter-6g64x\" (UID: \"d3998883-33f1-48fb-b9a4-865d09b95594\") " pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60903657-c82f-4222-911c-121e9ffcf6a5-tmp-dir\") pod \"node-resolver-cs9mh\" (UID: \"60903657-c82f-4222-911c-121e9ffcf6a5\") " pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-hostroot\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-run-systemd\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64be0627-f73b-455b-b7dd-6bbcbb7a54f7-host\") pod \"node-ca-qfzbq\" (UID: \"64be0627-f73b-455b-b7dd-6bbcbb7a54f7\") " pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbzmj\" (UniqueName: \"kubernetes.io/projected/60903657-c82f-4222-911c-121e9ffcf6a5-kube-api-access-tbzmj\") pod \"node-resolver-cs9mh\" (UID: \"60903657-c82f-4222-911c-121e9ffcf6a5\") " pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-run-ovn\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4nf\" (UniqueName: \"kubernetes.io/projected/20f93818-00f2-4891-bfe8-ab2848dec6bf-kube-api-access-gl4nf\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.270717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-sys-fs\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64be0627-f73b-455b-b7dd-6bbcbb7a54f7-serviceca\") pod \"node-ca-qfzbq\" (UID: \"64be0627-f73b-455b-b7dd-6bbcbb7a54f7\") " pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-var-lib-cni-bin\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-node-log\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/20f93818-00f2-4891-bfe8-ab2848dec6bf-ovnkube-script-lib\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270979 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-system-cni-dir\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.270987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-sys\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/95b6f23d-fd06-4986-b91b-45e323a8ba3f-dbus\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-run-k8s-cni-cncf-io\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-run-netns\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-os-release\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271290 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-os-release\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60903657-c82f-4222-911c-121e9ffcf6a5-hosts-file\") pod \"node-resolver-cs9mh\" (UID: \"60903657-c82f-4222-911c-121e9ffcf6a5\") " pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/20f93818-00f2-4891-bfe8-ab2848dec6bf-ovn-node-metrics-cert\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-socket-dir-parent\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.271498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn7hc\" (UniqueName: \"kubernetes.io/projected/8b7a756d-f983-45af-9dfe-6df81ac07903-kube-api-access-cn7hc\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-kubelet\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jddcl\" (UniqueName: \"kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl\") pod \"network-check-target-vx9mb\" (UID: \"6a96f009-0de6-4770-9561-d57ced585983\") " pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-tmp\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-cni-dir\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-etc-kubernetes\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zdnf\" (UniqueName: \"kubernetes.io/projected/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-kube-api-access-4zdnf\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcrh8\" (UniqueName: \"kubernetes.io/projected/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-kube-api-access-gcrh8\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-cnibin\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-daemon-config\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-cni-bin\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/20f93818-00f2-4891-bfe8-ab2848dec6bf-ovnkube-config\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-sysctl-d\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271900 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.272380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-device-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.271953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2f84134-907d-4db8-8791-0c83da22f474-agent-certs\") pod \"konnectivity-agent-xnxmc\" (UID: \"f2f84134-907d-4db8-8791-0c83da22f474\") " pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272036 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-cnibin\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272307 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-var-lib-openvswitch\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-systemd\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-var-lib-kubelet\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-tuned\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272567 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-log-socket\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-os-release\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2f84134-907d-4db8-8791-0c83da22f474-konnectivity-ca\") pod \"konnectivity-agent-xnxmc\" (UID: \"f2f84134-907d-4db8-8791-0c83da22f474\") " pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272780 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3998883-33f1-48fb-b9a4-865d09b95594-iptables-alerter-script\") pod \"iptables-alerter-6g64x\" (UID: \"d3998883-33f1-48fb-b9a4-865d09b95594\") " pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-conf-dir\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-modprobe-d\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.272972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6smnv\" (UniqueName: \"kubernetes.io/projected/46244a31-6bd2-43d4-91cc-3d4ee67b913d-kube-api-access-6smnv\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.273278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-var-lib-cni-multus\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-systemd-units\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-cni-netd\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-sysctl-conf\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-lib-modules\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-slash\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273423 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-run-openvswitch\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-run\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-registration-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxtb9\" (UniqueName: \"kubernetes.io/projected/64be0627-f73b-455b-b7dd-6bbcbb7a54f7-kube-api-access-sxtb9\") pod \"node-ca-qfzbq\" (UID: \"64be0627-f73b-455b-b7dd-6bbcbb7a54f7\") " pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-etc-openvswitch\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3998883-33f1-48fb-b9a4-865d09b95594-host-slash\") pod \"iptables-alerter-6g64x\" (UID: \"d3998883-33f1-48fb-b9a4-865d09b95594\") " pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.274169 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-run-multus-certs\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.274980 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-run-netns\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.274980 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/20f93818-00f2-4891-bfe8-ab2848dec6bf-env-overrides\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.274980 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:16.274980 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-sysconfig\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.274980 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.273988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-host\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.274980 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.274021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-socket-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.274980 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.274083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-system-cni-dir\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.274980 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.274169 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.274980 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.274521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2f84134-907d-4db8-8791-0c83da22f474-konnectivity-ca\") pod \"konnectivity-agent-xnxmc\" (UID: \"f2f84134-907d-4db8-8791-0c83da22f474\") " pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:16.277207 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.277181 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2f84134-907d-4db8-8791-0c83da22f474-agent-certs\") pod \"konnectivity-agent-xnxmc\" (UID: \"f2f84134-907d-4db8-8791-0c83da22f474\") " pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:16.283828 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.283802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsg95\" (UniqueName: \"kubernetes.io/projected/d6e3305b-c2fe-4eb3-9e4e-858041f6e262-kube-api-access-bsg95\") pod \"multus-additional-cni-plugins-4mpdp\" (UID: \"d6e3305b-c2fe-4eb3-9e4e-858041f6e262\") " pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.374941 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.374907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-var-lib-cni-bin\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.374941 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.374943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-node-log\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.375176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.374961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/20f93818-00f2-4891-bfe8-ab2848dec6bf-ovnkube-script-lib\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.375176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.374978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-sys\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.375176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/95b6f23d-fd06-4986-b91b-45e323a8ba3f-dbus\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:16.375176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-sys\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.375176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-run-k8s-cni-cncf-io\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-run-netns\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60903657-c82f-4222-911c-121e9ffcf6a5-hosts-file\") pod \"node-resolver-cs9mh\" (UID: \"60903657-c82f-4222-911c-121e9ffcf6a5\") " pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.375176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375133 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-node-log\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.375176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/20f93818-00f2-4891-bfe8-ab2848dec6bf-ovn-node-metrics-cert\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.375176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-socket-dir-parent\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-run-k8s-cni-cncf-io\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn7hc\" (UniqueName: \"kubernetes.io/projected/8b7a756d-f983-45af-9dfe-6df81ac07903-kube-api-access-cn7hc\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375280 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60903657-c82f-4222-911c-121e9ffcf6a5-hosts-file\") pod \"node-resolver-cs9mh\" (UID: \"60903657-c82f-4222-911c-121e9ffcf6a5\") " pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-kubelet\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375300 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-var-lib-cni-bin\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-run-netns\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddcl\" (UniqueName: \"kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl\") pod \"network-check-target-vx9mb\" (UID: \"6a96f009-0de6-4770-9561-d57ced585983\") " pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375366 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-socket-dir-parent\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-tmp\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-cni-dir\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-etc-kubernetes\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zdnf\" (UniqueName: \"kubernetes.io/projected/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-kube-api-access-4zdnf\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcrh8\" (UniqueName: \"kubernetes.io/projected/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-kube-api-access-gcrh8\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-daemon-config\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-cni-bin\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.375655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/20f93818-00f2-4891-bfe8-ab2848dec6bf-ovnkube-config\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-sysctl-d\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/20f93818-00f2-4891-bfe8-ab2848dec6bf-ovnkube-script-lib\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-device-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-var-lib-openvswitch\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-var-lib-openvswitch\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375859 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/95b6f23d-fd06-4986-b91b-45e323a8ba3f-dbus\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375858 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-cni-dir\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375926 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-kubelet\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375930 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-cni-bin\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.375972 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-systemd\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-var-lib-kubelet\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-tuned\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.376532 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-log-socket\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-os-release\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3998883-33f1-48fb-b9a4-865d09b95594-iptables-alerter-script\") pod \"iptables-alerter-6g64x\" (UID: \"d3998883-33f1-48fb-b9a4-865d09b95594\") " pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-conf-dir\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-modprobe-d\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376524 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/20f93818-00f2-4891-bfe8-ab2848dec6bf-ovnkube-config\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6smnv\" (UniqueName: \"kubernetes.io/projected/46244a31-6bd2-43d4-91cc-3d4ee67b913d-kube-api-access-6smnv\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-daemon-config\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-var-lib-cni-multus\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-systemd-units\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376623 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-log-socket\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-cni-netd\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-sysctl-conf\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376670 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-var-lib-kubelet\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-lib-modules\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-systemd\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-slash\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376781 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-run-openvswitch\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.377380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376786 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-systemd-units\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-run\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376858 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-registration-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxtb9\" (UniqueName: \"kubernetes.io/projected/64be0627-f73b-455b-b7dd-6bbcbb7a54f7-kube-api-access-sxtb9\") pod \"node-ca-qfzbq\" (UID: \"64be0627-f73b-455b-b7dd-6bbcbb7a54f7\") " pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-etc-openvswitch\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3998883-33f1-48fb-b9a4-865d09b95594-host-slash\") pod \"iptables-alerter-6g64x\" (UID: \"d3998883-33f1-48fb-b9a4-865d09b95594\") " pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376973 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-sysctl-d\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-run-multus-certs\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377025 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-device-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-run-netns\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377062 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-etc-kubernetes\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/20f93818-00f2-4891-bfe8-ab2848dec6bf-env-overrides\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-sysconfig\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-host\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-socket-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.378289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-system-cni-dir\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-multus-conf-dir\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b7a756d-f983-45af-9dfe-6df81ac07903-cni-binary-copy\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377264 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-etc-selinux\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-var-lib-kubelet\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-kubernetes\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377336 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3998883-33f1-48fb-b9a4-865d09b95594-iptables-alerter-script\") pod \"iptables-alerter-6g64x\" (UID: \"d3998883-33f1-48fb-b9a4-865d09b95594\") " pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-cni-netd\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-modprobe-d\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3998883-33f1-48fb-b9a4-865d09b95594-host-slash\") pod \"iptables-alerter-6g64x\" (UID: \"d3998883-33f1-48fb-b9a4-865d09b95594\") " pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-var-lib-cni-multus\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-etc-openvswitch\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-sysconfig\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377468 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-sysctl-conf\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.377532 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.376862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-os-release\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377575 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/20f93818-00f2-4891-bfe8-ab2848dec6bf-env-overrides\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.377608 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs podName:30acf1f4-d2f9-4ec5-8344-8fea6a81513d nodeName:}" failed. No retries permitted until 2026-07-01 20:17:16.87758557 +0000 UTC m=+3.085894832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs") pod "network-metrics-daemon-5dbjk" (UID: "30acf1f4-d2f9-4ec5-8344-8fea6a81513d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377614 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-var-lib-kubelet\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377634 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/95b6f23d-fd06-4986-b91b-45e323a8ba3f-kubelet-config\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377642 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-run\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377577 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-socket-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377662 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-host-run-multus-certs\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377664 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-cnibin\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377682 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-run-netns\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377689 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-run-openvswitch\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccc8h\" (UniqueName: \"kubernetes.io/projected/d3998883-33f1-48fb-b9a4-865d09b95594-kube-api-access-ccc8h\") pod \"iptables-alerter-6g64x\" (UID: \"d3998883-33f1-48fb-b9a4-865d09b95594\") " pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-cnibin\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377735 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-kubernetes\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-registration-dir\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60903657-c82f-4222-911c-121e9ffcf6a5-tmp-dir\") pod \"node-resolver-cs9mh\" (UID: \"60903657-c82f-4222-911c-121e9ffcf6a5\") " pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-hostroot\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.379844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-run-systemd\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64be0627-f73b-455b-b7dd-6bbcbb7a54f7-host\") pod \"node-ca-qfzbq\" (UID: \"64be0627-f73b-455b-b7dd-6bbcbb7a54f7\") " pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.377859 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbzmj\" (UniqueName: \"kubernetes.io/projected/60903657-c82f-4222-911c-121e9ffcf6a5-kube-api-access-tbzmj\") pod \"node-resolver-cs9mh\" (UID: \"60903657-c82f-4222-911c-121e9ffcf6a5\") " pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-run-ovn\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-lib-modules\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4nf\" (UniqueName: \"kubernetes.io/projected/20f93818-00f2-4891-bfe8-ab2848dec6bf-kube-api-access-gl4nf\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-sys-fs\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64be0627-f73b-455b-b7dd-6bbcbb7a54f7-serviceca\") pod \"node-ca-qfzbq\" (UID: \"64be0627-f73b-455b-b7dd-6bbcbb7a54f7\") " pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.378086 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60903657-c82f-4222-911c-121e9ffcf6a5-tmp-dir\") pod \"node-resolver-cs9mh\" (UID: \"60903657-c82f-4222-911c-121e9ffcf6a5\") " pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.378089 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b7a756d-f983-45af-9dfe-6df81ac07903-cni-binary-copy\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377796 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-system-cni-dir\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.378124 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-host-slash\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.378175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/95b6f23d-fd06-4986-b91b-45e323a8ba3f-kubelet-config\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.378188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b7a756d-f983-45af-9dfe-6df81ac07903-hostroot\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.377795 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-host\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.378210 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret podName:95b6f23d-fd06-4986-b91b-45e323a8ba3f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:16.87818916 +0000 UTC m=+3.086498388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret") pod "global-pull-secret-syncer-bcwn6" (UID: "95b6f23d-fd06-4986-b91b-45e323a8ba3f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.378225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-run-ovn\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.380568 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.378237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64be0627-f73b-455b-b7dd-6bbcbb7a54f7-host\") pod \"node-ca-qfzbq\" (UID: \"64be0627-f73b-455b-b7dd-6bbcbb7a54f7\") " pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.381295 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.378242 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/20f93818-00f2-4891-bfe8-ab2848dec6bf-run-systemd\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.381295 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.378279 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46244a31-6bd2-43d4-91cc-3d4ee67b913d-sys-fs\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.381295 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.378457 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64be0627-f73b-455b-b7dd-6bbcbb7a54f7-serviceca\") pod \"node-ca-qfzbq\" (UID: \"64be0627-f73b-455b-b7dd-6bbcbb7a54f7\") " pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.381295 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.379417 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-etc-tuned\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.381295 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.379996 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-tmp\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.381295 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.380992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/20f93818-00f2-4891-bfe8-ab2848dec6bf-ovn-node-metrics-cert\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.382062 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.382042 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:16.382062 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.382066 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:16.382062 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.382080 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jddcl for pod openshift-network-diagnostics/network-check-target-vx9mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:16.382297 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.382175 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl podName:6a96f009-0de6-4770-9561-d57ced585983 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:16.882156007 +0000 UTC m=+3.090465233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jddcl" (UniqueName: "kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl") pod "network-check-target-vx9mb" (UID: "6a96f009-0de6-4770-9561-d57ced585983") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:16.385343 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.385317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn7hc\" (UniqueName: \"kubernetes.io/projected/8b7a756d-f983-45af-9dfe-6df81ac07903-kube-api-access-cn7hc\") pod \"multus-wv2q7\" (UID: \"8b7a756d-f983-45af-9dfe-6df81ac07903\") " pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.385971 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.385832 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zdnf\" (UniqueName: \"kubernetes.io/projected/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-kube-api-access-4zdnf\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:16.386151 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.386063 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcrh8\" (UniqueName: \"kubernetes.io/projected/ff30693f-37f1-45fb-8a0b-a02f420cd8b2-kube-api-access-gcrh8\") pod \"tuned-4xnb7\" (UID: \"ff30693f-37f1-45fb-8a0b-a02f420cd8b2\") " pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.386909 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.386863 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6smnv\" (UniqueName: \"kubernetes.io/projected/46244a31-6bd2-43d4-91cc-3d4ee67b913d-kube-api-access-6smnv\") pod \"aws-ebs-csi-driver-node-jt6bz\" (UID: \"46244a31-6bd2-43d4-91cc-3d4ee67b913d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.387525 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.387494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxtb9\" (UniqueName: \"kubernetes.io/projected/64be0627-f73b-455b-b7dd-6bbcbb7a54f7-kube-api-access-sxtb9\") pod \"node-ca-qfzbq\" (UID: \"64be0627-f73b-455b-b7dd-6bbcbb7a54f7\") " pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.388647 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.387749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4nf\" (UniqueName: \"kubernetes.io/projected/20f93818-00f2-4891-bfe8-ab2848dec6bf-kube-api-access-gl4nf\") pod \"ovnkube-node-b74d4\" (UID: \"20f93818-00f2-4891-bfe8-ab2848dec6bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.389527 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.389501 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccc8h\" (UniqueName: \"kubernetes.io/projected/d3998883-33f1-48fb-b9a4-865d09b95594-kube-api-access-ccc8h\") pod \"iptables-alerter-6g64x\" (UID: \"d3998883-33f1-48fb-b9a4-865d09b95594\") " pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.390442 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.390407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbzmj\" (UniqueName: \"kubernetes.io/projected/60903657-c82f-4222-911c-121e9ffcf6a5-kube-api-access-tbzmj\") pod \"node-resolver-cs9mh\" (UID: \"60903657-c82f-4222-911c-121e9ffcf6a5\") " pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.473011 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.472984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" Jul 01 20:17:16.482238 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.482211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:16.493003 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.492984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6g64x" Jul 01 20:17:16.499300 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.499277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cs9mh" Jul 01 20:17:16.507394 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.507341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" Jul 01 20:17:16.516264 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.516242 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" Jul 01 20:17:16.525236 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.525207 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qfzbq" Jul 01 20:17:16.535985 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.535964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wv2q7" Jul 01 20:17:16.541860 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.541844 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:16.882581 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.882486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:16.882581 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.882538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:16.882770 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:16.882607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddcl\" (UniqueName: \"kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl\") pod \"network-check-target-vx9mb\" (UID: \"6a96f009-0de6-4770-9561-d57ced585983\") " pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:16.882770 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.882654 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:16.882770 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.882727 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:16.882770 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.882731 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:16.882982 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.882742 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:16.882982 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.882815 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jddcl for pod openshift-network-diagnostics/network-check-target-vx9mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:16.882982 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.882728 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret podName:95b6f23d-fd06-4986-b91b-45e323a8ba3f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:17.882708801 +0000 UTC m=+4.091018038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret") pod "global-pull-secret-syncer-bcwn6" (UID: "95b6f23d-fd06-4986-b91b-45e323a8ba3f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:16.882982 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.882892 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs podName:30acf1f4-d2f9-4ec5-8344-8fea6a81513d nodeName:}" failed. No retries permitted until 2026-07-01 20:17:17.882870273 +0000 UTC m=+4.091179501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs") pod "network-metrics-daemon-5dbjk" (UID: "30acf1f4-d2f9-4ec5-8344-8fea6a81513d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:16.882982 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:16.882921 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl podName:6a96f009-0de6-4770-9561-d57ced585983 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:17.882907534 +0000 UTC m=+4.091216762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jddcl" (UniqueName: "kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl") pod "network-check-target-vx9mb" (UID: "6a96f009-0de6-4770-9561-d57ced585983") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:17.209496 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:17.209388 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 20:12:16 +0000 UTC" deadline="2027-11-27 18:07:19.884501641 +0000 UTC" Jul 01 20:17:17.209496 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:17.209445 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12333h50m2.675061896s" Jul 01 20:17:17.458659 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:17.458550 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff30693f_37f1_45fb_8a0b_a02f420cd8b2.slice/crio-7b153d3c1f7b4b272b5cdc1cf8fb4862c8c8d6e77aaba76d247dc559d70c9988 WatchSource:0}: Error finding container 7b153d3c1f7b4b272b5cdc1cf8fb4862c8c8d6e77aaba76d247dc559d70c9988: Status 404 returned error can't find the container with id 7b153d3c1f7b4b272b5cdc1cf8fb4862c8c8d6e77aaba76d247dc559d70c9988 Jul 01 20:17:17.462218 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:17.462116 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e3305b_c2fe_4eb3_9e4e_858041f6e262.slice/crio-ddaeb41a82693499540cec04a87bba73b66743251c4cda3cd5721a827233a286 WatchSource:0}: Error finding container ddaeb41a82693499540cec04a87bba73b66743251c4cda3cd5721a827233a286: Status 404 returned error can't find the container with id ddaeb41a82693499540cec04a87bba73b66743251c4cda3cd5721a827233a286 Jul 01 20:17:17.462985 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:17.462934 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7a756d_f983_45af_9dfe_6df81ac07903.slice/crio-3acfc1e833dc7ecb63c38d8f39e9d717fcd0bbfcee1c99eb9263dfde111783f9 WatchSource:0}: Error finding container 3acfc1e833dc7ecb63c38d8f39e9d717fcd0bbfcee1c99eb9263dfde111783f9: Status 404 returned error can't find the container with id 3acfc1e833dc7ecb63c38d8f39e9d717fcd0bbfcee1c99eb9263dfde111783f9 Jul 01 20:17:17.470545 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:17.470517 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60903657_c82f_4222_911c_121e9ffcf6a5.slice/crio-7963938494ca1265b1c2ecefa201c3d20b8f56336749261084e937516ae87aaf WatchSource:0}: Error finding container 7963938494ca1265b1c2ecefa201c3d20b8f56336749261084e937516ae87aaf: Status 404 returned error can't find the container with id 7963938494ca1265b1c2ecefa201c3d20b8f56336749261084e937516ae87aaf Jul 01 20:17:17.470785 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:17.470755 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f93818_00f2_4891_bfe8_ab2848dec6bf.slice/crio-ebb8591b3a0f2103e3b97ba90ff6aa1a9f9a41759c9eb093d6eb0f8815f66565 WatchSource:0}: Error finding container ebb8591b3a0f2103e3b97ba90ff6aa1a9f9a41759c9eb093d6eb0f8815f66565: Status 404 returned error can't find the container with id ebb8591b3a0f2103e3b97ba90ff6aa1a9f9a41759c9eb093d6eb0f8815f66565 Jul 01 20:17:17.472355 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:17:17.472326 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f84134_907d_4db8_8791_0c83da22f474.slice/crio-4fed47c5f1c06d91862d294d09099308fab342de7ede407943891423b68f30b7 WatchSource:0}: Error finding container 4fed47c5f1c06d91862d294d09099308fab342de7ede407943891423b68f30b7: Status 404 returned error can't find the container with id 4fed47c5f1c06d91862d294d09099308fab342de7ede407943891423b68f30b7 Jul 01 20:17:17.891124 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:17.890938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:17.891124 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:17.891109 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:17.891320 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:17.891144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:17.891320 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:17.891168 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret podName:95b6f23d-fd06-4986-b91b-45e323a8ba3f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:19.891151996 +0000 UTC m=+6.099461218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret") pod "global-pull-secret-syncer-bcwn6" (UID: "95b6f23d-fd06-4986-b91b-45e323a8ba3f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:17.891320 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:17.891229 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:17.891320 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:17.891233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddcl\" (UniqueName: \"kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl\") pod \"network-check-target-vx9mb\" (UID: \"6a96f009-0de6-4770-9561-d57ced585983\") " pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:17.891320 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:17.891279 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs podName:30acf1f4-d2f9-4ec5-8344-8fea6a81513d nodeName:}" failed. No retries permitted until 2026-07-01 20:17:19.891262717 +0000 UTC m=+6.099571955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs") pod "network-metrics-daemon-5dbjk" (UID: "30acf1f4-d2f9-4ec5-8344-8fea6a81513d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:17.891495 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:17.891345 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:17.891495 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:17.891369 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:17.891495 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:17.891383 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jddcl for pod openshift-network-diagnostics/network-check-target-vx9mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:17.891495 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:17.891436 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl podName:6a96f009-0de6-4770-9561-d57ced585983 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:19.891420659 +0000 UTC m=+6.099729910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jddcl" (UniqueName: "kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl") pod "network-check-target-vx9mb" (UID: "6a96f009-0de6-4770-9561-d57ced585983") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:18.079852 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.079742 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:17:18.209714 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.209650 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 20:12:16 +0000 UTC" deadline="2028-02-03 12:27:32.966640645 +0000 UTC" Jul 01 20:17:18.209714 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.209712 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13960h10m14.756932945s" Jul 01 20:17:18.223494 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.223469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:18.223684 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:18.223655 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:18.224188 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.224169 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:18.224355 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:18.224330 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:18.224507 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.224488 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:18.224600 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:18.224579 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:18.260734 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.260373 2578 generic.go:356] "Generic (PLEG): container finished" podID="cb5792393d0580e10fa2b70bbe5f92f8" containerID="09e65689ce133cf8333e339d791d2d8886e8e25c8885f64e77f8676578ac47ad" exitCode=0 Jul 01 20:17:18.260734 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.260460 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" event={"ID":"cb5792393d0580e10fa2b70bbe5f92f8","Type":"ContainerDied","Data":"09e65689ce133cf8333e339d791d2d8886e8e25c8885f64e77f8676578ac47ad"} Jul 01 20:17:18.265812 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.265776 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" event={"ID":"b8636df1471c502dd21f18b789ab0075","Type":"ContainerStarted","Data":"20d2af26d149710762b2bcec37d8b536163e777812f0bd19644724b6efda17c7"} Jul 01 20:17:18.271927 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.271897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xnxmc" event={"ID":"f2f84134-907d-4db8-8791-0c83da22f474","Type":"ContainerStarted","Data":"4fed47c5f1c06d91862d294d09099308fab342de7ede407943891423b68f30b7"} Jul 01 20:17:18.283528 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.283416 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" event={"ID":"20f93818-00f2-4891-bfe8-ab2848dec6bf","Type":"ContainerStarted","Data":"ebb8591b3a0f2103e3b97ba90ff6aa1a9f9a41759c9eb093d6eb0f8815f66565"} Jul 01 20:17:18.291342 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.291280 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qfzbq" event={"ID":"64be0627-f73b-455b-b7dd-6bbcbb7a54f7","Type":"ContainerStarted","Data":"57393584482e2ad5be688936be2bf3c1b00aa0ce4c1edc4537d583b5e33d3d06"} Jul 01 20:17:18.294833 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.294785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6g64x" event={"ID":"d3998883-33f1-48fb-b9a4-865d09b95594","Type":"ContainerStarted","Data":"237fb6c2e41372462bb6f241e5762eab6d21cdec73bd6f92d3d031254556aa14"} Jul 01 20:17:18.296736 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.296651 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wv2q7" event={"ID":"8b7a756d-f983-45af-9dfe-6df81ac07903","Type":"ContainerStarted","Data":"3acfc1e833dc7ecb63c38d8f39e9d717fcd0bbfcee1c99eb9263dfde111783f9"} Jul 01 20:17:18.311864 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.311837 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" event={"ID":"ff30693f-37f1-45fb-8a0b-a02f420cd8b2","Type":"ContainerStarted","Data":"7b153d3c1f7b4b272b5cdc1cf8fb4862c8c8d6e77aaba76d247dc559d70c9988"} Jul 01 20:17:18.323213 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.323144 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cs9mh" event={"ID":"60903657-c82f-4222-911c-121e9ffcf6a5","Type":"ContainerStarted","Data":"7963938494ca1265b1c2ecefa201c3d20b8f56336749261084e937516ae87aaf"} Jul 01 20:17:18.336771 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.336480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" event={"ID":"d6e3305b-c2fe-4eb3-9e4e-858041f6e262","Type":"ContainerStarted","Data":"ddaeb41a82693499540cec04a87bba73b66743251c4cda3cd5721a827233a286"} Jul 01 20:17:18.355416 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:18.355387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" event={"ID":"46244a31-6bd2-43d4-91cc-3d4ee67b913d","Type":"ContainerStarted","Data":"d5edfd6519c0d607411457b9b4dce60354bafaa9fccb58c5a8b59941c34f7579"} Jul 01 20:17:19.398778 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:19.398715 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" event={"ID":"cb5792393d0580e10fa2b70bbe5f92f8","Type":"ContainerStarted","Data":"d646f281e494858c9c35d229d933ab45e0d5c17f91ab6a93907b269e9c1bead0"} Jul 01 20:17:19.419329 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:19.419109 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-83.ec2.internal" podStartSLOduration=4.4190878510000005 podStartE2EDuration="4.419087851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:18.294782634 +0000 UTC m=+4.503091881" watchObservedRunningTime="2026-07-01 20:17:19.419087851 +0000 UTC m=+5.627397098" Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:19.916685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddcl\" (UniqueName: \"kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl\") pod \"network-check-target-vx9mb\" (UID: \"6a96f009-0de6-4770-9561-d57ced585983\") " pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:19.916768 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:19.916802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:19.916936 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:19.917008 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs podName:30acf1f4-d2f9-4ec5-8344-8fea6a81513d nodeName:}" failed. No retries permitted until 2026-07-01 20:17:23.916985019 +0000 UTC m=+10.125294246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs") pod "network-metrics-daemon-5dbjk" (UID: "30acf1f4-d2f9-4ec5-8344-8fea6a81513d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:19.917497 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:19.917520 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:19.917533 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jddcl for pod openshift-network-diagnostics/network-check-target-vx9mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:19.917584 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl podName:6a96f009-0de6-4770-9561-d57ced585983 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:23.917567202 +0000 UTC m=+10.125876450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jddcl" (UniqueName: "kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl") pod "network-check-target-vx9mb" (UID: "6a96f009-0de6-4770-9561-d57ced585983") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:19.917653 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:19.917735 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:19.917689 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret podName:95b6f23d-fd06-4986-b91b-45e323a8ba3f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:23.917675588 +0000 UTC m=+10.125984812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret") pod "global-pull-secret-syncer-bcwn6" (UID: "95b6f23d-fd06-4986-b91b-45e323a8ba3f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:20.221961 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:20.221319 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:20.221961 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:20.221341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:20.221961 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:20.221532 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:20.221961 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:20.221822 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:20.221961 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:20.221903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:20.222343 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:20.221998 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:22.221925 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:22.221895 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:22.222385 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:22.221895 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:22.222385 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:22.222182 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:22.222385 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:22.222059 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:22.222385 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:22.222291 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:22.222606 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:22.222391 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:23.947731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:23.947695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:23.948208 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:23.947767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:23.948208 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:23.947831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddcl\" (UniqueName: \"kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl\") pod \"network-check-target-vx9mb\" (UID: \"6a96f009-0de6-4770-9561-d57ced585983\") " pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:23.948208 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:23.947921 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:23.948208 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:23.947989 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret podName:95b6f23d-fd06-4986-b91b-45e323a8ba3f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:31.947968252 +0000 UTC m=+18.156277473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret") pod "global-pull-secret-syncer-bcwn6" (UID: "95b6f23d-fd06-4986-b91b-45e323a8ba3f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:23.948208 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:23.948012 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:23.948208 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:23.948012 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:23.948208 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:23.948086 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs podName:30acf1f4-d2f9-4ec5-8344-8fea6a81513d nodeName:}" failed. No retries permitted until 2026-07-01 20:17:31.948049124 +0000 UTC m=+18.156358350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs") pod "network-metrics-daemon-5dbjk" (UID: "30acf1f4-d2f9-4ec5-8344-8fea6a81513d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:23.948208 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:23.948089 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:23.948208 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:23.948103 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jddcl for pod openshift-network-diagnostics/network-check-target-vx9mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:23.948208 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:23.948141 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl podName:6a96f009-0de6-4770-9561-d57ced585983 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:31.948129173 +0000 UTC m=+18.156438398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jddcl" (UniqueName: "kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl") pod "network-check-target-vx9mb" (UID: "6a96f009-0de6-4770-9561-d57ced585983") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:24.222166 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:24.222016 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:24.222555 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:24.222108 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:24.222662 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:24.222613 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:24.222934 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:24.222144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:24.222934 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:24.222882 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:24.223311 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:24.223268 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:26.222290 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:26.221765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:26.222290 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:26.221899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:26.222290 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:26.221898 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:26.222290 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:26.221971 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:26.222290 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:26.222107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:26.222290 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:26.222192 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:28.221910 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:28.221878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:28.221910 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:28.221893 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:28.222465 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:28.221995 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:28.222465 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:28.222043 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:28.222465 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:28.222084 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:28.222465 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:28.222167 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:30.221678 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:30.221640 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:30.221678 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:30.221658 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:30.222209 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:30.221777 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:30.222209 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:30.221814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:30.222209 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:30.221913 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:30.222209 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:30.222001 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:32.015636 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:32.015600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:32.016175 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:32.015669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddcl\" (UniqueName: \"kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl\") pod \"network-check-target-vx9mb\" (UID: \"6a96f009-0de6-4770-9561-d57ced585983\") " pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:32.016175 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:32.015710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:32.016175 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.015770 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:32.016175 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.015806 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:32.016175 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.015827 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:32.016175 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.015849 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:32.016175 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.015851 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs podName:30acf1f4-d2f9-4ec5-8344-8fea6a81513d nodeName:}" failed. No retries permitted until 2026-07-01 20:17:48.015830097 +0000 UTC m=+34.224139327 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs") pod "network-metrics-daemon-5dbjk" (UID: "30acf1f4-d2f9-4ec5-8344-8fea6a81513d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:32.016175 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.015861 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jddcl for pod openshift-network-diagnostics/network-check-target-vx9mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:32.016175 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.015873 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret podName:95b6f23d-fd06-4986-b91b-45e323a8ba3f nodeName:}" failed. No retries permitted until 2026-07-01 20:17:48.015863182 +0000 UTC m=+34.224172403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret") pod "global-pull-secret-syncer-bcwn6" (UID: "95b6f23d-fd06-4986-b91b-45e323a8ba3f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:32.016175 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.015898 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl podName:6a96f009-0de6-4770-9561-d57ced585983 nodeName:}" failed. No retries permitted until 2026-07-01 20:17:48.015883366 +0000 UTC m=+34.224192588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jddcl" (UniqueName: "kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl") pod "network-check-target-vx9mb" (UID: "6a96f009-0de6-4770-9561-d57ced585983") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:32.220928 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:32.220902 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:32.220928 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:32.220925 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:32.221172 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:32.220903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:32.221172 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.221023 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:32.221172 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.221126 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:32.221328 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:32.221280 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:34.222202 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:34.222166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:34.222630 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:34.222250 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:34.222630 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:34.222254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:34.222630 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:34.222334 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:34.222630 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:34.222362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:34.222630 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:34.222440 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:36.221271 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.221232 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:36.221271 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.221249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:36.221771 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.221239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:36.221771 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:36.221370 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:36.221771 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:36.221480 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:36.221771 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:36.221545 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:36.437566 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.437239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" event={"ID":"20f93818-00f2-4891-bfe8-ab2848dec6bf","Type":"ContainerStarted","Data":"7ea3f1fed760873b74463e6e4f669f141a2c21dd0a8484fbc341f2b9b31adffa"} Jul 01 20:17:36.444313 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.444031 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qfzbq" event={"ID":"64be0627-f73b-455b-b7dd-6bbcbb7a54f7","Type":"ContainerStarted","Data":"24f7423d7be49d251c7f1c3c29f97ab9594cdad4af8c0b73cf66cdc3b3bfb215"} Jul 01 20:17:36.448558 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.448498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wv2q7" event={"ID":"8b7a756d-f983-45af-9dfe-6df81ac07903","Type":"ContainerStarted","Data":"d4e22518a99a87d3e577fef7d5272a758d35012baafec03569f1a77e642a7eab"} Jul 01 20:17:36.450621 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.450562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" event={"ID":"ff30693f-37f1-45fb-8a0b-a02f420cd8b2","Type":"ContainerStarted","Data":"f92dc59e8922c01fa752d43201f8749967fab9d1a69548ce2ad923b3063443b5"} Jul 01 20:17:36.461348 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.461303 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qfzbq" podStartSLOduration=6.325607419 podStartE2EDuration="21.461285339s" totalImagesPullingTime="15.13567792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:36.460867625 +0000 UTC m=+22.669176869" watchObservedRunningTime="2026-07-01 20:17:36.461285339 +0000 UTC m=+22.669594584" Jul 01 20:17:36.461440 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.461404 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-83.ec2.internal" podStartSLOduration=21.461396211 podStartE2EDuration="21.461396211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:19.418558488 +0000 UTC m=+5.626867735" watchObservedRunningTime="2026-07-01 20:17:36.461396211 +0000 UTC m=+22.669705457" Jul 01 20:17:36.478733 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.478699 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4xnb7" podStartSLOduration=2.665424803 podStartE2EDuration="21.478691283s" totalImagesPullingTime="18.81326648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:36.478269861 +0000 UTC m=+22.686579103" watchObservedRunningTime="2026-07-01 20:17:36.478691283 +0000 UTC m=+22.687000527" Jul 01 20:17:36.495884 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:36.495852 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wv2q7" podStartSLOduration=2.654900098 podStartE2EDuration="21.495839979s" totalImagesPullingTime="18.840939881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:36.495761101 +0000 UTC m=+22.704070343" watchObservedRunningTime="2026-07-01 20:17:36.495839979 +0000 UTC m=+22.704149221" Jul 01 20:17:37.454451 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.454182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xnxmc" event={"ID":"f2f84134-907d-4db8-8791-0c83da22f474","Type":"ContainerStarted","Data":"77c3c5a2fa62d0a14f426544ce6d44929bbf4e59dee91d0cbae11d7f58709169"} Jul 01 20:17:37.457510 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.457487 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-acl-logging/0.log" Jul 01 20:17:37.457940 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.457914 2578 generic.go:356] "Generic (PLEG): container finished" podID="20f93818-00f2-4891-bfe8-ab2848dec6bf" containerID="fdf87c90a048bc3e3a72c18d648025f27101a191be7e280b460a58a0ca4142ea" exitCode=1 Jul 01 20:17:37.458070 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.457999 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" event={"ID":"20f93818-00f2-4891-bfe8-ab2848dec6bf","Type":"ContainerStarted","Data":"ee728255f0691b98123c5dcd710df8862c7d7b2f526887cae16e747be113ed77"} Jul 01 20:17:37.458128 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.458083 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" event={"ID":"20f93818-00f2-4891-bfe8-ab2848dec6bf","Type":"ContainerStarted","Data":"f3e626c5eb7e6198b92048c6b367b3f49468518c23467cad398d34d111d8c2bf"} Jul 01 20:17:37.458189 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.458132 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" event={"ID":"20f93818-00f2-4891-bfe8-ab2848dec6bf","Type":"ContainerStarted","Data":"0ecb5a0a56d1609d3025b0bdc8a7428d809c96cc67e318b31fcaa54495c17e4c"} Jul 01 20:17:37.458189 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.458180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" event={"ID":"20f93818-00f2-4891-bfe8-ab2848dec6bf","Type":"ContainerStarted","Data":"5820448ff4fecf3a64080b847a7ab5d98b733e3530171a8ab0342fb7aab75bc4"} Jul 01 20:17:37.458268 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.458227 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" event={"ID":"20f93818-00f2-4891-bfe8-ab2848dec6bf","Type":"ContainerDied","Data":"fdf87c90a048bc3e3a72c18d648025f27101a191be7e280b460a58a0ca4142ea"} Jul 01 20:17:37.459572 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.459531 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6g64x" event={"ID":"d3998883-33f1-48fb-b9a4-865d09b95594","Type":"ContainerStarted","Data":"5d22ea589f4706d132747b967d2ab386a1e40427191c65a29efa661b4e0d082c"} Jul 01 20:17:37.461178 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.461151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cs9mh" event={"ID":"60903657-c82f-4222-911c-121e9ffcf6a5","Type":"ContainerStarted","Data":"1390b10db9b04f22798e9532832c54915f4a7e5454162ddce583c668a6b18775"} Jul 01 20:17:37.462743 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.462720 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6e3305b-c2fe-4eb3-9e4e-858041f6e262" containerID="2b166bc411fdac088b25d6f3ad6dcd65b0d195c0e90679cb1fe7f663545807d7" exitCode=0 Jul 01 20:17:37.462840 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.462798 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" event={"ID":"d6e3305b-c2fe-4eb3-9e4e-858041f6e262","Type":"ContainerDied","Data":"2b166bc411fdac088b25d6f3ad6dcd65b0d195c0e90679cb1fe7f663545807d7"} Jul 01 20:17:37.464348 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.464329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" event={"ID":"46244a31-6bd2-43d4-91cc-3d4ee67b913d","Type":"ContainerStarted","Data":"764c55479d852cea6938944dac525b6ddff7126c1b269b64c65c74f5f45518d6"} Jul 01 20:17:37.471987 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.471943 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xnxmc" podStartSLOduration=4.695473581 podStartE2EDuration="23.471927147s" totalImagesPullingTime="18.776453566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:37.471585217 +0000 UTC m=+23.679894460" watchObservedRunningTime="2026-07-01 20:17:37.471927147 +0000 UTC m=+23.680236391" Jul 01 20:17:37.488734 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.488690 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6g64x" podStartSLOduration=3.7087542129999997 podStartE2EDuration="22.488674462s" totalImagesPullingTime="18.779920249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:37.488491493 +0000 UTC m=+23.696800739" watchObservedRunningTime="2026-07-01 20:17:37.488674462 +0000 UTC m=+23.696983706" Jul 01 20:17:37.505373 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:37.505331 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cs9mh" podStartSLOduration=3.730131186 podStartE2EDuration="22.505314414s" totalImagesPullingTime="18.775183228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:37.504973734 +0000 UTC m=+23.713282977" watchObservedRunningTime="2026-07-01 20:17:37.505314414 +0000 UTC m=+23.713623658" Jul 01 20:17:38.063044 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:38.063021 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 20:17:38.221394 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:38.221345 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:38.221394 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:38.221366 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:38.221627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:38.221354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:38.221627 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:38.221431 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:38.221627 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:38.221484 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:38.221627 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:38.221568 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:38.221788 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:38.221716 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T20:17:38.063038802Z","UUID":"00df5011-7105-4452-abb5-60f978d4f549","Handler":null,"Name":"","Endpoint":""} Jul 01 20:17:38.222898 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:38.222883 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 20:17:38.222989 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:38.222919 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 20:17:38.468220 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:38.468185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" event={"ID":"46244a31-6bd2-43d4-91cc-3d4ee67b913d","Type":"ContainerStarted","Data":"71dff07112b51871d7e6307c8d43ebfbd7bf989cacf0c3fd54a8fba27dc5bcf8"} Jul 01 20:17:39.476041 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:39.474554 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-acl-logging/0.log" Jul 01 20:17:39.476041 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:39.475326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" event={"ID":"20f93818-00f2-4891-bfe8-ab2848dec6bf","Type":"ContainerStarted","Data":"7e74316cf1fdb517ca76b5762c245b30a4593a4a04f830eac4a9828c502ca04b"} Jul 01 20:17:39.861840 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:39.861766 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:39.862379 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:39.862355 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:40.220922 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:40.220860 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:40.220922 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:40.220872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:40.221139 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:40.220872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:40.221139 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:40.220963 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:40.221139 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:40.221024 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:40.221139 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:40.221105 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:40.480745 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:40.480668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" event={"ID":"46244a31-6bd2-43d4-91cc-3d4ee67b913d","Type":"ContainerStarted","Data":"56bff3b9610dd4587fd6519f1f26824323ac7b12449054d0681adb7ea4d9f2f9"} Jul 01 20:17:40.481263 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:40.481238 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:40.481440 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:40.481424 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xnxmc" Jul 01 20:17:40.498490 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:40.498443 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jt6bz" podStartSLOduration=3.69463773 podStartE2EDuration="25.49842796s" totalImagesPullingTime="21.80379023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:40.49839503 +0000 UTC m=+26.706704273" watchObservedRunningTime="2026-07-01 20:17:40.49842796 +0000 UTC m=+26.706737205" Jul 01 20:17:42.221448 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:42.221427 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:42.222039 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:42.221430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:42.222039 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:42.221550 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:42.222039 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:42.221654 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:42.222039 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:42.221681 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:42.222039 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:42.221775 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:42.491383 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:42.491221 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-acl-logging/0.log" Jul 01 20:17:42.491803 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:42.491767 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" event={"ID":"20f93818-00f2-4891-bfe8-ab2848dec6bf","Type":"ContainerStarted","Data":"4076361e99c3c970d3ed52e25d30d5dbd8243609bbb79de70a113e66ee5cf7a9"} Jul 01 20:17:42.492002 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:42.491985 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:42.492087 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:42.492077 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:42.492274 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:42.492260 2578 scope.go:117] "RemoveContainer" containerID="fdf87c90a048bc3e3a72c18d648025f27101a191be7e280b460a58a0ca4142ea" Jul 01 20:17:42.510196 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:42.510172 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:43.497001 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:43.496919 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6e3305b-c2fe-4eb3-9e4e-858041f6e262" containerID="8ee06052c794b0d4bd2cd3d9832c5a296daef2e29c394236435cbb32163971fd" exitCode=0 Jul 01 20:17:43.497484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:43.496991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" event={"ID":"d6e3305b-c2fe-4eb3-9e4e-858041f6e262","Type":"ContainerDied","Data":"8ee06052c794b0d4bd2cd3d9832c5a296daef2e29c394236435cbb32163971fd"} Jul 01 20:17:43.501442 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:43.501425 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-acl-logging/0.log" Jul 01 20:17:43.501839 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:43.501803 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" event={"ID":"20f93818-00f2-4891-bfe8-ab2848dec6bf","Type":"ContainerStarted","Data":"8338e617ff87603f0896aa55a76fdf49dcf77e2e545966db51a9b8415ef6d5b3"} Jul 01 20:17:43.502108 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:43.502088 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:43.519312 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:43.519292 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:17:43.548719 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:43.548662 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" podStartSLOduration=9.707512337 podStartE2EDuration="28.548641771s" totalImagesPullingTime="18.841129434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:43.546690925 +0000 UTC m=+29.755000168" watchObservedRunningTime="2026-07-01 20:17:43.548641771 +0000 UTC m=+29.756951015" Jul 01 20:17:43.931444 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:43.931419 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cs9mh_60903657-c82f-4222-911c-121e9ffcf6a5/dns-node-resolver/0.log" Jul 01 20:17:44.222851 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:44.222778 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:44.222851 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:44.222817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:44.223032 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:44.222887 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:44.223032 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:44.222901 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:44.223032 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:44.222965 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:44.223171 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:44.223079 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:44.479833 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:44.479747 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bcwn6"] Jul 01 20:17:44.480322 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:44.480297 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vx9mb"] Jul 01 20:17:44.481901 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:44.481874 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5dbjk"] Jul 01 20:17:44.504011 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:44.503991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:44.504382 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:44.504017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:44.504382 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:44.503991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:44.504382 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:44.504106 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:44.504382 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:44.504210 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:44.504382 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:44.504303 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:45.307776 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:45.307610 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qfzbq_64be0627-f73b-455b-b7dd-6bbcbb7a54f7/node-ca/0.log" Jul 01 20:17:45.508041 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:45.508009 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6e3305b-c2fe-4eb3-9e4e-858041f6e262" containerID="cbd51c5aedf92e701d191b22b64dcafd4ad3b68026906821624cb2f06ef58b2b" exitCode=0 Jul 01 20:17:45.508605 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:45.508097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" event={"ID":"d6e3305b-c2fe-4eb3-9e4e-858041f6e262","Type":"ContainerDied","Data":"cbd51c5aedf92e701d191b22b64dcafd4ad3b68026906821624cb2f06ef58b2b"} Jul 01 20:17:46.221221 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:46.221150 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:46.221356 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:46.221153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:46.221356 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:46.221300 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:46.221356 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:46.221318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:46.221480 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:46.221453 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:46.221603 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:46.221579 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:47.514113 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:47.514030 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6e3305b-c2fe-4eb3-9e4e-858041f6e262" containerID="c54bf3b60d427511c6f781fd0b29e4e6bda3c38729e961c95353c05113f417d3" exitCode=0 Jul 01 20:17:47.514113 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:47.514088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" event={"ID":"d6e3305b-c2fe-4eb3-9e4e-858041f6e262","Type":"ContainerDied","Data":"c54bf3b60d427511c6f781fd0b29e4e6bda3c38729e961c95353c05113f417d3"} Jul 01 20:17:48.030394 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:48.030364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddcl\" (UniqueName: \"kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl\") pod \"network-check-target-vx9mb\" (UID: \"6a96f009-0de6-4770-9561-d57ced585983\") " pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:48.030554 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:48.030411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:48.030554 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:48.030431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:48.030554 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.030517 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:17:48.030554 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.030542 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:48.030554 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.030551 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:17:48.030798 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.030564 2578 projected.go:196] Error preparing data for projected volume kube-api-access-jddcl for pod openshift-network-diagnostics/network-check-target-vx9mb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:48.030798 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.030599 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret podName:95b6f23d-fd06-4986-b91b-45e323a8ba3f nodeName:}" failed. No retries permitted until 2026-07-01 20:18:20.030580745 +0000 UTC m=+66.238889987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret") pod "global-pull-secret-syncer-bcwn6" (UID: "95b6f23d-fd06-4986-b91b-45e323a8ba3f") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:17:48.030798 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.030616 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl podName:6a96f009-0de6-4770-9561-d57ced585983 nodeName:}" failed. No retries permitted until 2026-07-01 20:18:20.03060733 +0000 UTC m=+66.238916552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jddcl" (UniqueName: "kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl") pod "network-check-target-vx9mb" (UID: "6a96f009-0de6-4770-9561-d57ced585983") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:17:48.030798 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.030523 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:48.030798 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.030684 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs podName:30acf1f4-d2f9-4ec5-8344-8fea6a81513d nodeName:}" failed. No retries permitted until 2026-07-01 20:18:20.030660044 +0000 UTC m=+66.238969276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs") pod "network-metrics-daemon-5dbjk" (UID: "30acf1f4-d2f9-4ec5-8344-8fea6a81513d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:17:48.221647 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:48.221608 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:48.221647 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:48.221633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:48.221876 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.221726 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:48.221876 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.221841 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:48.221987 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:48.221900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:48.221987 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:48.221974 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:50.221256 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:50.221210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:50.221856 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:50.221400 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:50.221856 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:50.221416 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:50.221856 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:50.221437 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:50.221856 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:50.221514 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:50.221856 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:50.221599 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:52.221325 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:52.221296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:52.221762 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:52.221297 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:52.221762 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:52.221413 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:52.221762 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:52.221304 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:52.221762 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:52.221486 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:52.221762 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:52.221540 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:52.526518 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:52.526432 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6e3305b-c2fe-4eb3-9e4e-858041f6e262" containerID="4c27db263c706792cb9b80869ab9de1a116387c4bade3df0855dfcacd7e81eff" exitCode=0 Jul 01 20:17:52.526518 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:52.526474 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" event={"ID":"d6e3305b-c2fe-4eb3-9e4e-858041f6e262","Type":"ContainerDied","Data":"4c27db263c706792cb9b80869ab9de1a116387c4bade3df0855dfcacd7e81eff"} Jul 01 20:17:53.531976 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:53.531799 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6e3305b-c2fe-4eb3-9e4e-858041f6e262" containerID="7e36b36b6e5c0e3dfc83c689396903ca9693344b8563f0784d7ec35b2daae196" exitCode=0 Jul 01 20:17:53.532414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:53.531876 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" event={"ID":"d6e3305b-c2fe-4eb3-9e4e-858041f6e262","Type":"ContainerDied","Data":"7e36b36b6e5c0e3dfc83c689396903ca9693344b8563f0784d7ec35b2daae196"} Jul 01 20:17:54.221573 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:54.221516 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:54.221677 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:54.221590 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:54.221720 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:54.221680 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:54.221774 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:54.221757 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:54.221819 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:54.221806 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:54.221887 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:54.221874 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:54.536768 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:54.536710 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" event={"ID":"d6e3305b-c2fe-4eb3-9e4e-858041f6e262","Type":"ContainerStarted","Data":"8c0c41323d99a3d72985ce1f3820b1e63bb2d360797f4063dc6360bce8b38408"} Jul 01 20:17:54.561121 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:54.561088 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4mpdp" podStartSLOduration=10.485472295 podStartE2EDuration="40.561074498s" totalImagesPullingTime="30.075602203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:17:54.55966247 +0000 UTC m=+40.767971712" watchObservedRunningTime="2026-07-01 20:17:54.561074498 +0000 UTC m=+40.769383732" Jul 01 20:17:56.221695 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:56.221664 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:56.222076 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:56.221673 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:56.222076 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:56.221751 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:56.222076 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:56.221817 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:17:56.222076 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:56.221861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:56.222076 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:56.221927 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:58.221357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:58.221326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:17:58.221785 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:58.221330 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:17:58.221785 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:58.221458 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:17:58.221785 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:17:58.221330 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:17:58.221785 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:58.221547 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:17:58.221785 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:17:58.221629 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:18:00.220915 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:00.220882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:18:00.221357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:00.220927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:18:00.221357 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:00.221025 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:18:00.221357 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:00.221143 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:18:00.221357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:00.221205 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:18:00.221357 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:00.221324 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:18:02.221686 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:02.221653 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:18:02.222166 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:02.221664 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:18:02.222166 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:02.221750 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:18:02.222166 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:02.221770 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:18:02.222166 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:02.221837 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:18:02.222166 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:02.221897 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:18:04.222758 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:04.222723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:18:04.223167 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:04.222771 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:18:04.223167 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:04.222830 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:18:04.223167 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:04.222874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:18:04.223167 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:04.222964 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:18:04.223167 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:04.223000 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:18:06.221543 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:06.221510 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:18:06.221986 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:06.221510 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:18:06.221986 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:06.221603 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vx9mb" podUID="6a96f009-0de6-4770-9561-d57ced585983" Jul 01 20:18:06.221986 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:06.221613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:18:06.221986 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:06.221706 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dbjk" podUID="30acf1f4-d2f9-4ec5-8344-8fea6a81513d" Jul 01 20:18:06.221986 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:06.221797 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bcwn6" podUID="95b6f23d-fd06-4986-b91b-45e323a8ba3f" Jul 01 20:18:07.129120 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.129039 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-83.ec2.internal" event="NodeReady" Jul 01 20:18:07.129290 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.129157 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 20:18:07.174835 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.174807 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54fccf8966-l7vfq"] Jul 01 20:18:07.189235 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.189211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.193339 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.193324 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 20:18:07.193640 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.193625 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4pvx5\"" Jul 01 20:18:07.193890 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.193879 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 20:18:07.194265 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.194247 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 20:18:07.197759 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.197734 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5bn7l"] Jul 01 20:18:07.203735 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.203711 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 20:18:07.219388 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.219368 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cxmhp"] Jul 01 20:18:07.219487 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.219472 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5bn7l" Jul 01 20:18:07.224554 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.224534 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jdbl8\"" Jul 01 20:18:07.225039 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.224533 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 20:18:07.225039 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.224534 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 20:18:07.225198 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.225181 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 20:18:07.236065 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.236033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.236153 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.236034 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54fccf8966-l7vfq"] Jul 01 20:18:07.236153 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.236127 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5bn7l"] Jul 01 20:18:07.236153 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.236141 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cxmhp"] Jul 01 20:18:07.239112 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.239092 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7gq8j\"" Jul 01 20:18:07.239207 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.239116 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 20:18:07.239207 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.239132 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 20:18:07.239629 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.239616 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 20:18:07.239629 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.239626 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 20:18:07.268376 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-registry-tls\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.268479 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64qjz\" (UniqueName: \"kubernetes.io/projected/e4e810c5-6e22-4618-88d8-dd8c006bd13f-kube-api-access-64qjz\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.268479 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4e810c5-6e22-4618-88d8-dd8c006bd13f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.268548 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-registry-certificates\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.268548 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-installation-pull-secrets\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.268548 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4e810c5-6e22-4618-88d8-dd8c006bd13f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.268651 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67cccb88-4445-405a-a931-b0f6d16b532a-cert\") pod \"ingress-canary-5bn7l\" (UID: \"67cccb88-4445-405a-a931-b0f6d16b532a\") " pod="openshift-ingress-canary/ingress-canary-5bn7l" Jul 01 20:18:07.268651 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-image-registry-private-configuration\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.268651 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-ca-trust-extracted\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.268651 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4e810c5-6e22-4618-88d8-dd8c006bd13f-crio-socket\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.268791 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz7cx\" (UniqueName: \"kubernetes.io/projected/67cccb88-4445-405a-a931-b0f6d16b532a-kube-api-access-cz7cx\") pod \"ingress-canary-5bn7l\" (UID: \"67cccb88-4445-405a-a931-b0f6d16b532a\") " pod="openshift-ingress-canary/ingress-canary-5bn7l" Jul 01 20:18:07.268791 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-trusted-ca\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.268791 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-bound-sa-token\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.268791 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mcgj\" (UniqueName: \"kubernetes.io/projected/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-kube-api-access-5mcgj\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.268791 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.268732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4e810c5-6e22-4618-88d8-dd8c006bd13f-data-volume\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.292564 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.292541 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fh72z"] Jul 01 20:18:07.317297 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.317280 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.321124 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.321109 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 20:18:07.321404 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.321390 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqmvx\"" Jul 01 20:18:07.321404 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.321399 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 20:18:07.340406 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.340378 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fh72z"] Jul 01 20:18:07.369454 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64qjz\" (UniqueName: \"kubernetes.io/projected/e4e810c5-6e22-4618-88d8-dd8c006bd13f-kube-api-access-64qjz\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.369535 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4e810c5-6e22-4618-88d8-dd8c006bd13f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.369535 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c70c9714-0f1f-406a-a810-bb4328cdeacc-config-volume\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.369535 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-registry-certificates\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.369535 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-installation-pull-secrets\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.369707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4e810c5-6e22-4618-88d8-dd8c006bd13f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.369707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67cccb88-4445-405a-a931-b0f6d16b532a-cert\") pod \"ingress-canary-5bn7l\" (UID: \"67cccb88-4445-405a-a931-b0f6d16b532a\") " pod="openshift-ingress-canary/ingress-canary-5bn7l" Jul 01 20:18:07.369707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-image-registry-private-configuration\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.369707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-ca-trust-extracted\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.369707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4e810c5-6e22-4618-88d8-dd8c006bd13f-crio-socket\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.369707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz7cx\" (UniqueName: \"kubernetes.io/projected/67cccb88-4445-405a-a931-b0f6d16b532a-kube-api-access-cz7cx\") pod \"ingress-canary-5bn7l\" (UID: \"67cccb88-4445-405a-a931-b0f6d16b532a\") " pod="openshift-ingress-canary/ingress-canary-5bn7l" Jul 01 20:18:07.369992 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-trusted-ca\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.369992 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.369895 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e4e810c5-6e22-4618-88d8-dd8c006bd13f-crio-socket\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.370116 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.370042 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-ca-trust-extracted\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.370181 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.370160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70c9714-0f1f-406a-a810-bb4328cdeacc-metrics-tls\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.370238 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.370198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70c9714-0f1f-406a-a810-bb4328cdeacc-tmp-dir\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.370238 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.370230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-bound-sa-token\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.370343 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.370255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mcgj\" (UniqueName: \"kubernetes.io/projected/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-kube-api-access-5mcgj\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.370343 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.370278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4e810c5-6e22-4618-88d8-dd8c006bd13f-data-volume\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.370343 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.370303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcdd7\" (UniqueName: \"kubernetes.io/projected/c70c9714-0f1f-406a-a810-bb4328cdeacc-kube-api-access-dcdd7\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.370343 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.370336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-registry-tls\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.370534 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.370341 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e4e810c5-6e22-4618-88d8-dd8c006bd13f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.370758 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.370737 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-trusted-ca\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.371033 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.371009 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-registry-certificates\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.371170 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.371151 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4e810c5-6e22-4618-88d8-dd8c006bd13f-data-volume\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.373898 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.373871 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-registry-tls\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.373977 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.373878 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e4e810c5-6e22-4618-88d8-dd8c006bd13f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.373977 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.373946 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-installation-pull-secrets\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.374071 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.374007 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-image-registry-private-configuration\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.374071 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.374013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67cccb88-4445-405a-a931-b0f6d16b532a-cert\") pod \"ingress-canary-5bn7l\" (UID: \"67cccb88-4445-405a-a931-b0f6d16b532a\") " pod="openshift-ingress-canary/ingress-canary-5bn7l" Jul 01 20:18:07.392091 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.392016 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz7cx\" (UniqueName: \"kubernetes.io/projected/67cccb88-4445-405a-a931-b0f6d16b532a-kube-api-access-cz7cx\") pod \"ingress-canary-5bn7l\" (UID: \"67cccb88-4445-405a-a931-b0f6d16b532a\") " pod="openshift-ingress-canary/ingress-canary-5bn7l" Jul 01 20:18:07.392183 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.392134 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64qjz\" (UniqueName: \"kubernetes.io/projected/e4e810c5-6e22-4618-88d8-dd8c006bd13f-kube-api-access-64qjz\") pod \"insights-runtime-extractor-cxmhp\" (UID: \"e4e810c5-6e22-4618-88d8-dd8c006bd13f\") " pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.392803 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.392784 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-bound-sa-token\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.393734 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.393714 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mcgj\" (UniqueName: \"kubernetes.io/projected/1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5-kube-api-access-5mcgj\") pod \"image-registry-54fccf8966-l7vfq\" (UID: \"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5\") " pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.470933 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.470908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c70c9714-0f1f-406a-a810-bb4328cdeacc-config-volume\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.471005 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.470955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70c9714-0f1f-406a-a810-bb4328cdeacc-metrics-tls\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.471005 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.470970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70c9714-0f1f-406a-a810-bb4328cdeacc-tmp-dir\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.471005 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.470988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcdd7\" (UniqueName: \"kubernetes.io/projected/c70c9714-0f1f-406a-a810-bb4328cdeacc-kube-api-access-dcdd7\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.471306 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.471286 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c70c9714-0f1f-406a-a810-bb4328cdeacc-tmp-dir\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.471478 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.471461 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c70c9714-0f1f-406a-a810-bb4328cdeacc-config-volume\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.472853 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.472835 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c70c9714-0f1f-406a-a810-bb4328cdeacc-metrics-tls\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.483292 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.483275 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcdd7\" (UniqueName: \"kubernetes.io/projected/c70c9714-0f1f-406a-a810-bb4328cdeacc-kube-api-access-dcdd7\") pod \"dns-default-fh72z\" (UID: \"c70c9714-0f1f-406a-a810-bb4328cdeacc\") " pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.499206 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.499184 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:07.527305 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.527288 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5bn7l" Jul 01 20:18:07.543923 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.543905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cxmhp" Jul 01 20:18:07.625559 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.625527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:07.709391 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.709367 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5bn7l"] Jul 01 20:18:07.712719 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:07.712694 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67cccb88_4445_405a_a931_b0f6d16b532a.slice/crio-df3803ff3c82978ca54c7dea05cd0cc449bc4229d9a9291e06772d006e48bdd0 WatchSource:0}: Error finding container df3803ff3c82978ca54c7dea05cd0cc449bc4229d9a9291e06772d006e48bdd0: Status 404 returned error can't find the container with id df3803ff3c82978ca54c7dea05cd0cc449bc4229d9a9291e06772d006e48bdd0 Jul 01 20:18:07.769441 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.769411 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fh72z"] Jul 01 20:18:07.778736 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:07.778713 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70c9714_0f1f_406a_a810_bb4328cdeacc.slice/crio-9bb7674d09da78c501d2f46063ce4d6f8299dd75ccfb9648d8492a55e9688891 WatchSource:0}: Error finding container 9bb7674d09da78c501d2f46063ce4d6f8299dd75ccfb9648d8492a55e9688891: Status 404 returned error can't find the container with id 9bb7674d09da78c501d2f46063ce4d6f8299dd75ccfb9648d8492a55e9688891 Jul 01 20:18:07.925084 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.924827 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cxmhp"] Jul 01 20:18:07.927762 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:07.927725 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e810c5_6e22_4618_88d8_dd8c006bd13f.slice/crio-cd7056e3e675557f5638adf80aebf41d8e05ba8823fb7c345ef2295a98a3a5a5 WatchSource:0}: Error finding container cd7056e3e675557f5638adf80aebf41d8e05ba8823fb7c345ef2295a98a3a5a5: Status 404 returned error can't find the container with id cd7056e3e675557f5638adf80aebf41d8e05ba8823fb7c345ef2295a98a3a5a5 Jul 01 20:18:07.927861 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:07.927843 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54fccf8966-l7vfq"] Jul 01 20:18:07.933104 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:07.933077 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aba7b0c_8d52_4ee7_bdab_8a4d7eb05ea5.slice/crio-5e452325d427d5fcf0b947b2f7e65f31ead10894fc015e1605251da8bfb44519 WatchSource:0}: Error finding container 5e452325d427d5fcf0b947b2f7e65f31ead10894fc015e1605251da8bfb44519: Status 404 returned error can't find the container with id 5e452325d427d5fcf0b947b2f7e65f31ead10894fc015e1605251da8bfb44519 Jul 01 20:18:08.221882 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.221815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:18:08.221882 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.221852 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:18:08.222047 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.221814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:18:08.225195 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.225174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 20:18:08.226450 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.226428 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 20:18:08.226567 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.226431 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 20:18:08.226567 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.226431 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 20:18:08.226719 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.226704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9s48\"" Jul 01 20:18:08.226814 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.226800 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpvfj\"" Jul 01 20:18:08.569691 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.569572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fh72z" event={"ID":"c70c9714-0f1f-406a-a810-bb4328cdeacc","Type":"ContainerStarted","Data":"9bb7674d09da78c501d2f46063ce4d6f8299dd75ccfb9648d8492a55e9688891"} Jul 01 20:18:08.571402 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.571322 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxmhp" event={"ID":"e4e810c5-6e22-4618-88d8-dd8c006bd13f","Type":"ContainerStarted","Data":"cd7056e3e675557f5638adf80aebf41d8e05ba8823fb7c345ef2295a98a3a5a5"} Jul 01 20:18:08.573784 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.573717 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5bn7l" event={"ID":"67cccb88-4445-405a-a931-b0f6d16b532a","Type":"ContainerStarted","Data":"df3803ff3c82978ca54c7dea05cd0cc449bc4229d9a9291e06772d006e48bdd0"} Jul 01 20:18:08.576923 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.576881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" event={"ID":"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5","Type":"ContainerStarted","Data":"e3a454e811be7ce5089b3e20f17934fdad6f8143e3e046a520d76685531d5c92"} Jul 01 20:18:08.577171 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.577110 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:08.577306 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.577274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" event={"ID":"1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5","Type":"ContainerStarted","Data":"5e452325d427d5fcf0b947b2f7e65f31ead10894fc015e1605251da8bfb44519"} Jul 01 20:18:08.600649 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:08.599929 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" podStartSLOduration=2.599911198 podStartE2EDuration="2.599911198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:08.599202967 +0000 UTC m=+54.807512212" watchObservedRunningTime="2026-07-01 20:18:08.599911198 +0000 UTC m=+54.808220442" Jul 01 20:18:09.722442 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:09.722410 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5"] Jul 01 20:18:09.752031 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:09.751996 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5"] Jul 01 20:18:09.752188 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:09.752140 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" Jul 01 20:18:09.755295 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:09.755267 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 20:18:09.755425 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:09.755307 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-drtm6\"" Jul 01 20:18:09.795185 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:09.795155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3a92cb29-d9df-4e33-a598-2e9f7fd37f6d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rjkr5\" (UID: \"3a92cb29-d9df-4e33-a598-2e9f7fd37f6d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" Jul 01 20:18:09.895653 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:09.895619 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3a92cb29-d9df-4e33-a598-2e9f7fd37f6d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rjkr5\" (UID: \"3a92cb29-d9df-4e33-a598-2e9f7fd37f6d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" Jul 01 20:18:09.895810 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:09.895792 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 01 20:18:09.895889 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:09.895874 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a92cb29-d9df-4e33-a598-2e9f7fd37f6d-tls-certificates podName:3a92cb29-d9df-4e33-a598-2e9f7fd37f6d nodeName:}" failed. No retries permitted until 2026-07-01 20:18:10.395850364 +0000 UTC m=+56.604159597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3a92cb29-d9df-4e33-a598-2e9f7fd37f6d-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" (UID: "3a92cb29-d9df-4e33-a598-2e9f7fd37f6d") : secret "prometheus-operator-admission-webhook-tls" not found Jul 01 20:18:10.400902 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:10.400867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3a92cb29-d9df-4e33-a598-2e9f7fd37f6d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rjkr5\" (UID: \"3a92cb29-d9df-4e33-a598-2e9f7fd37f6d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" Jul 01 20:18:10.403394 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:10.403366 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3a92cb29-d9df-4e33-a598-2e9f7fd37f6d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rjkr5\" (UID: \"3a92cb29-d9df-4e33-a598-2e9f7fd37f6d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" Jul 01 20:18:10.664109 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:10.664018 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" Jul 01 20:18:13.067617 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:13.066953 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5"] Jul 01 20:18:13.591508 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:13.591473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fh72z" event={"ID":"c70c9714-0f1f-406a-a810-bb4328cdeacc","Type":"ContainerStarted","Data":"383dc4c2bba32a7cd6cd35daef895e0291d3053f2384f90212d42bd5be98922f"} Jul 01 20:18:13.591680 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:13.591531 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fh72z" event={"ID":"c70c9714-0f1f-406a-a810-bb4328cdeacc","Type":"ContainerStarted","Data":"d52c6a4d248ae302b86c9a5d53f22a6fc49c6a45b745470e8b090e873b1a9c6c"} Jul 01 20:18:13.591680 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:13.591563 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:13.592868 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:13.592845 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxmhp" event={"ID":"e4e810c5-6e22-4618-88d8-dd8c006bd13f","Type":"ContainerStarted","Data":"fe71cbbdd6b6d1afababc712844c1a58e0e794e6e541542f8a37d144836e8ac1"} Jul 01 20:18:13.594365 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:13.594337 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5bn7l" event={"ID":"67cccb88-4445-405a-a931-b0f6d16b532a","Type":"ContainerStarted","Data":"12066cf51d5666b945a7170d86f8e466442559082493a668afb6b9ed19e57f79"} Jul 01 20:18:13.595438 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:13.595418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" event={"ID":"3a92cb29-d9df-4e33-a598-2e9f7fd37f6d","Type":"ContainerStarted","Data":"a436573ee0941640a4469bc85cbb8480a323b723518349b5b35d63bb9913485b"} Jul 01 20:18:13.617533 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:13.617495 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fh72z" podStartSLOduration=1.7979384170000001 podStartE2EDuration="6.61748199s" totalImagesPullingTime="4.819543573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:13.617345275 +0000 UTC m=+59.825654520" watchObservedRunningTime="2026-07-01 20:18:13.61748199 +0000 UTC m=+59.825791212" Jul 01 20:18:13.639148 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:13.639094 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5bn7l" podStartSLOduration=1.428219857 podStartE2EDuration="6.639077198s" totalImagesPullingTime="5.210857341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:13.637836742 +0000 UTC m=+59.846145987" watchObservedRunningTime="2026-07-01 20:18:13.639077198 +0000 UTC m=+59.847386434" Jul 01 20:18:14.600961 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:14.600922 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxmhp" event={"ID":"e4e810c5-6e22-4618-88d8-dd8c006bd13f","Type":"ContainerStarted","Data":"0bfe13fa5cd7d9df8b1777b5b2b54e0e0d28b027afcc388628a017951e282c2d"} Jul 01 20:18:15.525351 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:15.525322 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b74d4" Jul 01 20:18:15.606401 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:15.606362 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" event={"ID":"3a92cb29-d9df-4e33-a598-2e9f7fd37f6d","Type":"ContainerStarted","Data":"64b62b3841b82a8db0e5d602b26c9e3e185030719bc409517a7fe89021a9d3d4"} Jul 01 20:18:15.606780 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:15.606590 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" Jul 01 20:18:15.611034 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:15.611015 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" Jul 01 20:18:15.626733 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:15.626686 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rjkr5" podStartSLOduration=5.081675527 podStartE2EDuration="6.626672164s" totalImagesPullingTime="1.544996637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:15.625614969 +0000 UTC m=+61.833924212" watchObservedRunningTime="2026-07-01 20:18:15.626672164 +0000 UTC m=+61.834981385" Jul 01 20:18:17.614914 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:17.614883 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxmhp" event={"ID":"e4e810c5-6e22-4618-88d8-dd8c006bd13f","Type":"ContainerStarted","Data":"fb1f969c5131d917f8ac9ab1d09830f460110ec313e867ed335e229ab41496c1"} Jul 01 20:18:17.640385 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:17.640322 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cxmhp" podStartSLOduration=1.682972542 podStartE2EDuration="10.64030924s" totalImagesPullingTime="8.957336698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:18:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:17.639487968 +0000 UTC m=+63.847797211" watchObservedRunningTime="2026-07-01 20:18:17.64030924 +0000 UTC m=+63.848618479" Jul 01 20:18:20.073011 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.072972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:18:20.073011 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.073012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:18:20.073492 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.073043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddcl\" (UniqueName: \"kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl\") pod \"network-check-target-vx9mb\" (UID: \"6a96f009-0de6-4770-9561-d57ced585983\") " pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:18:20.076086 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.076068 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 20:18:20.077123 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.077105 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 20:18:20.077209 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.077192 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 20:18:20.085608 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.085587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30acf1f4-d2f9-4ec5-8344-8fea6a81513d-metrics-certs\") pod \"network-metrics-daemon-5dbjk\" (UID: \"30acf1f4-d2f9-4ec5-8344-8fea6a81513d\") " pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:18:20.085719 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.085702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95b6f23d-fd06-4986-b91b-45e323a8ba3f-original-pull-secret\") pod \"global-pull-secret-syncer-bcwn6\" (UID: \"95b6f23d-fd06-4986-b91b-45e323a8ba3f\") " pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:18:20.085967 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.085950 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 20:18:20.096096 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.096071 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jddcl\" (UniqueName: \"kubernetes.io/projected/6a96f009-0de6-4770-9561-d57ced585983-kube-api-access-jddcl\") pod \"network-check-target-vx9mb\" (UID: \"6a96f009-0de6-4770-9561-d57ced585983\") " pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:18:20.235846 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.235827 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zpvfj\"" Jul 01 20:18:20.243581 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.243566 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dbjk" Jul 01 20:18:20.259560 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.259539 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9s48\"" Jul 01 20:18:20.264957 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.264940 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bcwn6" Jul 01 20:18:20.266665 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.266641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:18:20.382279 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.382251 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5dbjk"] Jul 01 20:18:20.384630 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:20.384601 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30acf1f4_d2f9_4ec5_8344_8fea6a81513d.slice/crio-69096024e0a08c20069e40ef623530d5f0fa3893abeaa0ce09d8b1dde5d67a5e WatchSource:0}: Error finding container 69096024e0a08c20069e40ef623530d5f0fa3893abeaa0ce09d8b1dde5d67a5e: Status 404 returned error can't find the container with id 69096024e0a08c20069e40ef623530d5f0fa3893abeaa0ce09d8b1dde5d67a5e Jul 01 20:18:20.396191 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.396170 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bcwn6"] Jul 01 20:18:20.398805 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:20.398785 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b6f23d_fd06_4986_b91b_45e323a8ba3f.slice/crio-33bba120c24db4cfe573e06ad25d12618bbb901afe1da4c21db927ee7545a916 WatchSource:0}: Error finding container 33bba120c24db4cfe573e06ad25d12618bbb901afe1da4c21db927ee7545a916: Status 404 returned error can't find the container with id 33bba120c24db4cfe573e06ad25d12618bbb901afe1da4c21db927ee7545a916 Jul 01 20:18:20.417798 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.417769 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vx9mb"] Jul 01 20:18:20.420705 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:20.420684 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a96f009_0de6_4770_9561_d57ced585983.slice/crio-775c8f4baeb9626bd5f9a439122bf15a9645f5aa939d0e0be760f72be55bc6c4 WatchSource:0}: Error finding container 775c8f4baeb9626bd5f9a439122bf15a9645f5aa939d0e0be760f72be55bc6c4: Status 404 returned error can't find the container with id 775c8f4baeb9626bd5f9a439122bf15a9645f5aa939d0e0be760f72be55bc6c4 Jul 01 20:18:20.625238 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.625180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dbjk" event={"ID":"30acf1f4-d2f9-4ec5-8344-8fea6a81513d","Type":"ContainerStarted","Data":"69096024e0a08c20069e40ef623530d5f0fa3893abeaa0ce09d8b1dde5d67a5e"} Jul 01 20:18:20.626262 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.626240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vx9mb" event={"ID":"6a96f009-0de6-4770-9561-d57ced585983","Type":"ContainerStarted","Data":"775c8f4baeb9626bd5f9a439122bf15a9645f5aa939d0e0be760f72be55bc6c4"} Jul 01 20:18:20.627312 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:20.627293 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bcwn6" event={"ID":"95b6f23d-fd06-4986-b91b-45e323a8ba3f","Type":"ContainerStarted","Data":"33bba120c24db4cfe573e06ad25d12618bbb901afe1da4c21db927ee7545a916"} Jul 01 20:18:21.633436 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:21.633343 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dbjk" event={"ID":"30acf1f4-d2f9-4ec5-8344-8fea6a81513d","Type":"ContainerStarted","Data":"c607eef565939fc85e47e4915bf1f5fa5144af066020dc735ea865d45278a90c"} Jul 01 20:18:21.633436 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:21.633391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dbjk" event={"ID":"30acf1f4-d2f9-4ec5-8344-8fea6a81513d","Type":"ContainerStarted","Data":"689b83133119aa7e0568942e8d44f2eb8dfec61be0b9ac695541eb3345a63ad8"} Jul 01 20:18:21.652964 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:21.652917 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5dbjk" podStartSLOduration=65.684220627 podStartE2EDuration="1m6.652901548s" totalImagesPullingTime="968.680921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:21.65114481 +0000 UTC m=+67.859454054" watchObservedRunningTime="2026-07-01 20:18:21.652901548 +0000 UTC m=+67.861210790" Jul 01 20:18:23.603142 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:23.603114 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fh72z" Jul 01 20:18:24.647218 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:24.647179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vx9mb" event={"ID":"6a96f009-0de6-4770-9561-d57ced585983","Type":"ContainerStarted","Data":"54d49d1a00b69773e1e1e65babccbf012dc922eef294e3d0f63dc8ceefa28f06"} Jul 01 20:18:24.647640 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:24.647331 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:18:24.664739 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:24.664686 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vx9mb" podStartSLOduration=65.795983041 podStartE2EDuration="1m9.664668408s" totalImagesPullingTime="3.868685367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:24.663889083 +0000 UTC m=+70.872198328" watchObservedRunningTime="2026-07-01 20:18:24.664668408 +0000 UTC m=+70.872977653" Jul 01 20:18:25.157957 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.157929 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l6lmc"] Jul 01 20:18:25.160881 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.160858 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.163816 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.163796 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 20:18:25.163934 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.163819 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 20:18:25.164941 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.164908 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 20:18:25.164941 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.164921 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x9pq4\"" Jul 01 20:18:25.164941 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.164937 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 20:18:25.165182 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.164961 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 20:18:25.165182 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.165166 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 20:18:25.212926 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.212893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879292c5-a443-4890-949d-5e650decee29-metrics-client-ca\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.213046 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.212937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879292c5-a443-4890-949d-5e650decee29-node-exporter-textfile\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.213046 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.212982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879292c5-a443-4890-949d-5e650decee29-sys\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.213046 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.213034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879292c5-a443-4890-949d-5e650decee29-node-exporter-tls\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.213216 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.213076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879292c5-a443-4890-949d-5e650decee29-root\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.213216 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.213103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879292c5-a443-4890-949d-5e650decee29-node-exporter-wtmp\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.213216 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.213144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879292c5-a443-4890-949d-5e650decee29-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.213340 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.213220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879292c5-a443-4890-949d-5e650decee29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.213340 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.213251 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg6bd\" (UniqueName: \"kubernetes.io/projected/879292c5-a443-4890-949d-5e650decee29-kube-api-access-xg6bd\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314226 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879292c5-a443-4890-949d-5e650decee29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314226 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg6bd\" (UniqueName: \"kubernetes.io/projected/879292c5-a443-4890-949d-5e650decee29-kube-api-access-xg6bd\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314426 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879292c5-a443-4890-949d-5e650decee29-metrics-client-ca\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314426 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879292c5-a443-4890-949d-5e650decee29-node-exporter-textfile\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314426 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879292c5-a443-4890-949d-5e650decee29-sys\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314426 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879292c5-a443-4890-949d-5e650decee29-node-exporter-tls\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314426 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879292c5-a443-4890-949d-5e650decee29-root\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314426 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879292c5-a443-4890-949d-5e650decee29-node-exporter-wtmp\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314721 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879292c5-a443-4890-949d-5e650decee29-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314721 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314457 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879292c5-a443-4890-949d-5e650decee29-sys\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314721 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879292c5-a443-4890-949d-5e650decee29-root\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.314859 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:25.314746 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 20:18:25.314859 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:25.314823 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/879292c5-a443-4890-949d-5e650decee29-node-exporter-tls podName:879292c5-a443-4890-949d-5e650decee29 nodeName:}" failed. No retries permitted until 2026-07-01 20:18:25.814800278 +0000 UTC m=+72.023109533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/879292c5-a443-4890-949d-5e650decee29-node-exporter-tls") pod "node-exporter-l6lmc" (UID: "879292c5-a443-4890-949d-5e650decee29") : secret "node-exporter-tls" not found Jul 01 20:18:25.314859 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.314839 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879292c5-a443-4890-949d-5e650decee29-node-exporter-wtmp\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.315110 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.315089 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879292c5-a443-4890-949d-5e650decee29-node-exporter-textfile\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.315176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.315097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879292c5-a443-4890-949d-5e650decee29-metrics-client-ca\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.315229 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.315209 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879292c5-a443-4890-949d-5e650decee29-node-exporter-accelerators-collector-config\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.317289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.317268 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879292c5-a443-4890-949d-5e650decee29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.324137 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.324115 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg6bd\" (UniqueName: \"kubernetes.io/projected/879292c5-a443-4890-949d-5e650decee29-kube-api-access-xg6bd\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.818115 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.818092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879292c5-a443-4890-949d-5e650decee29-node-exporter-tls\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:25.820265 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:25.820242 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879292c5-a443-4890-949d-5e650decee29-node-exporter-tls\") pod \"node-exporter-l6lmc\" (UID: \"879292c5-a443-4890-949d-5e650decee29\") " pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:26.071472 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.071442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l6lmc" Jul 01 20:18:26.082107 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:26.082078 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879292c5_a443_4890_949d_5e650decee29.slice/crio-17308e5cad77b8770e9605d77195fea3343e412256e1f666c43d905110f684fa WatchSource:0}: Error finding container 17308e5cad77b8770e9605d77195fea3343e412256e1f666c43d905110f684fa: Status 404 returned error can't find the container with id 17308e5cad77b8770e9605d77195fea3343e412256e1f666c43d905110f684fa Jul 01 20:18:26.220555 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.220524 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 20:18:26.224799 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.224782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.228385 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.228358 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 20:18:26.228495 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.228482 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 20:18:26.228566 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.228364 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 20:18:26.228834 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.228817 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 20:18:26.229018 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.229001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 20:18:26.229450 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.229004 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j8kfz\"" Jul 01 20:18:26.230181 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.230158 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 20:18:26.230296 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.230202 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 20:18:26.230296 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.230163 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 20:18:26.230296 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.230213 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 20:18:26.241767 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.241747 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 20:18:26.322028 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.321959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322028 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.321994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322028 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322261 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-config-volume\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322261 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpxtk\" (UniqueName: \"kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-kube-api-access-hpxtk\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322261 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-config-out\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322261 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322261 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322261 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-web-config\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322561 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322561 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322561 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.322561 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.322362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.422979 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.422954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-config-volume\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423102 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.422984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxtk\" (UniqueName: \"kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-kube-api-access-hpxtk\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423102 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423000 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-config-out\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423102 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423102 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423102 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-web-config\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423102 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.423703 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.423639 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.424790 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.424478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.424790 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.424748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.426587 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.426176 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.426587 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.426365 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-config-out\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.426587 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.426459 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.426587 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.426511 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.426587 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.426569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-web-config\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.426887 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.426756 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.426887 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.426844 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.427261 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.427243 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-config-volume\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.427862 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.427838 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.431412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.431394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpxtk\" (UniqueName: \"kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-kube-api-access-hpxtk\") pod \"alertmanager-main-0\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.537543 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.537519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:18:26.656339 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.656307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bcwn6" event={"ID":"95b6f23d-fd06-4986-b91b-45e323a8ba3f","Type":"ContainerStarted","Data":"36b6e0d25229260ca6c9c9becb5e3d071d0f71c059988b55b64219cf6db4d61f"} Jul 01 20:18:26.657895 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.657867 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6lmc" event={"ID":"879292c5-a443-4890-949d-5e650decee29","Type":"ContainerStarted","Data":"17308e5cad77b8770e9605d77195fea3343e412256e1f666c43d905110f684fa"} Jul 01 20:18:26.673119 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.673040 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bcwn6" podStartSLOduration=66.301437686 podStartE2EDuration="1m11.673023406s" totalImagesPullingTime="5.37158572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:26.672962837 +0000 UTC m=+72.881272081" watchObservedRunningTime="2026-07-01 20:18:26.673023406 +0000 UTC m=+72.881332650" Jul 01 20:18:26.686569 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:26.686544 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 20:18:26.689448 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:26.689419 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a855f82_5882_45bc_81cd_22442ee14fa6.slice/crio-4ca5d25159bad9dbe03e3eb292ef6dcef8191983ed25b3a779d8bb36cab19067 WatchSource:0}: Error finding container 4ca5d25159bad9dbe03e3eb292ef6dcef8191983ed25b3a779d8bb36cab19067: Status 404 returned error can't find the container with id 4ca5d25159bad9dbe03e3eb292ef6dcef8191983ed25b3a779d8bb36cab19067 Jul 01 20:18:27.503654 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:27.503620 2578 patch_prober.go:28] interesting pod/image-registry-54fccf8966-l7vfq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 20:18:27.503985 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:27.503672 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" podUID="1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 20:18:27.663795 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:27.663745 2578 generic.go:356] "Generic (PLEG): container finished" podID="879292c5-a443-4890-949d-5e650decee29" containerID="9e9fe4c4e3b550d2d3f767206e87ffc679b77003dd887f5a9ad23b66db1b66d1" exitCode=0 Jul 01 20:18:27.663949 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:27.663842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6lmc" event={"ID":"879292c5-a443-4890-949d-5e650decee29","Type":"ContainerDied","Data":"9e9fe4c4e3b550d2d3f767206e87ffc679b77003dd887f5a9ad23b66db1b66d1"} Jul 01 20:18:27.665215 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:27.665193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerStarted","Data":"4ca5d25159bad9dbe03e3eb292ef6dcef8191983ed25b3a779d8bb36cab19067"} Jul 01 20:18:28.124912 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.124850 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5"] Jul 01 20:18:28.128125 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.128110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.130902 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.130873 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 20:18:28.131029 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.130939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 20:18:28.131029 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.130950 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 20:18:28.131029 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.130953 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dqoqhpu13i4uc\"" Jul 01 20:18:28.131229 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.130939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 20:18:28.131325 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.131309 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vcq2j\"" Jul 01 20:18:28.131392 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.131347 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 20:18:28.147212 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.147189 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5"] Jul 01 20:18:28.237564 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.237537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.237695 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.237569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.237695 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.237591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.237695 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.237609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79825\" (UniqueName: \"kubernetes.io/projected/b223771d-b6a3-40fa-9d91-b753b8af4c58-kube-api-access-79825\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.237695 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.237678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b223771d-b6a3-40fa-9d91-b753b8af4c58-metrics-client-ca\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.237847 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.237719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-grpc-tls\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.237847 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.237741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-tls\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.237847 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.237760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.338012 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.337986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.338128 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.338018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.338128 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.338038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.338128 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.338071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79825\" (UniqueName: \"kubernetes.io/projected/b223771d-b6a3-40fa-9d91-b753b8af4c58-kube-api-access-79825\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.338242 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.338196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b223771d-b6a3-40fa-9d91-b753b8af4c58-metrics-client-ca\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.338282 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.338247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-grpc-tls\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.338282 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.338272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-tls\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.338365 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.338302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.338943 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.338917 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b223771d-b6a3-40fa-9d91-b753b8af4c58-metrics-client-ca\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.340993 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.340964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.341151 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.341127 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.341232 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.341167 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.341295 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.341241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.341368 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.341352 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-grpc-tls\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.341418 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.341362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b223771d-b6a3-40fa-9d91-b753b8af4c58-secret-thanos-querier-tls\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.348032 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.348009 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79825\" (UniqueName: \"kubernetes.io/projected/b223771d-b6a3-40fa-9d91-b753b8af4c58-kube-api-access-79825\") pod \"thanos-querier-dfd8bf9dc-rnlp5\" (UID: \"b223771d-b6a3-40fa-9d91-b753b8af4c58\") " pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.436925 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.436870 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:28.565411 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.565388 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5"] Jul 01 20:18:28.567535 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:28.567509 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb223771d_b6a3_40fa_9d91_b753b8af4c58.slice/crio-848e081e2e70ca7ebe201fd530ed1c9b5d04e6d8844ea62b3a3d536b2764ec17 WatchSource:0}: Error finding container 848e081e2e70ca7ebe201fd530ed1c9b5d04e6d8844ea62b3a3d536b2764ec17: Status 404 returned error can't find the container with id 848e081e2e70ca7ebe201fd530ed1c9b5d04e6d8844ea62b3a3d536b2764ec17 Jul 01 20:18:28.669812 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.669778 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" event={"ID":"b223771d-b6a3-40fa-9d91-b753b8af4c58","Type":"ContainerStarted","Data":"848e081e2e70ca7ebe201fd530ed1c9b5d04e6d8844ea62b3a3d536b2764ec17"} Jul 01 20:18:28.672048 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.672024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6lmc" event={"ID":"879292c5-a443-4890-949d-5e650decee29","Type":"ContainerStarted","Data":"b2f7b0821dff9515b750d3616c8a309f2a30223bf3b6cf0f44a2f4cef841160f"} Jul 01 20:18:28.672180 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.672081 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l6lmc" event={"ID":"879292c5-a443-4890-949d-5e650decee29","Type":"ContainerStarted","Data":"0e98f6ace9d3f3cd423e4211679a71919a773d6c5f1856fa8c094f2aaaef80fc"} Jul 01 20:18:28.673855 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.673833 2578 generic.go:356] "Generic (PLEG): container finished" podID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerID="ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c" exitCode=0 Jul 01 20:18:28.673941 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.673911 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerDied","Data":"ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c"} Jul 01 20:18:28.692174 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:28.692097 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l6lmc" podStartSLOduration=2.695976501 podStartE2EDuration="3.692078525s" totalImagesPullingTime="934.318327ms" totalInitContainerRuntime="61.783697ms" isStatefulPod=true podCreationTimestamp="2026-07-01 20:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:28.6905342 +0000 UTC m=+74.898843443" watchObservedRunningTime="2026-07-01 20:18:28.692078525 +0000 UTC m=+74.900387765" Jul 01 20:18:29.469702 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.469666 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5c97bdddb5-m65vq"] Jul 01 20:18:29.473128 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.473105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.477940 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.477760 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bgcpo96id7fq3\"" Jul 01 20:18:29.477940 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.477775 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kwvct\"" Jul 01 20:18:29.477940 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.477786 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 20:18:29.477940 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.477789 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 20:18:29.477940 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.477897 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 20:18:29.478295 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.478107 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 20:18:29.484201 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.484179 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c97bdddb5-m65vq"] Jul 01 20:18:29.547641 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.547610 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f1a98db9-b63a-4156-a767-424c03e412ad-metrics-server-audit-profiles\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.547756 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.547660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1a98db9-b63a-4156-a767-424c03e412ad-client-ca-bundle\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.547756 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.547692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f1a98db9-b63a-4156-a767-424c03e412ad-secret-metrics-server-client-certs\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.547756 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.547717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f1a98db9-b63a-4156-a767-424c03e412ad-audit-log\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.547935 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.547764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnht2\" (UniqueName: \"kubernetes.io/projected/f1a98db9-b63a-4156-a767-424c03e412ad-kube-api-access-cnht2\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.547935 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.547807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f1a98db9-b63a-4156-a767-424c03e412ad-secret-metrics-server-tls\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.547935 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.547831 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a98db9-b63a-4156-a767-424c03e412ad-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.648295 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.648258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f1a98db9-b63a-4156-a767-424c03e412ad-secret-metrics-server-tls\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.648707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.648296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a98db9-b63a-4156-a767-424c03e412ad-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.648707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.648351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f1a98db9-b63a-4156-a767-424c03e412ad-metrics-server-audit-profiles\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.648707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.648464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1a98db9-b63a-4156-a767-424c03e412ad-client-ca-bundle\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.648707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.648507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f1a98db9-b63a-4156-a767-424c03e412ad-secret-metrics-server-client-certs\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.648707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.648530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f1a98db9-b63a-4156-a767-424c03e412ad-audit-log\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.648707 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.648584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnht2\" (UniqueName: \"kubernetes.io/projected/f1a98db9-b63a-4156-a767-424c03e412ad-kube-api-access-cnht2\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.649265 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.649033 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1a98db9-b63a-4156-a767-424c03e412ad-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.649448 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.649420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f1a98db9-b63a-4156-a767-424c03e412ad-metrics-server-audit-profiles\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.649551 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.649438 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f1a98db9-b63a-4156-a767-424c03e412ad-audit-log\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.651320 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.651286 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f1a98db9-b63a-4156-a767-424c03e412ad-secret-metrics-server-client-certs\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.651503 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.651479 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1a98db9-b63a-4156-a767-424c03e412ad-client-ca-bundle\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.651611 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.651515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f1a98db9-b63a-4156-a767-424c03e412ad-secret-metrics-server-tls\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.657496 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.657474 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnht2\" (UniqueName: \"kubernetes.io/projected/f1a98db9-b63a-4156-a767-424c03e412ad-kube-api-access-cnht2\") pod \"metrics-server-5c97bdddb5-m65vq\" (UID: \"f1a98db9-b63a-4156-a767-424c03e412ad\") " pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.786747 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.786682 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:29.902563 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.902528 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-krbkf"] Jul 01 20:18:29.906776 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.906748 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:29.909496 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.909475 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xkrgj\"" Jul 01 20:18:29.909630 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.909534 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 20:18:29.915020 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:29.914995 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-krbkf"] Jul 01 20:18:30.050865 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.050791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nvpd\" (UniqueName: \"kubernetes.io/projected/0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc-kube-api-access-2nvpd\") pod \"monitoring-plugin-cd8656b8-krbkf\" (UID: \"0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:30.050865 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.050837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-krbkf\" (UID: \"0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:30.151422 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.151386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-krbkf\" (UID: \"0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:30.151592 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.151499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nvpd\" (UniqueName: \"kubernetes.io/projected/0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc-kube-api-access-2nvpd\") pod \"monitoring-plugin-cd8656b8-krbkf\" (UID: \"0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:30.151592 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:30.151563 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 01 20:18:30.151713 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:18:30.151646 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc-monitoring-plugin-cert podName:0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc nodeName:}" failed. No retries permitted until 2026-07-01 20:18:30.651624019 +0000 UTC m=+76.859933243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-krbkf" (UID: "0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc") : secret "monitoring-plugin-cert" not found Jul 01 20:18:30.160912 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.160883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nvpd\" (UniqueName: \"kubernetes.io/projected/0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc-kube-api-access-2nvpd\") pod \"monitoring-plugin-cd8656b8-krbkf\" (UID: \"0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:30.273671 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.273645 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c97bdddb5-m65vq"] Jul 01 20:18:30.275337 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:30.275313 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a98db9_b63a_4156_a767_424c03e412ad.slice/crio-33e795a2ad79b7562fa50e30be217ca17ff206f6b939c145004c3bc86eedb6b9 WatchSource:0}: Error finding container 33e795a2ad79b7562fa50e30be217ca17ff206f6b939c145004c3bc86eedb6b9: Status 404 returned error can't find the container with id 33e795a2ad79b7562fa50e30be217ca17ff206f6b939c145004c3bc86eedb6b9 Jul 01 20:18:30.339342 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.339316 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b77f56865-vc8zt"] Jul 01 20:18:30.343938 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.343916 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.346824 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.346799 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 20:18:30.346941 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.346834 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 20:18:30.347148 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.347121 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 20:18:30.347233 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.347202 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 20:18:30.347233 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.347215 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qdx78\"" Jul 01 20:18:30.347563 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.347543 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 20:18:30.352830 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.352809 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 20:18:30.357175 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.357151 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b77f56865-vc8zt"] Jul 01 20:18:30.455074 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.453815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7046366b-bb41-44b8-9239-a4c7d8d97f20-metrics-client-ca\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.455074 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.453917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.455074 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.453956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qn98\" (UniqueName: \"kubernetes.io/projected/7046366b-bb41-44b8-9239-a4c7d8d97f20-kube-api-access-6qn98\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.455074 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.454012 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-telemeter-client-tls\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.455074 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.454039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7046366b-bb41-44b8-9239-a4c7d8d97f20-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.455074 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.454090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7046366b-bb41-44b8-9239-a4c7d8d97f20-serving-certs-ca-bundle\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.455074 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.454116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-secret-telemeter-client\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.455074 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.454155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-federate-client-tls\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.477999 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.477976 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c6497f847-lsqj8"] Jul 01 20:18:30.482197 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.482183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.485537 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.485353 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 20:18:30.485537 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.485372 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-48cxh\"" Jul 01 20:18:30.485537 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.485373 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 20:18:30.485537 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.485389 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 20:18:30.485537 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.485510 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 20:18:30.485537 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.485513 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 20:18:30.485861 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.485546 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 20:18:30.485990 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.485973 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 20:18:30.489634 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.489606 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 20:18:30.492214 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.492193 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6497f847-lsqj8"] Jul 01 20:18:30.555324 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7046366b-bb41-44b8-9239-a4c7d8d97f20-metrics-client-ca\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.555400 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-service-ca\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.555452 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.555452 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz25z\" (UniqueName: \"kubernetes.io/projected/e68bb141-6906-43fc-92f2-380c3b1c5a9f-kube-api-access-dz25z\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.555565 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-oauth-serving-cert\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.555565 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-config\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.555565 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qn98\" (UniqueName: \"kubernetes.io/projected/7046366b-bb41-44b8-9239-a4c7d8d97f20-kube-api-access-6qn98\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.555827 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-trusted-ca-bundle\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.555827 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-oauth-config\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.555827 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-telemeter-client-tls\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.555827 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-serving-cert\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.555827 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7046366b-bb41-44b8-9239-a4c7d8d97f20-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.555827 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7046366b-bb41-44b8-9239-a4c7d8d97f20-serving-certs-ca-bundle\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.555827 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-secret-telemeter-client\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.555827 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.555820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-federate-client-tls\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.556470 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.556232 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7046366b-bb41-44b8-9239-a4c7d8d97f20-metrics-client-ca\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.556578 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.556560 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7046366b-bb41-44b8-9239-a4c7d8d97f20-serving-certs-ca-bundle\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.557014 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.556992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7046366b-bb41-44b8-9239-a4c7d8d97f20-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.559089 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.558579 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.559089 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.559024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-federate-client-tls\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.559291 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.559135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-telemeter-client-tls\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.559438 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.559417 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7046366b-bb41-44b8-9239-a4c7d8d97f20-secret-telemeter-client\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.566469 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.566444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qn98\" (UniqueName: \"kubernetes.io/projected/7046366b-bb41-44b8-9239-a4c7d8d97f20-kube-api-access-6qn98\") pod \"telemeter-client-5b77f56865-vc8zt\" (UID: \"7046366b-bb41-44b8-9239-a4c7d8d97f20\") " pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.586703 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.586658 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54fccf8966-l7vfq" Jul 01 20:18:30.655560 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.655518 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" Jul 01 20:18:30.656761 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.656737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-oauth-config\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.656893 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.656771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-serving-cert\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.656893 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.656835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-service-ca\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.657080 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.657039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-krbkf\" (UID: \"0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:30.657185 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.657155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz25z\" (UniqueName: \"kubernetes.io/projected/e68bb141-6906-43fc-92f2-380c3b1c5a9f-kube-api-access-dz25z\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.657273 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.657190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-oauth-serving-cert\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.657273 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.657215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-config\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.657273 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.657247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-trusted-ca-bundle\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.657739 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.657711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-service-ca\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.658430 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.658407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-config\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.658590 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.658514 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-oauth-serving-cert\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.659000 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.658905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-trusted-ca-bundle\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.661013 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.660990 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-oauth-config\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.661224 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.661195 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-krbkf\" (UID: \"0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:30.661523 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.661482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-serving-cert\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.669651 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.669632 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz25z\" (UniqueName: \"kubernetes.io/projected/e68bb141-6906-43fc-92f2-380c3b1c5a9f-kube-api-access-dz25z\") pod \"console-5c6497f847-lsqj8\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.684891 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.684863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerStarted","Data":"a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de"} Jul 01 20:18:30.684995 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.684956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerStarted","Data":"3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3"} Jul 01 20:18:30.684995 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.684983 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerStarted","Data":"3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe"} Jul 01 20:18:30.685104 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.685008 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerStarted","Data":"80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2"} Jul 01 20:18:30.685104 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.685033 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerStarted","Data":"7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f"} Jul 01 20:18:30.686200 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.686176 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" event={"ID":"f1a98db9-b63a-4156-a767-424c03e412ad","Type":"ContainerStarted","Data":"33e795a2ad79b7562fa50e30be217ca17ff206f6b939c145004c3bc86eedb6b9"} Jul 01 20:18:30.786299 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.786240 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b77f56865-vc8zt"] Jul 01 20:18:30.793638 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.793615 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:30.817880 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:30.817816 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:31.271131 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:31.271035 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7046366b_bb41_44b8_9239_a4c7d8d97f20.slice/crio-02caafcc908e1c200700465bc52546a4b0c28e1b94af4ee330563bbb3fc94238 WatchSource:0}: Error finding container 02caafcc908e1c200700465bc52546a4b0c28e1b94af4ee330563bbb3fc94238: Status 404 returned error can't find the container with id 02caafcc908e1c200700465bc52546a4b0c28e1b94af4ee330563bbb3fc94238 Jul 01 20:18:31.424360 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:31.424333 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6497f847-lsqj8"] Jul 01 20:18:31.443190 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:31.443145 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-krbkf"] Jul 01 20:18:31.692457 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:31.692420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" event={"ID":"b223771d-b6a3-40fa-9d91-b753b8af4c58","Type":"ContainerStarted","Data":"f04c12eb05b3283dd0b115c4ebd47bdb018515f59b17702fc74f829ff5c078da"} Jul 01 20:18:31.693762 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:31.693738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" event={"ID":"7046366b-bb41-44b8-9239-a4c7d8d97f20","Type":"ContainerStarted","Data":"02caafcc908e1c200700465bc52546a4b0c28e1b94af4ee330563bbb3fc94238"} Jul 01 20:18:31.797171 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:31.797135 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ced35dd_1b4b_4193_8f27_56aa9ea6ffbc.slice/crio-d7a8f3edb31c4bbac711a3b578f132448c38191f6f2841342a5e3d81bc60cb34 WatchSource:0}: Error finding container d7a8f3edb31c4bbac711a3b578f132448c38191f6f2841342a5e3d81bc60cb34: Status 404 returned error can't find the container with id d7a8f3edb31c4bbac711a3b578f132448c38191f6f2841342a5e3d81bc60cb34 Jul 01 20:18:31.918562 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:31.918533 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68bb141_6906_43fc_92f2_380c3b1c5a9f.slice/crio-eef4c0d04c92a1c56f541a7e403f8684cc6d4c11c7780f576c8c90c76d0b7e56 WatchSource:0}: Error finding container eef4c0d04c92a1c56f541a7e403f8684cc6d4c11c7780f576c8c90c76d0b7e56: Status 404 returned error can't find the container with id eef4c0d04c92a1c56f541a7e403f8684cc6d4c11c7780f576c8c90c76d0b7e56 Jul 01 20:18:32.704630 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.704466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerStarted","Data":"a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6"} Jul 01 20:18:32.706523 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.706493 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" event={"ID":"f1a98db9-b63a-4156-a767-424c03e412ad","Type":"ContainerStarted","Data":"d6ed12c2d3c8488104908b0ea18a8688c5367a8653359c24fb16d47577ca18f5"} Jul 01 20:18:32.708001 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.707973 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6497f847-lsqj8" event={"ID":"e68bb141-6906-43fc-92f2-380c3b1c5a9f","Type":"ContainerStarted","Data":"eef4c0d04c92a1c56f541a7e403f8684cc6d4c11c7780f576c8c90c76d0b7e56"} Jul 01 20:18:32.712349 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.712317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" event={"ID":"b223771d-b6a3-40fa-9d91-b753b8af4c58","Type":"ContainerStarted","Data":"ea58586beccd0e5b5b83f2d9b3091696a4e918dd46a32e6edc818acbc8b9fca0"} Jul 01 20:18:32.712456 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.712389 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" event={"ID":"b223771d-b6a3-40fa-9d91-b753b8af4c58","Type":"ContainerStarted","Data":"248a6652470b4a537903e695efd6e2d46f626b456af8cbc371fb47dd36930703"} Jul 01 20:18:32.712456 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.712429 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" event={"ID":"b223771d-b6a3-40fa-9d91-b753b8af4c58","Type":"ContainerStarted","Data":"6d6ab4c576922e6ab0cc90e02b1100eb62280fbd6d5ca7ed78debe36564ff759"} Jul 01 20:18:32.712572 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.712469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" event={"ID":"b223771d-b6a3-40fa-9d91-b753b8af4c58","Type":"ContainerStarted","Data":"92595707471a61259b6c24bd0b172f42b4cb17a685097c841bd07742dadc6d37"} Jul 01 20:18:32.712572 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.712508 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" event={"ID":"b223771d-b6a3-40fa-9d91-b753b8af4c58","Type":"ContainerStarted","Data":"ad5c428e785cd0f42a6e01668006ab831b55c949a15701b4791255f8b5e5285f"} Jul 01 20:18:32.712572 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.712554 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:32.714028 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.714004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" event={"ID":"0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc","Type":"ContainerStarted","Data":"d7a8f3edb31c4bbac711a3b578f132448c38191f6f2841342a5e3d81bc60cb34"} Jul 01 20:18:32.738911 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.738857 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.576181669 podStartE2EDuration="6.738838684s" totalImagesPullingTime="4.146334065s" totalInitContainerRuntime="16.32295ms" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:32.737339928 +0000 UTC m=+78.945649172" watchObservedRunningTime="2026-07-01 20:18:32.738838684 +0000 UTC m=+78.947147928" Jul 01 20:18:32.764117 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.764042 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" podStartSLOduration=1.9945484900000001 podStartE2EDuration="4.764018835s" totalImagesPullingTime="2.769470345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:32.762767238 +0000 UTC m=+78.971076481" watchObservedRunningTime="2026-07-01 20:18:32.764018835 +0000 UTC m=+78.972328103" Jul 01 20:18:32.789565 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:32.789506 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" podStartSLOduration=2.092116861 podStartE2EDuration="3.78948254s" totalImagesPullingTime="1.697365679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:32.787945971 +0000 UTC m=+78.996255218" watchObservedRunningTime="2026-07-01 20:18:32.78948254 +0000 UTC m=+78.997791784" Jul 01 20:18:35.730726 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:35.730685 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6497f847-lsqj8" event={"ID":"e68bb141-6906-43fc-92f2-380c3b1c5a9f","Type":"ContainerStarted","Data":"2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e"} Jul 01 20:18:35.732726 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:35.732700 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" event={"ID":"7046366b-bb41-44b8-9239-a4c7d8d97f20","Type":"ContainerStarted","Data":"b1820bbb63eb8de9e4d47b4a846b3f5d483260a95e4d728a002d7c38afd9fe99"} Jul 01 20:18:35.732846 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:35.732754 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" event={"ID":"7046366b-bb41-44b8-9239-a4c7d8d97f20","Type":"ContainerStarted","Data":"342e5d2d12ed3d2669e730671c9580a93f2ab93a2151125d8c4915c690334d18"} Jul 01 20:18:35.732846 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:35.732781 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" event={"ID":"7046366b-bb41-44b8-9239-a4c7d8d97f20","Type":"ContainerStarted","Data":"a41b987caefb2916d27aba54812844239e4357a67a79bd48bec79a23856ea279"} Jul 01 20:18:35.734035 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:35.734017 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" event={"ID":"0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc","Type":"ContainerStarted","Data":"84bee01518e961a3f14f1a8e3a308400776687d514a9a69ac066b3d7c78f0b7a"} Jul 01 20:18:35.734148 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:35.734137 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:35.738975 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:35.738953 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" Jul 01 20:18:35.755988 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:35.755944 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c6497f847-lsqj8" podStartSLOduration=2.628227504 podStartE2EDuration="5.755929122s" totalImagesPullingTime="3.127701618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:35.754122937 +0000 UTC m=+81.962432180" watchObservedRunningTime="2026-07-01 20:18:35.755929122 +0000 UTC m=+81.964238364" Jul 01 20:18:35.775198 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:35.775147 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-krbkf" podStartSLOduration=3.552991264 podStartE2EDuration="6.775127367s" totalImagesPullingTime="3.222136103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:35.77489327 +0000 UTC m=+81.983202515" watchObservedRunningTime="2026-07-01 20:18:35.775127367 +0000 UTC m=+81.983436610" Jul 01 20:18:35.806070 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:35.806009 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b77f56865-vc8zt" podStartSLOduration=2.058502581 podStartE2EDuration="5.805994191s" totalImagesPullingTime="3.74749161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:35.803527254 +0000 UTC m=+82.011836497" watchObservedRunningTime="2026-07-01 20:18:35.805994191 +0000 UTC m=+82.014303433" Jul 01 20:18:36.657978 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.657854 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6497f847-lsqj8"] Jul 01 20:18:36.698871 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.698834 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c845bc687-pxbnb"] Jul 01 20:18:36.703361 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.703338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.715955 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.715925 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c845bc687-pxbnb"] Jul 01 20:18:36.812811 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.812769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-console-config\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.813282 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.812837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-service-ca\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.813282 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.812893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrflw\" (UniqueName: \"kubernetes.io/projected/26efe538-5da1-4885-b577-dc2049a32f99-kube-api-access-vrflw\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.813282 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.813118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-oauth-config\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.813282 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.813153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-serving-cert\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.813282 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.813219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-oauth-serving-cert\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.813563 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.813286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-trusted-ca-bundle\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.913890 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.913798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-oauth-config\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.913890 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.913845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-serving-cert\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.913890 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.913873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-oauth-serving-cert\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.914194 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.913902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-trusted-ca-bundle\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.914194 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.913932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-console-config\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.914194 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.913959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-service-ca\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.914194 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.913993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrflw\" (UniqueName: \"kubernetes.io/projected/26efe538-5da1-4885-b577-dc2049a32f99-kube-api-access-vrflw\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.914696 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.914671 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-console-config\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.914828 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.914806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-service-ca\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.914912 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.914893 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-trusted-ca-bundle\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.914956 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.914933 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-oauth-serving-cert\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.916331 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.916311 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-serving-cert\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.916396 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.916347 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-oauth-config\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:36.922750 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:36.922730 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrflw\" (UniqueName: \"kubernetes.io/projected/26efe538-5da1-4885-b577-dc2049a32f99-kube-api-access-vrflw\") pod \"console-7c845bc687-pxbnb\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:37.012452 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:37.012414 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:37.143480 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:37.143448 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c845bc687-pxbnb"] Jul 01 20:18:37.145538 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:18:37.145509 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26efe538_5da1_4885_b577_dc2049a32f99.slice/crio-ac6a3f9d8ebd2a826147c4c756071834cd73eff66a472d0bff54386b4ee4282b WatchSource:0}: Error finding container ac6a3f9d8ebd2a826147c4c756071834cd73eff66a472d0bff54386b4ee4282b: Status 404 returned error can't find the container with id ac6a3f9d8ebd2a826147c4c756071834cd73eff66a472d0bff54386b4ee4282b Jul 01 20:18:37.742638 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:37.742596 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c845bc687-pxbnb" event={"ID":"26efe538-5da1-4885-b577-dc2049a32f99","Type":"ContainerStarted","Data":"6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24"} Jul 01 20:18:37.742812 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:37.742657 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c845bc687-pxbnb" event={"ID":"26efe538-5da1-4885-b577-dc2049a32f99","Type":"ContainerStarted","Data":"ac6a3f9d8ebd2a826147c4c756071834cd73eff66a472d0bff54386b4ee4282b"} Jul 01 20:18:37.776387 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:37.776338 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c845bc687-pxbnb" podStartSLOduration=1.776322148 podStartE2EDuration="1.776322148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:18:37.774879535 +0000 UTC m=+83.983188778" watchObservedRunningTime="2026-07-01 20:18:37.776322148 +0000 UTC m=+83.984631382" Jul 01 20:18:38.725691 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:38.725667 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-dfd8bf9dc-rnlp5" Jul 01 20:18:40.794068 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:40.794023 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:18:47.012566 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:47.012535 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:47.013005 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:47.012593 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:47.017390 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:47.017368 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:47.785923 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:47.785897 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:18:49.787260 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:49.787229 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:49.787682 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:49.787276 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:18:55.652773 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:18:55.652743 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vx9mb" Jul 01 20:19:02.762488 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:02.762397 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c6497f847-lsqj8" podUID="e68bb141-6906-43fc-92f2-380c3b1c5a9f" containerName="console" containerID="cri-o://2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e" gracePeriod=15 Jul 01 20:19:03.010044 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.010018 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:19:03.108646 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.108606 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-trusted-ca-bundle\") pod \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " Jul 01 20:19:03.108646 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.108655 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz25z\" (UniqueName: \"kubernetes.io/projected/e68bb141-6906-43fc-92f2-380c3b1c5a9f-kube-api-access-dz25z\") pod \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " Jul 01 20:19:03.108903 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.108689 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-oauth-config\") pod \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " Jul 01 20:19:03.108903 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.108715 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-serving-cert\") pod \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " Jul 01 20:19:03.108903 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.108755 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-config\") pod \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " Jul 01 20:19:03.108903 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.108784 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-service-ca\") pod \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " Jul 01 20:19:03.108903 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.108812 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-oauth-serving-cert\") pod \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\" (UID: \"e68bb141-6906-43fc-92f2-380c3b1c5a9f\") " Jul 01 20:19:03.109311 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.109278 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e68bb141-6906-43fc-92f2-380c3b1c5a9f" (UID: "e68bb141-6906-43fc-92f2-380c3b1c5a9f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:03.109388 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.109296 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-service-ca" (OuterVolumeSpecName: "service-ca") pod "e68bb141-6906-43fc-92f2-380c3b1c5a9f" (UID: "e68bb141-6906-43fc-92f2-380c3b1c5a9f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:03.109388 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.109285 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-config" (OuterVolumeSpecName: "console-config") pod "e68bb141-6906-43fc-92f2-380c3b1c5a9f" (UID: "e68bb141-6906-43fc-92f2-380c3b1c5a9f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:03.109647 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.109614 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e68bb141-6906-43fc-92f2-380c3b1c5a9f" (UID: "e68bb141-6906-43fc-92f2-380c3b1c5a9f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:03.111003 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.110974 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e68bb141-6906-43fc-92f2-380c3b1c5a9f" (UID: "e68bb141-6906-43fc-92f2-380c3b1c5a9f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:03.111140 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.111011 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68bb141-6906-43fc-92f2-380c3b1c5a9f-kube-api-access-dz25z" (OuterVolumeSpecName: "kube-api-access-dz25z") pod "e68bb141-6906-43fc-92f2-380c3b1c5a9f" (UID: "e68bb141-6906-43fc-92f2-380c3b1c5a9f"). InnerVolumeSpecName "kube-api-access-dz25z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:19:03.111140 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.111025 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e68bb141-6906-43fc-92f2-380c3b1c5a9f" (UID: "e68bb141-6906-43fc-92f2-380c3b1c5a9f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:03.210387 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.210340 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz25z\" (UniqueName: \"kubernetes.io/projected/e68bb141-6906-43fc-92f2-380c3b1c5a9f-kube-api-access-dz25z\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:03.210387 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.210375 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-oauth-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:03.210387 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.210385 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:03.210387 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.210394 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-console-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:03.210387 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.210403 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-service-ca\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:03.210676 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.210411 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-oauth-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:03.210676 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.210418 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68bb141-6906-43fc-92f2-380c3b1c5a9f-trusted-ca-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:03.849216 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.849178 2578 generic.go:356] "Generic (PLEG): container finished" podID="e68bb141-6906-43fc-92f2-380c3b1c5a9f" containerID="2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e" exitCode=0 Jul 01 20:19:03.849611 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.849223 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6497f847-lsqj8" Jul 01 20:19:03.849611 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.849264 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6497f847-lsqj8" event={"ID":"e68bb141-6906-43fc-92f2-380c3b1c5a9f","Type":"ContainerDied","Data":"2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e"} Jul 01 20:19:03.849611 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.849318 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6497f847-lsqj8" event={"ID":"e68bb141-6906-43fc-92f2-380c3b1c5a9f","Type":"ContainerDied","Data":"eef4c0d04c92a1c56f541a7e403f8684cc6d4c11c7780f576c8c90c76d0b7e56"} Jul 01 20:19:03.849611 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.849339 2578 scope.go:117] "RemoveContainer" containerID="2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e" Jul 01 20:19:03.858419 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.858399 2578 scope.go:117] "RemoveContainer" containerID="2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e" Jul 01 20:19:03.858724 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:19:03.858703 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e\": container with ID starting with 2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e not found: ID does not exist" containerID="2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e" Jul 01 20:19:03.858776 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.858733 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e"} err="failed to get container status \"2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e\": rpc error: code = NotFound desc = could not find container \"2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e\": container with ID starting with 2796f6f7ff8d5d65c336fe925703af3ffab38fa65a511a3a8930ca8b71f4b23e not found: ID does not exist" Jul 01 20:19:03.870840 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.870810 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6497f847-lsqj8"] Jul 01 20:19:03.876606 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:03.876579 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c6497f847-lsqj8"] Jul 01 20:19:04.225782 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:04.225709 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e68bb141-6906-43fc-92f2-380c3b1c5a9f" path="/var/lib/kubelet/pods/e68bb141-6906-43fc-92f2-380c3b1c5a9f/volumes" Jul 01 20:19:09.793439 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:09.793408 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:19:09.797402 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:09.797372 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5c97bdddb5-m65vq" Jul 01 20:19:45.414648 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:45.414606 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 20:19:45.415272 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:45.415033 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="alertmanager" containerID="cri-o://7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f" gracePeriod=120 Jul 01 20:19:45.415272 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:45.415107 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy-metric" containerID="cri-o://a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de" gracePeriod=120 Jul 01 20:19:45.415272 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:45.415125 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy-web" containerID="cri-o://3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe" gracePeriod=120 Jul 01 20:19:45.415272 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:45.415158 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="prom-label-proxy" containerID="cri-o://a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6" gracePeriod=120 Jul 01 20:19:45.415272 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:45.415125 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy" containerID="cri-o://3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3" gracePeriod=120 Jul 01 20:19:45.415272 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:45.415195 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="config-reloader" containerID="cri-o://80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2" gracePeriod=120 Jul 01 20:19:46.009515 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.009484 2578 generic.go:356] "Generic (PLEG): container finished" podID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerID="a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6" exitCode=0 Jul 01 20:19:46.009515 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.009508 2578 generic.go:356] "Generic (PLEG): container finished" podID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerID="3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3" exitCode=0 Jul 01 20:19:46.009515 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.009516 2578 generic.go:356] "Generic (PLEG): container finished" podID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerID="80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2" exitCode=0 Jul 01 20:19:46.009515 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.009522 2578 generic.go:356] "Generic (PLEG): container finished" podID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerID="7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f" exitCode=0 Jul 01 20:19:46.009758 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.009548 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerDied","Data":"a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6"} Jul 01 20:19:46.009758 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.009614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerDied","Data":"3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3"} Jul 01 20:19:46.009758 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.009642 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerDied","Data":"80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2"} Jul 01 20:19:46.009758 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.009668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerDied","Data":"7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f"} Jul 01 20:19:46.651572 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.651545 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:46.724683 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724625 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.724683 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724660 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpxtk\" (UniqueName: \"kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-kube-api-access-hpxtk\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.724869 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724684 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-metrics-client-ca\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.724869 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724702 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-main-db\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.724869 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724723 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.724869 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724776 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-trusted-ca-bundle\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.724869 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724821 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-config-out\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.724869 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724849 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-tls-assets\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.725181 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724905 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-main-tls\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.725181 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724930 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-web-config\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.725181 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.724974 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-cluster-tls-config\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.725181 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.725004 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-config-volume\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.725181 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.725034 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-web\") pod \"6a855f82-5882-45bc-81cd-22442ee14fa6\" (UID: \"6a855f82-5882-45bc-81cd-22442ee14fa6\") " Jul 01 20:19:46.725418 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.725125 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:46.725418 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.725297 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:19:46.725418 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.725338 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-metrics-client-ca\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.726191 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.725724 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:19:46.727516 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.727485 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:46.727876 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.727839 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:46.728521 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.728496 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:19:46.728723 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.728698 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-config-out" (OuterVolumeSpecName: "config-out") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:19:46.728941 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.728902 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:46.729154 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.729129 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-kube-api-access-hpxtk" (OuterVolumeSpecName: "kube-api-access-hpxtk") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "kube-api-access-hpxtk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:19:46.729154 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.729143 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-config-volume" (OuterVolumeSpecName: "config-volume") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:46.729296 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.729260 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:46.733409 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.733385 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:46.739148 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.739128 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-web-config" (OuterVolumeSpecName: "web-config") pod "6a855f82-5882-45bc-81cd-22442ee14fa6" (UID: "6a855f82-5882-45bc-81cd-22442ee14fa6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:19:46.826255 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826229 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpxtk\" (UniqueName: \"kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-kube-api-access-hpxtk\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826255 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826253 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-main-db\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826268 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826281 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a855f82-5882-45bc-81cd-22442ee14fa6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826294 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a855f82-5882-45bc-81cd-22442ee14fa6-config-out\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826305 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a855f82-5882-45bc-81cd-22442ee14fa6-tls-assets\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826317 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-main-tls\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826331 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-web-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826344 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-cluster-tls-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826355 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-config-volume\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826367 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:46.826412 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:46.826381 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6a855f82-5882-45bc-81cd-22442ee14fa6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:19:47.017012 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.016950 2578 generic.go:356] "Generic (PLEG): container finished" podID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerID="a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de" exitCode=0 Jul 01 20:19:47.017012 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.016977 2578 generic.go:356] "Generic (PLEG): container finished" podID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerID="3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe" exitCode=0 Jul 01 20:19:47.017146 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.017012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerDied","Data":"a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de"} Jul 01 20:19:47.017146 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.017073 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.017146 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.017099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerDied","Data":"3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe"} Jul 01 20:19:47.017146 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.017135 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6a855f82-5882-45bc-81cd-22442ee14fa6","Type":"ContainerDied","Data":"4ca5d25159bad9dbe03e3eb292ef6dcef8191983ed25b3a779d8bb36cab19067"} Jul 01 20:19:47.017272 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.017170 2578 scope.go:117] "RemoveContainer" containerID="a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6" Jul 01 20:19:47.025093 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.024960 2578 scope.go:117] "RemoveContainer" containerID="a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de" Jul 01 20:19:47.032067 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.032037 2578 scope.go:117] "RemoveContainer" containerID="3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3" Jul 01 20:19:47.039163 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.039139 2578 scope.go:117] "RemoveContainer" containerID="3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe" Jul 01 20:19:47.045864 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.045842 2578 scope.go:117] "RemoveContainer" containerID="80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2" Jul 01 20:19:47.046625 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.046606 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 20:19:47.051367 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.051345 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 20:19:47.053085 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.053073 2578 scope.go:117] "RemoveContainer" containerID="7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f" Jul 01 20:19:47.059992 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.059976 2578 scope.go:117] "RemoveContainer" containerID="ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c" Jul 01 20:19:47.066407 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.066391 2578 scope.go:117] "RemoveContainer" containerID="a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6" Jul 01 20:19:47.066671 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:19:47.066654 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6\": container with ID starting with a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6 not found: ID does not exist" containerID="a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6" Jul 01 20:19:47.066713 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.066679 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6"} err="failed to get container status \"a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6\": rpc error: code = NotFound desc = could not find container \"a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6\": container with ID starting with a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6 not found: ID does not exist" Jul 01 20:19:47.066713 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.066697 2578 scope.go:117] "RemoveContainer" containerID="a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de" Jul 01 20:19:47.066932 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:19:47.066914 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de\": container with ID starting with a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de not found: ID does not exist" containerID="a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de" Jul 01 20:19:47.066971 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.066939 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de"} err="failed to get container status \"a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de\": rpc error: code = NotFound desc = could not find container \"a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de\": container with ID starting with a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de not found: ID does not exist" Jul 01 20:19:47.066971 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.066953 2578 scope.go:117] "RemoveContainer" containerID="3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3" Jul 01 20:19:47.067199 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:19:47.067182 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3\": container with ID starting with 3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3 not found: ID does not exist" containerID="3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3" Jul 01 20:19:47.067249 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.067204 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3"} err="failed to get container status \"3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3\": rpc error: code = NotFound desc = could not find container \"3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3\": container with ID starting with 3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3 not found: ID does not exist" Jul 01 20:19:47.067249 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.067220 2578 scope.go:117] "RemoveContainer" containerID="3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe" Jul 01 20:19:47.067424 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:19:47.067406 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe\": container with ID starting with 3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe not found: ID does not exist" containerID="3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe" Jul 01 20:19:47.067495 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.067432 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe"} err="failed to get container status \"3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe\": rpc error: code = NotFound desc = could not find container \"3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe\": container with ID starting with 3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe not found: ID does not exist" Jul 01 20:19:47.067495 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.067453 2578 scope.go:117] "RemoveContainer" containerID="80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2" Jul 01 20:19:47.067683 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:19:47.067664 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2\": container with ID starting with 80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2 not found: ID does not exist" containerID="80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2" Jul 01 20:19:47.067723 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.067691 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2"} err="failed to get container status \"80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2\": rpc error: code = NotFound desc = could not find container \"80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2\": container with ID starting with 80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2 not found: ID does not exist" Jul 01 20:19:47.067723 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.067709 2578 scope.go:117] "RemoveContainer" containerID="7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f" Jul 01 20:19:47.067922 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:19:47.067907 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f\": container with ID starting with 7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f not found: ID does not exist" containerID="7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f" Jul 01 20:19:47.067966 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.067924 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f"} err="failed to get container status \"7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f\": rpc error: code = NotFound desc = could not find container \"7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f\": container with ID starting with 7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f not found: ID does not exist" Jul 01 20:19:47.067966 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.067938 2578 scope.go:117] "RemoveContainer" containerID="ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c" Jul 01 20:19:47.068160 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:19:47.068143 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c\": container with ID starting with ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c not found: ID does not exist" containerID="ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c" Jul 01 20:19:47.068205 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.068165 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c"} err="failed to get container status \"ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c\": rpc error: code = NotFound desc = could not find container \"ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c\": container with ID starting with ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c not found: ID does not exist" Jul 01 20:19:47.068205 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.068179 2578 scope.go:117] "RemoveContainer" containerID="a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6" Jul 01 20:19:47.068404 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.068386 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6"} err="failed to get container status \"a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6\": rpc error: code = NotFound desc = could not find container \"a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6\": container with ID starting with a2c79390a1147219e2a8aefb23f962104f3abf60131ea4d6804be2d92c98d8a6 not found: ID does not exist" Jul 01 20:19:47.068447 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.068405 2578 scope.go:117] "RemoveContainer" containerID="a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de" Jul 01 20:19:47.068637 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.068621 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de"} err="failed to get container status \"a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de\": rpc error: code = NotFound desc = could not find container \"a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de\": container with ID starting with a679271477b75b610e09eb2d14f0246e9b02fd05ea3caf7c23ebfe138a0d08de not found: ID does not exist" Jul 01 20:19:47.068733 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.068638 2578 scope.go:117] "RemoveContainer" containerID="3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3" Jul 01 20:19:47.068808 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.068794 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3"} err="failed to get container status \"3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3\": rpc error: code = NotFound desc = could not find container \"3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3\": container with ID starting with 3056436de27942d99989241a36c9f12aa6b80a79fa0b927d9fe8f223b32247b3 not found: ID does not exist" Jul 01 20:19:47.068808 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.068807 2578 scope.go:117] "RemoveContainer" containerID="3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe" Jul 01 20:19:47.069012 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.068994 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe"} err="failed to get container status \"3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe\": rpc error: code = NotFound desc = could not find container \"3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe\": container with ID starting with 3b68c9229552fc40c0e5af256ce8bcbebf7b0f3031bcaf6cfa483c526d250cfe not found: ID does not exist" Jul 01 20:19:47.069096 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.069014 2578 scope.go:117] "RemoveContainer" containerID="80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2" Jul 01 20:19:47.069322 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.069304 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2"} err="failed to get container status \"80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2\": rpc error: code = NotFound desc = could not find container \"80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2\": container with ID starting with 80fb0e4b43d0ee97636a0941285cc894fc716768b27401a263df399c170c13e2 not found: ID does not exist" Jul 01 20:19:47.069396 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.069323 2578 scope.go:117] "RemoveContainer" containerID="7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f" Jul 01 20:19:47.069558 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.069539 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f"} err="failed to get container status \"7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f\": rpc error: code = NotFound desc = could not find container \"7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f\": container with ID starting with 7a8108f5729947a1150420bde8c8b55905ba60ecdc4c04ce4c624c766dec9e2f not found: ID does not exist" Jul 01 20:19:47.069605 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.069559 2578 scope.go:117] "RemoveContainer" containerID="ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c" Jul 01 20:19:47.069781 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.069762 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c"} err="failed to get container status \"ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c\": rpc error: code = NotFound desc = could not find container \"ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c\": container with ID starting with ab5092877410b1c0c5bfbc029b446b83cdd045a7bb5016b8746ff4616547d73c not found: ID does not exist" Jul 01 20:19:47.082194 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082146 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 20:19:47.082416 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082405 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="alertmanager" Jul 01 20:19:47.082456 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082418 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="alertmanager" Jul 01 20:19:47.082456 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082425 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy-web" Jul 01 20:19:47.082456 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082430 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy-web" Jul 01 20:19:47.082456 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082442 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68bb141-6906-43fc-92f2-380c3b1c5a9f" containerName="console" Jul 01 20:19:47.082456 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082447 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68bb141-6906-43fc-92f2-380c3b1c5a9f" containerName="console" Jul 01 20:19:47.082456 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082454 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="prom-label-proxy" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082459 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="prom-label-proxy" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082465 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="init-config-reloader" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082470 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="init-config-reloader" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082476 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082481 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082492 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy-metric" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082497 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy-metric" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082505 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="config-reloader" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082512 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="config-reloader" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082548 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="alertmanager" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082556 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy-metric" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082561 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy-web" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082567 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68bb141-6906-43fc-92f2-380c3b1c5a9f" containerName="console" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082572 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="prom-label-proxy" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082579 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="config-reloader" Jul 01 20:19:47.082627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.082584 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" containerName="kube-rbac-proxy" Jul 01 20:19:47.086181 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.086166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.089446 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.089423 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 20:19:47.089589 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.089571 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 20:19:47.089669 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.089655 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 20:19:47.090087 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.089771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j8kfz\"" Jul 01 20:19:47.090087 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.089798 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 20:19:47.090087 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.089818 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 20:19:47.090087 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.089833 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 20:19:47.090087 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.089935 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 20:19:47.090087 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.089947 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 20:19:47.095403 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.095386 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 20:19:47.100824 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.100805 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 20:19:47.127688 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.127668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-web-config\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.127771 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.127693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.127771 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.127720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.127836 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.127792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z2d6\" (UniqueName: \"kubernetes.io/projected/e7665232-5799-4f6e-a049-727c48fe7d78-kube-api-access-8z2d6\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.127869 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.127841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7665232-5799-4f6e-a049-727c48fe7d78-config-out\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.127911 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.127874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7665232-5799-4f6e-a049-727c48fe7d78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.127911 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.127902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.127973 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.127940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7665232-5799-4f6e-a049-727c48fe7d78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.127973 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.127965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7665232-5799-4f6e-a049-727c48fe7d78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.128033 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.127986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-config-volume\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.128033 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.128012 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.128033 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.128029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.128144 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.128044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7665232-5799-4f6e-a049-727c48fe7d78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228621 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228704 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z2d6\" (UniqueName: \"kubernetes.io/projected/e7665232-5799-4f6e-a049-727c48fe7d78-kube-api-access-8z2d6\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228704 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7665232-5799-4f6e-a049-727c48fe7d78-config-out\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228704 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7665232-5799-4f6e-a049-727c48fe7d78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228704 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228918 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7665232-5799-4f6e-a049-727c48fe7d78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228918 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7665232-5799-4f6e-a049-727c48fe7d78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228918 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-config-volume\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228918 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228918 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228918 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7665232-5799-4f6e-a049-727c48fe7d78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228918 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-web-config\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.228918 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.228901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.231879 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.231846 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7665232-5799-4f6e-a049-727c48fe7d78-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.232162 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.232138 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7665232-5799-4f6e-a049-727c48fe7d78-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.232162 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.232157 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7665232-5799-4f6e-a049-727c48fe7d78-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.233143 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.232409 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7665232-5799-4f6e-a049-727c48fe7d78-config-out\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.233143 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.232420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-web-config\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.233143 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.232517 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-config-volume\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.233143 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.232994 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e7665232-5799-4f6e-a049-727c48fe7d78-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.233143 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.233004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.233143 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.233101 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.233466 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.233218 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.237105 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.233698 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.237105 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.233888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e7665232-5799-4f6e-a049-727c48fe7d78-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.237849 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.237828 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z2d6\" (UniqueName: \"kubernetes.io/projected/e7665232-5799-4f6e-a049-727c48fe7d78-kube-api-access-8z2d6\") pod \"alertmanager-main-0\" (UID: \"e7665232-5799-4f6e-a049-727c48fe7d78\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.396185 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.396158 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 20:19:47.544864 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:47.544837 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 20:19:47.546482 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:19:47.546452 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7665232_5799_4f6e_a049_727c48fe7d78.slice/crio-2b35bb2ae35e7c28bf3ea4d3ec5a325fd852cc5ad5a91820fb2465288d145081 WatchSource:0}: Error finding container 2b35bb2ae35e7c28bf3ea4d3ec5a325fd852cc5ad5a91820fb2465288d145081: Status 404 returned error can't find the container with id 2b35bb2ae35e7c28bf3ea4d3ec5a325fd852cc5ad5a91820fb2465288d145081 Jul 01 20:19:48.023376 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:48.023332 2578 generic.go:356] "Generic (PLEG): container finished" podID="e7665232-5799-4f6e-a049-727c48fe7d78" containerID="df64b3075fe05c0dc5ba8790631830581087d3c33edd763b23a658170fde3943" exitCode=0 Jul 01 20:19:48.023692 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:48.023385 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7665232-5799-4f6e-a049-727c48fe7d78","Type":"ContainerDied","Data":"df64b3075fe05c0dc5ba8790631830581087d3c33edd763b23a658170fde3943"} Jul 01 20:19:48.023692 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:48.023434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7665232-5799-4f6e-a049-727c48fe7d78","Type":"ContainerStarted","Data":"2b35bb2ae35e7c28bf3ea4d3ec5a325fd852cc5ad5a91820fb2465288d145081"} Jul 01 20:19:48.228636 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:48.228606 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a855f82-5882-45bc-81cd-22442ee14fa6" path="/var/lib/kubelet/pods/6a855f82-5882-45bc-81cd-22442ee14fa6/volumes" Jul 01 20:19:49.030732 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:49.030694 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7665232-5799-4f6e-a049-727c48fe7d78","Type":"ContainerStarted","Data":"abcfef458b3832966382f722111317788c577b3a70cfa1748dafbac2ecea8502"} Jul 01 20:19:49.031113 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:49.030779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7665232-5799-4f6e-a049-727c48fe7d78","Type":"ContainerStarted","Data":"37a1f11de464fd6d4ac75e9695169d824c698c73497e4828182bc130d31e9064"} Jul 01 20:19:49.031113 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:49.030820 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7665232-5799-4f6e-a049-727c48fe7d78","Type":"ContainerStarted","Data":"a394bcc76e676a3d5e85a0cf519dde8c784e6b9b9958a787a03a1e6aff1c8505"} Jul 01 20:19:49.031113 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:49.030863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7665232-5799-4f6e-a049-727c48fe7d78","Type":"ContainerStarted","Data":"18926f138344d0eeff0d6fdad0bb1b116a2432ddefc88168b7964f9bc8bcf6e0"} Jul 01 20:19:49.031113 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:49.030897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7665232-5799-4f6e-a049-727c48fe7d78","Type":"ContainerStarted","Data":"3ffcfe459c0bf8ed107060ac4d2999cbf1cb2e407053074cafaf85d1fac1e69b"} Jul 01 20:19:49.031113 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:49.030932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e7665232-5799-4f6e-a049-727c48fe7d78","Type":"ContainerStarted","Data":"3b76c3d70fffc6897376454e20e2630dcba9e5b747e423c68de00a7b6a8a9143"} Jul 01 20:19:49.060933 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:19:49.060883 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.045684843 podStartE2EDuration="2.060867848s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.183005ms" isStatefulPod=false podCreationTimestamp="2026-07-01 20:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:19:49.058398249 +0000 UTC m=+155.266707493" watchObservedRunningTime="2026-07-01 20:19:49.060867848 +0000 UTC m=+155.269177105" Jul 01 20:20:10.122796 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.122715 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ddf5bf8c5-pjwt2"] Jul 01 20:20:10.125227 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.125208 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.137988 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.137962 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddf5bf8c5-pjwt2"] Jul 01 20:20:10.190106 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.190080 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-console-config\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.190213 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.190113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-oauth-config\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.190213 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.190136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-serving-cert\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.190213 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.190184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-oauth-serving-cert\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.190213 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.190207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmrm6\" (UniqueName: \"kubernetes.io/projected/53083167-0375-4657-85f2-d572379730e8-kube-api-access-hmrm6\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.190336 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.190251 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-trusted-ca-bundle\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.190336 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.190267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-service-ca\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.291207 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.291180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-trusted-ca-bundle\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.291316 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.291209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-service-ca\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.291316 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.291227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-console-config\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.291316 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.291250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-oauth-config\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.291316 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.291274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-serving-cert\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.291316 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.291300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-oauth-serving-cert\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.291538 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.291333 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmrm6\" (UniqueName: \"kubernetes.io/projected/53083167-0375-4657-85f2-d572379730e8-kube-api-access-hmrm6\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.291995 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.291969 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-service-ca\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.292110 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.292018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-oauth-serving-cert\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.292205 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.292185 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-console-config\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.292246 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.292215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-trusted-ca-bundle\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.293819 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.293792 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-oauth-config\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.293894 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.293863 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-serving-cert\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.299655 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.299636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmrm6\" (UniqueName: \"kubernetes.io/projected/53083167-0375-4657-85f2-d572379730e8-kube-api-access-hmrm6\") pod \"console-7ddf5bf8c5-pjwt2\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.433551 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.433502 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:10.556604 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:10.556581 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddf5bf8c5-pjwt2"] Jul 01 20:20:10.558510 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:20:10.558484 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53083167_0375_4657_85f2_d572379730e8.slice/crio-abbb4f71cc94ebd12a9b7052ccadbe8f4a080036d75b2a3c7bebf3891144b229 WatchSource:0}: Error finding container abbb4f71cc94ebd12a9b7052ccadbe8f4a080036d75b2a3c7bebf3891144b229: Status 404 returned error can't find the container with id abbb4f71cc94ebd12a9b7052ccadbe8f4a080036d75b2a3c7bebf3891144b229 Jul 01 20:20:11.115652 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:11.115619 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddf5bf8c5-pjwt2" event={"ID":"53083167-0375-4657-85f2-d572379730e8","Type":"ContainerStarted","Data":"f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b"} Jul 01 20:20:11.115808 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:11.115666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddf5bf8c5-pjwt2" event={"ID":"53083167-0375-4657-85f2-d572379730e8","Type":"ContainerStarted","Data":"abbb4f71cc94ebd12a9b7052ccadbe8f4a080036d75b2a3c7bebf3891144b229"} Jul 01 20:20:11.136645 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:11.136599 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ddf5bf8c5-pjwt2" podStartSLOduration=1.136584079 podStartE2EDuration="1.136584079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:20:11.135798371 +0000 UTC m=+177.344107615" watchObservedRunningTime="2026-07-01 20:20:11.136584079 +0000 UTC m=+177.344893322" Jul 01 20:20:20.434608 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:20.434573 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:20.435100 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:20.434641 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:20.439537 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:20.439515 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:21.156947 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:21.156913 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:20:21.210523 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:21.210497 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c845bc687-pxbnb"] Jul 01 20:20:42.098456 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.098422 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv"] Jul 01 20:20:42.101737 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.101721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.104552 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.104532 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 20:20:42.105718 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.105704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kjvjv\"" Jul 01 20:20:42.105771 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.105742 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 20:20:42.112401 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.112375 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv"] Jul 01 20:20:42.201319 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.201292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.201426 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.201327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsnwf\" (UniqueName: \"kubernetes.io/projected/c305976c-c856-45f1-b736-9c1641c229d4-kube-api-access-jsnwf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.201473 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.201423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.302252 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.302230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.302348 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.302256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsnwf\" (UniqueName: \"kubernetes.io/projected/c305976c-c856-45f1-b736-9c1641c229d4-kube-api-access-jsnwf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.302348 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.302295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.302567 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.302549 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.302627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.302612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.311444 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.311418 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsnwf\" (UniqueName: \"kubernetes.io/projected/c305976c-c856-45f1-b736-9c1641c229d4-kube-api-access-jsnwf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.410656 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.410609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:20:42.534863 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:42.534837 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv"] Jul 01 20:20:42.537349 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:20:42.537315 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc305976c_c856_45f1_b736_9c1641c229d4.slice/crio-d76470429ed0a276af427749491dc7cf07d95a426ce89749232d8399982f8df1 WatchSource:0}: Error finding container d76470429ed0a276af427749491dc7cf07d95a426ce89749232d8399982f8df1: Status 404 returned error can't find the container with id d76470429ed0a276af427749491dc7cf07d95a426ce89749232d8399982f8df1 Jul 01 20:20:43.231503 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:43.231463 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" event={"ID":"c305976c-c856-45f1-b736-9c1641c229d4","Type":"ContainerStarted","Data":"d76470429ed0a276af427749491dc7cf07d95a426ce89749232d8399982f8df1"} Jul 01 20:20:46.237230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.237195 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c845bc687-pxbnb" podUID="26efe538-5da1-4885-b577-dc2049a32f99" containerName="console" containerID="cri-o://6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24" gracePeriod=15 Jul 01 20:20:46.473837 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.473815 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:20:46.533226 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533164 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-serving-cert\") pod \"26efe538-5da1-4885-b577-dc2049a32f99\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " Jul 01 20:20:46.533226 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533204 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-oauth-config\") pod \"26efe538-5da1-4885-b577-dc2049a32f99\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " Jul 01 20:20:46.533226 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533222 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-trusted-ca-bundle\") pod \"26efe538-5da1-4885-b577-dc2049a32f99\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " Jul 01 20:20:46.533427 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533238 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-service-ca\") pod \"26efe538-5da1-4885-b577-dc2049a32f99\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " Jul 01 20:20:46.533427 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533342 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-console-config\") pod \"26efe538-5da1-4885-b577-dc2049a32f99\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " Jul 01 20:20:46.533427 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533414 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrflw\" (UniqueName: \"kubernetes.io/projected/26efe538-5da1-4885-b577-dc2049a32f99-kube-api-access-vrflw\") pod \"26efe538-5da1-4885-b577-dc2049a32f99\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " Jul 01 20:20:46.533555 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533472 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-oauth-serving-cert\") pod \"26efe538-5da1-4885-b577-dc2049a32f99\" (UID: \"26efe538-5da1-4885-b577-dc2049a32f99\") " Jul 01 20:20:46.533638 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533613 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-service-ca" (OuterVolumeSpecName: "service-ca") pod "26efe538-5da1-4885-b577-dc2049a32f99" (UID: "26efe538-5da1-4885-b577-dc2049a32f99"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:20:46.533714 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533651 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "26efe538-5da1-4885-b577-dc2049a32f99" (UID: "26efe538-5da1-4885-b577-dc2049a32f99"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:20:46.533714 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533666 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-console-config" (OuterVolumeSpecName: "console-config") pod "26efe538-5da1-4885-b577-dc2049a32f99" (UID: "26efe538-5da1-4885-b577-dc2049a32f99"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:20:46.533875 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533853 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-trusted-ca-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:20:46.533951 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533882 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-service-ca\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:20:46.533951 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533898 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-console-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:20:46.533951 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.533932 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26efe538-5da1-4885-b577-dc2049a32f99" (UID: "26efe538-5da1-4885-b577-dc2049a32f99"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:20:46.535352 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.535329 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26efe538-5da1-4885-b577-dc2049a32f99" (UID: "26efe538-5da1-4885-b577-dc2049a32f99"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:20:46.535352 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.535346 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26efe538-5da1-4885-b577-dc2049a32f99" (UID: "26efe538-5da1-4885-b577-dc2049a32f99"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:20:46.535489 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.535424 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26efe538-5da1-4885-b577-dc2049a32f99-kube-api-access-vrflw" (OuterVolumeSpecName: "kube-api-access-vrflw") pod "26efe538-5da1-4885-b577-dc2049a32f99" (UID: "26efe538-5da1-4885-b577-dc2049a32f99"). InnerVolumeSpecName "kube-api-access-vrflw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:20:46.634597 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.634563 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26efe538-5da1-4885-b577-dc2049a32f99-oauth-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:20:46.634597 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.634595 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:20:46.634597 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.634604 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26efe538-5da1-4885-b577-dc2049a32f99-console-oauth-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:20:46.634763 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:46.634612 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrflw\" (UniqueName: \"kubernetes.io/projected/26efe538-5da1-4885-b577-dc2049a32f99-kube-api-access-vrflw\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:20:47.247521 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:47.247478 2578 generic.go:356] "Generic (PLEG): container finished" podID="26efe538-5da1-4885-b577-dc2049a32f99" containerID="6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24" exitCode=0 Jul 01 20:20:47.247985 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:47.247531 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c845bc687-pxbnb" Jul 01 20:20:47.247985 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:47.247534 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c845bc687-pxbnb" event={"ID":"26efe538-5da1-4885-b577-dc2049a32f99","Type":"ContainerDied","Data":"6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24"} Jul 01 20:20:47.247985 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:47.247660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c845bc687-pxbnb" event={"ID":"26efe538-5da1-4885-b577-dc2049a32f99","Type":"ContainerDied","Data":"ac6a3f9d8ebd2a826147c4c756071834cd73eff66a472d0bff54386b4ee4282b"} Jul 01 20:20:47.247985 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:47.247690 2578 scope.go:117] "RemoveContainer" containerID="6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24" Jul 01 20:20:47.257435 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:47.257269 2578 scope.go:117] "RemoveContainer" containerID="6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24" Jul 01 20:20:47.257550 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:20:47.257515 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24\": container with ID starting with 6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24 not found: ID does not exist" containerID="6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24" Jul 01 20:20:47.258154 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:47.257541 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24"} err="failed to get container status \"6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24\": rpc error: code = NotFound desc = could not find container \"6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24\": container with ID starting with 6514e9a22910232c5f4fd4b5a3f1d0c90cae1917fe4e1f914248257b8138fb24 not found: ID does not exist" Jul 01 20:20:47.272712 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:47.272689 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c845bc687-pxbnb"] Jul 01 20:20:47.278174 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:47.278149 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c845bc687-pxbnb"] Jul 01 20:20:48.227480 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:48.227447 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26efe538-5da1-4885-b577-dc2049a32f99" path="/var/lib/kubelet/pods/26efe538-5da1-4885-b577-dc2049a32f99/volumes" Jul 01 20:20:51.264956 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:51.264925 2578 generic.go:356] "Generic (PLEG): container finished" podID="c305976c-c856-45f1-b736-9c1641c229d4" containerID="f0651564c9386e2b14d34f7b68df1a764754034462b8de16eb97f06cdaa43962" exitCode=0 Jul 01 20:20:51.265325 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:51.265008 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" event={"ID":"c305976c-c856-45f1-b736-9c1641c229d4","Type":"ContainerDied","Data":"f0651564c9386e2b14d34f7b68df1a764754034462b8de16eb97f06cdaa43962"} Jul 01 20:20:54.277593 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:54.277520 2578 generic.go:356] "Generic (PLEG): container finished" podID="c305976c-c856-45f1-b736-9c1641c229d4" containerID="37b3cce1d34c8668fa841f17d565bbf25956b2f67e5521ff8ed4163fadf01990" exitCode=0 Jul 01 20:20:54.277593 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:20:54.277553 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" event={"ID":"c305976c-c856-45f1-b736-9c1641c229d4","Type":"ContainerDied","Data":"37b3cce1d34c8668fa841f17d565bbf25956b2f67e5521ff8ed4163fadf01990"} Jul 01 20:21:02.316094 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:02.316049 2578 generic.go:356] "Generic (PLEG): container finished" podID="c305976c-c856-45f1-b736-9c1641c229d4" containerID="77f29990dd148e3a479c13bfa4fd974a79b80a05a58966faf1190b817d869012" exitCode=0 Jul 01 20:21:02.316454 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:02.316112 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" event={"ID":"c305976c-c856-45f1-b736-9c1641c229d4","Type":"ContainerDied","Data":"77f29990dd148e3a479c13bfa4fd974a79b80a05a58966faf1190b817d869012"} Jul 01 20:21:03.479981 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:03.479959 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:21:03.573985 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:03.573930 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsnwf\" (UniqueName: \"kubernetes.io/projected/c305976c-c856-45f1-b736-9c1641c229d4-kube-api-access-jsnwf\") pod \"c305976c-c856-45f1-b736-9c1641c229d4\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " Jul 01 20:21:03.574119 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:03.574012 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-util\") pod \"c305976c-c856-45f1-b736-9c1641c229d4\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " Jul 01 20:21:03.574119 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:03.574036 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-bundle\") pod \"c305976c-c856-45f1-b736-9c1641c229d4\" (UID: \"c305976c-c856-45f1-b736-9c1641c229d4\") " Jul 01 20:21:03.574684 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:03.574655 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-bundle" (OuterVolumeSpecName: "bundle") pod "c305976c-c856-45f1-b736-9c1641c229d4" (UID: "c305976c-c856-45f1-b736-9c1641c229d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:21:03.575834 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:03.575809 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c305976c-c856-45f1-b736-9c1641c229d4-kube-api-access-jsnwf" (OuterVolumeSpecName: "kube-api-access-jsnwf") pod "c305976c-c856-45f1-b736-9c1641c229d4" (UID: "c305976c-c856-45f1-b736-9c1641c229d4"). InnerVolumeSpecName "kube-api-access-jsnwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:21:03.579044 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:03.579025 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-util" (OuterVolumeSpecName: "util") pod "c305976c-c856-45f1-b736-9c1641c229d4" (UID: "c305976c-c856-45f1-b736-9c1641c229d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:21:03.675463 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:03.675441 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-util\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:21:03.675463 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:03.675460 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c305976c-c856-45f1-b736-9c1641c229d4-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:21:03.675585 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:03.675470 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsnwf\" (UniqueName: \"kubernetes.io/projected/c305976c-c856-45f1-b736-9c1641c229d4-kube-api-access-jsnwf\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:21:04.325923 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:04.325900 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" Jul 01 20:21:04.326069 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:04.325898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxwwfv" event={"ID":"c305976c-c856-45f1-b736-9c1641c229d4","Type":"ContainerDied","Data":"d76470429ed0a276af427749491dc7cf07d95a426ce89749232d8399982f8df1"} Jul 01 20:21:04.326069 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:04.326008 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d76470429ed0a276af427749491dc7cf07d95a426ce89749232d8399982f8df1" Jul 01 20:21:10.081877 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.081847 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w"] Jul 01 20:21:10.082244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.082195 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c305976c-c856-45f1-b736-9c1641c229d4" containerName="util" Jul 01 20:21:10.082244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.082209 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c305976c-c856-45f1-b736-9c1641c229d4" containerName="util" Jul 01 20:21:10.082244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.082226 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26efe538-5da1-4885-b577-dc2049a32f99" containerName="console" Jul 01 20:21:10.082244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.082231 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26efe538-5da1-4885-b577-dc2049a32f99" containerName="console" Jul 01 20:21:10.082244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.082236 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c305976c-c856-45f1-b736-9c1641c229d4" containerName="extract" Jul 01 20:21:10.082244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.082241 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c305976c-c856-45f1-b736-9c1641c229d4" containerName="extract" Jul 01 20:21:10.082244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.082248 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c305976c-c856-45f1-b736-9c1641c229d4" containerName="pull" Jul 01 20:21:10.082443 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.082254 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c305976c-c856-45f1-b736-9c1641c229d4" containerName="pull" Jul 01 20:21:10.082443 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.082294 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c305976c-c856-45f1-b736-9c1641c229d4" containerName="extract" Jul 01 20:21:10.082443 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.082303 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="26efe538-5da1-4885-b577-dc2049a32f99" containerName="console" Jul 01 20:21:10.084083 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.084053 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" Jul 01 20:21:10.086581 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.086560 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:21:10.086705 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.086686 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 01 20:21:10.087108 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.087093 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8wkml\"" Jul 01 20:21:10.097001 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.096979 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w"] Jul 01 20:21:10.220688 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.220661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mq5w\" (UID: \"4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" Jul 01 20:21:10.220797 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.220723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxw6\" (UniqueName: \"kubernetes.io/projected/4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd-kube-api-access-dnxw6\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mq5w\" (UID: \"4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" Jul 01 20:21:10.321096 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.321051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mq5w\" (UID: \"4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" Jul 01 20:21:10.321221 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.321111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxw6\" (UniqueName: \"kubernetes.io/projected/4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd-kube-api-access-dnxw6\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mq5w\" (UID: \"4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" Jul 01 20:21:10.321482 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.321464 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mq5w\" (UID: \"4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" Jul 01 20:21:10.330214 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.330184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxw6\" (UniqueName: \"kubernetes.io/projected/4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd-kube-api-access-dnxw6\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mq5w\" (UID: \"4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" Jul 01 20:21:10.392919 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.392864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" Jul 01 20:21:10.517278 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:10.517252 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w"] Jul 01 20:21:10.519833 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:21:10.519810 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2a7e55_7ba7_4cd0_b208_fd45dc9181cd.slice/crio-015322f7bb4c7abe3f59845ab85de9ae54943b79fb3bd7ec7f188c4c6dd968d4 WatchSource:0}: Error finding container 015322f7bb4c7abe3f59845ab85de9ae54943b79fb3bd7ec7f188c4c6dd968d4: Status 404 returned error can't find the container with id 015322f7bb4c7abe3f59845ab85de9ae54943b79fb3bd7ec7f188c4c6dd968d4 Jul 01 20:21:11.353298 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:11.353265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" event={"ID":"4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd","Type":"ContainerStarted","Data":"015322f7bb4c7abe3f59845ab85de9ae54943b79fb3bd7ec7f188c4c6dd968d4"} Jul 01 20:21:14.366124 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:14.366089 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" event={"ID":"4e2a7e55-7ba7-4cd0-b208-fd45dc9181cd","Type":"ContainerStarted","Data":"e49a2ea7e8467deaf9c30048d08089348e2326d79e855b6571be810744a875da"} Jul 01 20:21:14.396744 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:14.396697 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mq5w" podStartSLOduration=0.963017028 podStartE2EDuration="4.396684446s" totalImagesPullingTime="3.433667418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:21:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:21:14.395193781 +0000 UTC m=+240.603503034" watchObservedRunningTime="2026-07-01 20:21:14.396684446 +0000 UTC m=+240.604993690" Jul 01 20:21:15.043231 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.043201 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm"] Jul 01 20:21:15.046025 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.046010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.052738 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.052716 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 20:21:15.052954 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.052941 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kjvjv\"" Jul 01 20:21:15.053809 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.053795 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 20:21:15.075597 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.075576 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm"] Jul 01 20:21:15.157612 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.157589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfttf\" (UniqueName: \"kubernetes.io/projected/3ba6acb6-ecee-481b-9273-a12d6721f388-kube-api-access-sfttf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.157711 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.157623 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.157711 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.157691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.258718 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.258696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.258821 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.258737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfttf\" (UniqueName: \"kubernetes.io/projected/3ba6acb6-ecee-481b-9273-a12d6721f388-kube-api-access-sfttf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.258821 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.258761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.259032 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.259017 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.259123 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.259086 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.267007 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.266989 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfttf\" (UniqueName: \"kubernetes.io/projected/3ba6acb6-ecee-481b-9273-a12d6721f388-kube-api-access-sfttf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.354547 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.354526 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:15.477745 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:15.477724 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm"] Jul 01 20:21:15.479357 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:21:15.479332 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba6acb6_ecee_481b_9273_a12d6721f388.slice/crio-621ecbb763e582d78227289dbda7a1907fee4187364953b9b645515832a83416 WatchSource:0}: Error finding container 621ecbb763e582d78227289dbda7a1907fee4187364953b9b645515832a83416: Status 404 returned error can't find the container with id 621ecbb763e582d78227289dbda7a1907fee4187364953b9b645515832a83416 Jul 01 20:21:16.375621 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:16.375588 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ba6acb6-ecee-481b-9273-a12d6721f388" containerID="0169d587ab1ee5bf9315618c24770be442a7deface89c97c5c440711cebce1a8" exitCode=0 Jul 01 20:21:16.375749 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:16.375649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" event={"ID":"3ba6acb6-ecee-481b-9273-a12d6721f388","Type":"ContainerDied","Data":"0169d587ab1ee5bf9315618c24770be442a7deface89c97c5c440711cebce1a8"} Jul 01 20:21:16.375749 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:16.375696 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" event={"ID":"3ba6acb6-ecee-481b-9273-a12d6721f388","Type":"ContainerStarted","Data":"621ecbb763e582d78227289dbda7a1907fee4187364953b9b645515832a83416"} Jul 01 20:21:19.388890 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.388863 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ba6acb6-ecee-481b-9273-a12d6721f388" containerID="4c905bc9e9e44d9e72c5e3159b90083de13372f84ebf3ad034c5f9e1d3f8889d" exitCode=0 Jul 01 20:21:19.389240 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.388937 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" event={"ID":"3ba6acb6-ecee-481b-9273-a12d6721f388","Type":"ContainerDied","Data":"4c905bc9e9e44d9e72c5e3159b90083de13372f84ebf3ad034c5f9e1d3f8889d"} Jul 01 20:21:19.803951 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.803928 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt"] Jul 01 20:21:19.805934 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.805920 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" Jul 01 20:21:19.808657 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.808635 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-c9s96\"" Jul 01 20:21:19.808769 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.808636 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 20:21:19.808769 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.808643 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 20:21:19.817642 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.817622 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt"] Jul 01 20:21:19.897225 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.897202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzzsl\" (UniqueName: \"kubernetes.io/projected/52e82156-d79a-42d7-b4e8-72364f0a67ad-kube-api-access-dzzsl\") pod \"cert-manager-cainjector-5d99449ffd-wgjtt\" (UID: \"52e82156-d79a-42d7-b4e8-72364f0a67ad\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" Jul 01 20:21:19.897319 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.897246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52e82156-d79a-42d7-b4e8-72364f0a67ad-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-wgjtt\" (UID: \"52e82156-d79a-42d7-b4e8-72364f0a67ad\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" Jul 01 20:21:19.998034 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.998005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52e82156-d79a-42d7-b4e8-72364f0a67ad-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-wgjtt\" (UID: \"52e82156-d79a-42d7-b4e8-72364f0a67ad\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" Jul 01 20:21:19.998134 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:19.998098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzzsl\" (UniqueName: \"kubernetes.io/projected/52e82156-d79a-42d7-b4e8-72364f0a67ad-kube-api-access-dzzsl\") pod \"cert-manager-cainjector-5d99449ffd-wgjtt\" (UID: \"52e82156-d79a-42d7-b4e8-72364f0a67ad\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" Jul 01 20:21:20.006872 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:20.006849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzzsl\" (UniqueName: \"kubernetes.io/projected/52e82156-d79a-42d7-b4e8-72364f0a67ad-kube-api-access-dzzsl\") pod \"cert-manager-cainjector-5d99449ffd-wgjtt\" (UID: \"52e82156-d79a-42d7-b4e8-72364f0a67ad\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" Jul 01 20:21:20.006949 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:20.006853 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52e82156-d79a-42d7-b4e8-72364f0a67ad-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-wgjtt\" (UID: \"52e82156-d79a-42d7-b4e8-72364f0a67ad\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" Jul 01 20:21:20.126670 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:20.126623 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" Jul 01 20:21:20.275242 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:20.275217 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt"] Jul 01 20:21:20.276974 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:21:20.276947 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52e82156_d79a_42d7_b4e8_72364f0a67ad.slice/crio-807998c2e356a5e0d4ce4b29424da7ec9622d16ff0fbfac10f70107c58889855 WatchSource:0}: Error finding container 807998c2e356a5e0d4ce4b29424da7ec9622d16ff0fbfac10f70107c58889855: Status 404 returned error can't find the container with id 807998c2e356a5e0d4ce4b29424da7ec9622d16ff0fbfac10f70107c58889855 Jul 01 20:21:20.394974 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:20.394914 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ba6acb6-ecee-481b-9273-a12d6721f388" containerID="16675e4fa217e79583bdcd8333f219cdb01a5938ff132949b3f71186a69f456c" exitCode=0 Jul 01 20:21:20.395365 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:20.394986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" event={"ID":"3ba6acb6-ecee-481b-9273-a12d6721f388","Type":"ContainerDied","Data":"16675e4fa217e79583bdcd8333f219cdb01a5938ff132949b3f71186a69f456c"} Jul 01 20:21:20.396198 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:20.396173 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" event={"ID":"52e82156-d79a-42d7-b4e8-72364f0a67ad","Type":"ContainerStarted","Data":"807998c2e356a5e0d4ce4b29424da7ec9622d16ff0fbfac10f70107c58889855"} Jul 01 20:21:21.545948 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:21.545913 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:21.610488 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:21.610460 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfttf\" (UniqueName: \"kubernetes.io/projected/3ba6acb6-ecee-481b-9273-a12d6721f388-kube-api-access-sfttf\") pod \"3ba6acb6-ecee-481b-9273-a12d6721f388\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " Jul 01 20:21:21.610639 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:21.610512 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-util\") pod \"3ba6acb6-ecee-481b-9273-a12d6721f388\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " Jul 01 20:21:21.610639 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:21.610556 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-bundle\") pod \"3ba6acb6-ecee-481b-9273-a12d6721f388\" (UID: \"3ba6acb6-ecee-481b-9273-a12d6721f388\") " Jul 01 20:21:21.611023 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:21.610987 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-bundle" (OuterVolumeSpecName: "bundle") pod "3ba6acb6-ecee-481b-9273-a12d6721f388" (UID: "3ba6acb6-ecee-481b-9273-a12d6721f388"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:21:21.612860 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:21.612813 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ba6acb6-ecee-481b-9273-a12d6721f388-kube-api-access-sfttf" (OuterVolumeSpecName: "kube-api-access-sfttf") pod "3ba6acb6-ecee-481b-9273-a12d6721f388" (UID: "3ba6acb6-ecee-481b-9273-a12d6721f388"). InnerVolumeSpecName "kube-api-access-sfttf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:21:21.615717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:21.615680 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-util" (OuterVolumeSpecName: "util") pod "3ba6acb6-ecee-481b-9273-a12d6721f388" (UID: "3ba6acb6-ecee-481b-9273-a12d6721f388"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:21:21.712129 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:21.712039 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfttf\" (UniqueName: \"kubernetes.io/projected/3ba6acb6-ecee-481b-9273-a12d6721f388-kube-api-access-sfttf\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:21:21.712129 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:21.712089 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-util\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:21:21.712129 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:21.712104 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ba6acb6-ecee-481b-9273-a12d6721f388-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:21:22.414536 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:22.414489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" event={"ID":"3ba6acb6-ecee-481b-9273-a12d6721f388","Type":"ContainerDied","Data":"621ecbb763e582d78227289dbda7a1907fee4187364953b9b645515832a83416"} Jul 01 20:21:22.414536 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:22.414519 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ftxm" Jul 01 20:21:22.414740 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:22.414580 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="621ecbb763e582d78227289dbda7a1907fee4187364953b9b645515832a83416" Jul 01 20:21:23.420846 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:23.420805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" event={"ID":"52e82156-d79a-42d7-b4e8-72364f0a67ad","Type":"ContainerStarted","Data":"060f7bb6946ddeb9928498297ef20cfbde0d7484360d5580da2c975a3bb59002"} Jul 01 20:21:23.443861 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:23.443817 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-wgjtt" podStartSLOduration=2.04765194 podStartE2EDuration="4.443802892s" totalImagesPullingTime="2.396150952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:21:23.443368655 +0000 UTC m=+249.651677896" watchObservedRunningTime="2026-07-01 20:21:23.443802892 +0000 UTC m=+249.652112134" Jul 01 20:21:27.415484 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.415450 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw"] Jul 01 20:21:27.415944 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.415741 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba6acb6-ecee-481b-9273-a12d6721f388" containerName="util" Jul 01 20:21:27.415944 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.415752 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba6acb6-ecee-481b-9273-a12d6721f388" containerName="util" Jul 01 20:21:27.415944 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.415762 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba6acb6-ecee-481b-9273-a12d6721f388" containerName="pull" Jul 01 20:21:27.415944 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.415769 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba6acb6-ecee-481b-9273-a12d6721f388" containerName="pull" Jul 01 20:21:27.415944 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.415794 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba6acb6-ecee-481b-9273-a12d6721f388" containerName="extract" Jul 01 20:21:27.415944 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.415799 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba6acb6-ecee-481b-9273-a12d6721f388" containerName="extract" Jul 01 20:21:27.415944 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.415844 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ba6acb6-ecee-481b-9273-a12d6721f388" containerName="extract" Jul 01 20:21:27.419171 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.419157 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" Jul 01 20:21:27.422889 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.422868 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 20:21:27.424198 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.424181 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xlr94\"" Jul 01 20:21:27.424387 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.424361 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:21:27.434546 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.434523 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw"] Jul 01 20:21:27.552273 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.552250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abcb268b-5527-4be5-9385-4435a8d03563-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nhdnw\" (UID: \"abcb268b-5527-4be5-9385-4435a8d03563\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" Jul 01 20:21:27.552375 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.552287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqddg\" (UniqueName: \"kubernetes.io/projected/abcb268b-5527-4be5-9385-4435a8d03563-kube-api-access-cqddg\") pod \"openshift-lws-operator-fd8ccff4c-nhdnw\" (UID: \"abcb268b-5527-4be5-9385-4435a8d03563\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" Jul 01 20:21:27.653610 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.653584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abcb268b-5527-4be5-9385-4435a8d03563-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nhdnw\" (UID: \"abcb268b-5527-4be5-9385-4435a8d03563\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" Jul 01 20:21:27.653744 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.653622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqddg\" (UniqueName: \"kubernetes.io/projected/abcb268b-5527-4be5-9385-4435a8d03563-kube-api-access-cqddg\") pod \"openshift-lws-operator-fd8ccff4c-nhdnw\" (UID: \"abcb268b-5527-4be5-9385-4435a8d03563\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" Jul 01 20:21:27.653988 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.653970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abcb268b-5527-4be5-9385-4435a8d03563-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nhdnw\" (UID: \"abcb268b-5527-4be5-9385-4435a8d03563\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" Jul 01 20:21:27.661468 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.661440 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqddg\" (UniqueName: \"kubernetes.io/projected/abcb268b-5527-4be5-9385-4435a8d03563-kube-api-access-cqddg\") pod \"openshift-lws-operator-fd8ccff4c-nhdnw\" (UID: \"abcb268b-5527-4be5-9385-4435a8d03563\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" Jul 01 20:21:27.728464 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.728412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" Jul 01 20:21:27.857678 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:27.857655 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw"] Jul 01 20:21:27.859151 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:21:27.859117 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabcb268b_5527_4be5_9385_4435a8d03563.slice/crio-78febd48a7289b7392ea03ca9e4abbeb0f194cbe9bed1b1d178ec73ae34f9d3e WatchSource:0}: Error finding container 78febd48a7289b7392ea03ca9e4abbeb0f194cbe9bed1b1d178ec73ae34f9d3e: Status 404 returned error can't find the container with id 78febd48a7289b7392ea03ca9e4abbeb0f194cbe9bed1b1d178ec73ae34f9d3e Jul 01 20:21:28.443679 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:28.443634 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" event={"ID":"abcb268b-5527-4be5-9385-4435a8d03563","Type":"ContainerStarted","Data":"78febd48a7289b7392ea03ca9e4abbeb0f194cbe9bed1b1d178ec73ae34f9d3e"} Jul 01 20:21:31.458320 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:31.458288 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" event={"ID":"abcb268b-5527-4be5-9385-4435a8d03563","Type":"ContainerStarted","Data":"554aeee0816444c842f7205310267cd8be91a5dba7f7c9a8600bce1cbc0fcef4"} Jul 01 20:21:31.477230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:31.477182 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nhdnw" podStartSLOduration=1.448772317 podStartE2EDuration="4.47716751s" totalImagesPullingTime="3.028395193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:21:31.476107118 +0000 UTC m=+257.684416355" watchObservedRunningTime="2026-07-01 20:21:31.47716751 +0000 UTC m=+257.685476752" Jul 01 20:21:33.846773 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:33.846738 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw"] Jul 01 20:21:33.849309 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:33.849290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:33.852301 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:33.852282 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 20:21:33.852418 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:33.852282 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 20:21:33.853941 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:33.853922 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kjvjv\"" Jul 01 20:21:33.861879 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:33.861855 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw"] Jul 01 20:21:33.997340 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:33.997312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:33.997451 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:33.997358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:33.997451 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:33.997398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rd8h\" (UniqueName: \"kubernetes.io/projected/a1b84bab-ca35-4f37-be42-a58682331f6d-kube-api-access-5rd8h\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:34.097911 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.097855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rd8h\" (UniqueName: \"kubernetes.io/projected/a1b84bab-ca35-4f37-be42-a58682331f6d-kube-api-access-5rd8h\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:34.097911 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.097898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:34.098119 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.098013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:34.098217 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.098201 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:34.098355 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.098336 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:34.115353 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.115328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rd8h\" (UniqueName: \"kubernetes.io/projected/a1b84bab-ca35-4f37-be42-a58682331f6d-kube-api-access-5rd8h\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:34.158423 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.158402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:34.288603 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.288572 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw"] Jul 01 20:21:34.290929 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:21:34.290897 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b84bab_ca35_4f37_be42_a58682331f6d.slice/crio-ea457d6be9e031f7368d9a6debee379f4a53cca428b56dc8ffef24f4bad62593 WatchSource:0}: Error finding container ea457d6be9e031f7368d9a6debee379f4a53cca428b56dc8ffef24f4bad62593: Status 404 returned error can't find the container with id ea457d6be9e031f7368d9a6debee379f4a53cca428b56dc8ffef24f4bad62593 Jul 01 20:21:34.472301 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.472271 2578 generic.go:356] "Generic (PLEG): container finished" podID="a1b84bab-ca35-4f37-be42-a58682331f6d" containerID="46d2b3b258bfacba0ba64e5e15ada94bf7a13ebebfe3ef7caa491a05b92273e2" exitCode=0 Jul 01 20:21:34.472397 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.472320 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" event={"ID":"a1b84bab-ca35-4f37-be42-a58682331f6d","Type":"ContainerDied","Data":"46d2b3b258bfacba0ba64e5e15ada94bf7a13ebebfe3ef7caa491a05b92273e2"} Jul 01 20:21:34.472397 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:34.472370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" event={"ID":"a1b84bab-ca35-4f37-be42-a58682331f6d","Type":"ContainerStarted","Data":"ea457d6be9e031f7368d9a6debee379f4a53cca428b56dc8ffef24f4bad62593"} Jul 01 20:21:35.478172 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.478085 2578 generic.go:356] "Generic (PLEG): container finished" podID="a1b84bab-ca35-4f37-be42-a58682331f6d" containerID="356d04b6eb017ed48963396e70f0befccaccfff6ea24f9be61fae393ce67f078" exitCode=0 Jul 01 20:21:35.478172 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.478142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" event={"ID":"a1b84bab-ca35-4f37-be42-a58682331f6d","Type":"ContainerDied","Data":"356d04b6eb017ed48963396e70f0befccaccfff6ea24f9be61fae393ce67f078"} Jul 01 20:21:35.534202 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.534179 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-rzkxh"] Jul 01 20:21:35.536292 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.536277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-rzkxh" Jul 01 20:21:35.539117 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.539042 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-424xk\"" Jul 01 20:21:35.549046 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.549022 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-rzkxh"] Jul 01 20:21:35.610182 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.610157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3988fd3d-23ad-4a88-9b12-b9e97d4051f6-bound-sa-token\") pod \"cert-manager-59c77684cc-rzkxh\" (UID: \"3988fd3d-23ad-4a88-9b12-b9e97d4051f6\") " pod="cert-manager/cert-manager-59c77684cc-rzkxh" Jul 01 20:21:35.610314 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.610262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n2tr\" (UniqueName: \"kubernetes.io/projected/3988fd3d-23ad-4a88-9b12-b9e97d4051f6-kube-api-access-6n2tr\") pod \"cert-manager-59c77684cc-rzkxh\" (UID: \"3988fd3d-23ad-4a88-9b12-b9e97d4051f6\") " pod="cert-manager/cert-manager-59c77684cc-rzkxh" Jul 01 20:21:35.711299 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.711276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n2tr\" (UniqueName: \"kubernetes.io/projected/3988fd3d-23ad-4a88-9b12-b9e97d4051f6-kube-api-access-6n2tr\") pod \"cert-manager-59c77684cc-rzkxh\" (UID: \"3988fd3d-23ad-4a88-9b12-b9e97d4051f6\") " pod="cert-manager/cert-manager-59c77684cc-rzkxh" Jul 01 20:21:35.711391 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.711304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3988fd3d-23ad-4a88-9b12-b9e97d4051f6-bound-sa-token\") pod \"cert-manager-59c77684cc-rzkxh\" (UID: \"3988fd3d-23ad-4a88-9b12-b9e97d4051f6\") " pod="cert-manager/cert-manager-59c77684cc-rzkxh" Jul 01 20:21:35.719325 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.719297 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3988fd3d-23ad-4a88-9b12-b9e97d4051f6-bound-sa-token\") pod \"cert-manager-59c77684cc-rzkxh\" (UID: \"3988fd3d-23ad-4a88-9b12-b9e97d4051f6\") " pod="cert-manager/cert-manager-59c77684cc-rzkxh" Jul 01 20:21:35.719512 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.719495 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n2tr\" (UniqueName: \"kubernetes.io/projected/3988fd3d-23ad-4a88-9b12-b9e97d4051f6-kube-api-access-6n2tr\") pod \"cert-manager-59c77684cc-rzkxh\" (UID: \"3988fd3d-23ad-4a88-9b12-b9e97d4051f6\") " pod="cert-manager/cert-manager-59c77684cc-rzkxh" Jul 01 20:21:35.844854 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.844829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-rzkxh" Jul 01 20:21:35.966620 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:35.966595 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-rzkxh"] Jul 01 20:21:35.967537 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:21:35.967517 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3988fd3d_23ad_4a88_9b12_b9e97d4051f6.slice/crio-8c07d4b172012151d3a9133b812e1c507cc90ec3aa5ca90cdf6937513541a6d4 WatchSource:0}: Error finding container 8c07d4b172012151d3a9133b812e1c507cc90ec3aa5ca90cdf6937513541a6d4: Status 404 returned error can't find the container with id 8c07d4b172012151d3a9133b812e1c507cc90ec3aa5ca90cdf6937513541a6d4 Jul 01 20:21:36.484619 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:36.484586 2578 generic.go:356] "Generic (PLEG): container finished" podID="a1b84bab-ca35-4f37-be42-a58682331f6d" containerID="63ee62e3acf0c2ffd10cd471b18bfb51dd84d245519ee02c3b2f263c957ce8ba" exitCode=0 Jul 01 20:21:36.485024 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:36.484671 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" event={"ID":"a1b84bab-ca35-4f37-be42-a58682331f6d","Type":"ContainerDied","Data":"63ee62e3acf0c2ffd10cd471b18bfb51dd84d245519ee02c3b2f263c957ce8ba"} Jul 01 20:21:36.486022 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:36.486001 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-rzkxh" event={"ID":"3988fd3d-23ad-4a88-9b12-b9e97d4051f6","Type":"ContainerStarted","Data":"f87999f8c2bfc1dd4a1503770cd76827a5b2b3a72ebbe4a5917e13ffff0d99ce"} Jul 01 20:21:36.486137 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:36.486029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-rzkxh" event={"ID":"3988fd3d-23ad-4a88-9b12-b9e97d4051f6","Type":"ContainerStarted","Data":"8c07d4b172012151d3a9133b812e1c507cc90ec3aa5ca90cdf6937513541a6d4"} Jul 01 20:21:36.521141 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:36.521103 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-rzkxh" podStartSLOduration=1.5210904410000001 podStartE2EDuration="1.521090441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:21:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:21:36.520299089 +0000 UTC m=+262.728608333" watchObservedRunningTime="2026-07-01 20:21:36.521090441 +0000 UTC m=+262.729399687" Jul 01 20:21:37.610432 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:37.610411 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:37.727283 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:37.727257 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-util\") pod \"a1b84bab-ca35-4f37-be42-a58682331f6d\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " Jul 01 20:21:37.727415 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:37.727292 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-bundle\") pod \"a1b84bab-ca35-4f37-be42-a58682331f6d\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " Jul 01 20:21:37.727415 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:37.727323 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rd8h\" (UniqueName: \"kubernetes.io/projected/a1b84bab-ca35-4f37-be42-a58682331f6d-kube-api-access-5rd8h\") pod \"a1b84bab-ca35-4f37-be42-a58682331f6d\" (UID: \"a1b84bab-ca35-4f37-be42-a58682331f6d\") " Jul 01 20:21:37.727968 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:37.727930 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-bundle" (OuterVolumeSpecName: "bundle") pod "a1b84bab-ca35-4f37-be42-a58682331f6d" (UID: "a1b84bab-ca35-4f37-be42-a58682331f6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:21:37.729289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:37.729268 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b84bab-ca35-4f37-be42-a58682331f6d-kube-api-access-5rd8h" (OuterVolumeSpecName: "kube-api-access-5rd8h") pod "a1b84bab-ca35-4f37-be42-a58682331f6d" (UID: "a1b84bab-ca35-4f37-be42-a58682331f6d"). InnerVolumeSpecName "kube-api-access-5rd8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:21:37.732847 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:37.732827 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-util" (OuterVolumeSpecName: "util") pod "a1b84bab-ca35-4f37-be42-a58682331f6d" (UID: "a1b84bab-ca35-4f37-be42-a58682331f6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:21:37.828248 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:37.828221 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-util\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:21:37.828380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:37.828251 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b84bab-ca35-4f37-be42-a58682331f6d-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:21:37.828380 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:37.828261 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rd8h\" (UniqueName: \"kubernetes.io/projected/a1b84bab-ca35-4f37-be42-a58682331f6d-kube-api-access-5rd8h\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:21:38.496273 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:38.496208 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" Jul 01 20:21:38.496431 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:38.496207 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cddqxzw" event={"ID":"a1b84bab-ca35-4f37-be42-a58682331f6d","Type":"ContainerDied","Data":"ea457d6be9e031f7368d9a6debee379f4a53cca428b56dc8ffef24f4bad62593"} Jul 01 20:21:38.496431 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:38.496321 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea457d6be9e031f7368d9a6debee379f4a53cca428b56dc8ffef24f4bad62593" Jul 01 20:21:47.727388 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.727354 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz"] Jul 01 20:21:47.727759 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.727649 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b84bab-ca35-4f37-be42-a58682331f6d" containerName="extract" Jul 01 20:21:47.727759 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.727661 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b84bab-ca35-4f37-be42-a58682331f6d" containerName="extract" Jul 01 20:21:47.727759 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.727672 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b84bab-ca35-4f37-be42-a58682331f6d" containerName="util" Jul 01 20:21:47.727759 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.727677 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b84bab-ca35-4f37-be42-a58682331f6d" containerName="util" Jul 01 20:21:47.727759 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.727683 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b84bab-ca35-4f37-be42-a58682331f6d" containerName="pull" Jul 01 20:21:47.727759 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.727689 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b84bab-ca35-4f37-be42-a58682331f6d" containerName="pull" Jul 01 20:21:47.727759 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.727750 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b84bab-ca35-4f37-be42-a58682331f6d" containerName="extract" Jul 01 20:21:47.730459 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.730443 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:47.734987 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.734963 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 20:21:47.735239 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.735217 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bmcqh\"" Jul 01 20:21:47.735749 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.735722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 20:21:47.746230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.746213 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 20:21:47.746394 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.746377 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 20:21:47.783298 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.783270 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz"] Jul 01 20:21:47.906429 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.906398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae6a625-d233-4c4e-b838-b5b542174deb-manifests\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:47.906429 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.906430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hmbw\" (UniqueName: \"kubernetes.io/projected/3ae6a625-d233-4c4e-b838-b5b542174deb-kube-api-access-4hmbw\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:47.906626 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.906474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae6a625-d233-4c4e-b838-b5b542174deb-tmp\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:47.906626 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.906491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae6a625-d233-4c4e-b838-b5b542174deb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:47.906626 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:47.906528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae6a625-d233-4c4e-b838-b5b542174deb-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.007467 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.007384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae6a625-d233-4c4e-b838-b5b542174deb-tmp\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.007467 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.007421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae6a625-d233-4c4e-b838-b5b542174deb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.007674 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.007545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae6a625-d233-4c4e-b838-b5b542174deb-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.007674 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.007587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae6a625-d233-4c4e-b838-b5b542174deb-manifests\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.007674 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.007611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hmbw\" (UniqueName: \"kubernetes.io/projected/3ae6a625-d233-4c4e-b838-b5b542174deb-kube-api-access-4hmbw\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.007948 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.007918 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae6a625-d233-4c4e-b838-b5b542174deb-manifests\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.009797 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.009758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae6a625-d233-4c4e-b838-b5b542174deb-tmp\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.009913 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.009895 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae6a625-d233-4c4e-b838-b5b542174deb-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.009973 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.009927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae6a625-d233-4c4e-b838-b5b542174deb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.019199 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.019179 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hmbw\" (UniqueName: \"kubernetes.io/projected/3ae6a625-d233-4c4e-b838-b5b542174deb-kube-api-access-4hmbw\") pod \"opendatahub-operator-controller-manager-67bb96b6fd-5v6hz\" (UID: \"3ae6a625-d233-4c4e-b838-b5b542174deb\") " pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.040182 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.040159 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:48.173740 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.173716 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz"] Jul 01 20:21:48.176032 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:21:48.176008 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae6a625_d233_4c4e_b838_b5b542174deb.slice/crio-062d5f721fad8310f287603b134c77cb38141ff41cb1fc05bc97173e14865af5 WatchSource:0}: Error finding container 062d5f721fad8310f287603b134c77cb38141ff41cb1fc05bc97173e14865af5: Status 404 returned error can't find the container with id 062d5f721fad8310f287603b134c77cb38141ff41cb1fc05bc97173e14865af5 Jul 01 20:21:48.540646 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:48.540611 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" event={"ID":"3ae6a625-d233-4c4e-b838-b5b542174deb","Type":"ContainerStarted","Data":"062d5f721fad8310f287603b134c77cb38141ff41cb1fc05bc97173e14865af5"} Jul 01 20:21:51.557052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:51.557013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" event={"ID":"3ae6a625-d233-4c4e-b838-b5b542174deb","Type":"ContainerStarted","Data":"a2440c198ac61107f31fac5e9dc1fb9c72b5f0034cb4ad8abe69390964e83ff4"} Jul 01 20:21:52.563410 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:52.563376 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ae6a625-d233-4c4e-b838-b5b542174deb" containerID="a2440c198ac61107f31fac5e9dc1fb9c72b5f0034cb4ad8abe69390964e83ff4" exitCode=0 Jul 01 20:21:52.563762 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:52.563417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" event={"ID":"3ae6a625-d233-4c4e-b838-b5b542174deb","Type":"ContainerDied","Data":"a2440c198ac61107f31fac5e9dc1fb9c72b5f0034cb4ad8abe69390964e83ff4"} Jul 01 20:21:53.571136 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:53.571093 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" event={"ID":"3ae6a625-d233-4c4e-b838-b5b542174deb","Type":"ContainerStarted","Data":"fb0cee0c3fdf96e7a5f81682945c5ac5c203de3056c089aee44da252755d1c1d"} Jul 01 20:21:53.571592 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:53.571215 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:21:53.596617 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:21:53.596574 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" podStartSLOduration=2.507055251 podStartE2EDuration="6.59656237s" totalImagesPullingTime="3.161153891s" totalInitContainerRuntime="928.353228ms" isStatefulPod=false podCreationTimestamp="2026-07-01 20:21:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:21:53.595261631 +0000 UTC m=+279.803570873" watchObservedRunningTime="2026-07-01 20:21:53.59656237 +0000 UTC m=+279.804871613" Jul 01 20:22:04.578140 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:04.578111 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67bb96b6fd-5v6hz" Jul 01 20:22:07.700775 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:07.700743 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9vn79"] Jul 01 20:22:07.703695 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:07.703675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:07.706305 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:07.706285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 01 20:22:07.706439 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:07.706359 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kjqzm\"" Jul 01 20:22:07.718457 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:07.718432 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9vn79"] Jul 01 20:22:07.778915 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:07.778876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx482\" (UniqueName: \"kubernetes.io/projected/81d8abfa-1dc3-4a83-8b96-dbffdc9df80d-kube-api-access-tx482\") pod \"odh-model-controller-6dc94f689f-9vn79\" (UID: \"81d8abfa-1dc3-4a83-8b96-dbffdc9df80d\") " pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:07.779102 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:07.778953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d8abfa-1dc3-4a83-8b96-dbffdc9df80d-cert\") pod \"odh-model-controller-6dc94f689f-9vn79\" (UID: \"81d8abfa-1dc3-4a83-8b96-dbffdc9df80d\") " pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:07.880587 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:07.880546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx482\" (UniqueName: \"kubernetes.io/projected/81d8abfa-1dc3-4a83-8b96-dbffdc9df80d-kube-api-access-tx482\") pod \"odh-model-controller-6dc94f689f-9vn79\" (UID: \"81d8abfa-1dc3-4a83-8b96-dbffdc9df80d\") " pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:07.880782 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:07.880621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d8abfa-1dc3-4a83-8b96-dbffdc9df80d-cert\") pod \"odh-model-controller-6dc94f689f-9vn79\" (UID: \"81d8abfa-1dc3-4a83-8b96-dbffdc9df80d\") " pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:07.880782 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:22:07.880760 2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 01 20:22:07.880894 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:22:07.880827 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81d8abfa-1dc3-4a83-8b96-dbffdc9df80d-cert podName:81d8abfa-1dc3-4a83-8b96-dbffdc9df80d nodeName:}" failed. No retries permitted until 2026-07-01 20:22:08.380810669 +0000 UTC m=+294.589119893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/81d8abfa-1dc3-4a83-8b96-dbffdc9df80d-cert") pod "odh-model-controller-6dc94f689f-9vn79" (UID: "81d8abfa-1dc3-4a83-8b96-dbffdc9df80d") : secret "odh-model-controller-webhook-cert" not found Jul 01 20:22:07.892115 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:07.892084 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx482\" (UniqueName: \"kubernetes.io/projected/81d8abfa-1dc3-4a83-8b96-dbffdc9df80d-kube-api-access-tx482\") pod \"odh-model-controller-6dc94f689f-9vn79\" (UID: \"81d8abfa-1dc3-4a83-8b96-dbffdc9df80d\") " pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:08.323300 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.323266 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-mlv8k"] Jul 01 20:22:08.325478 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.325463 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" Jul 01 20:22:08.328798 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.328754 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-4sb9x\"" Jul 01 20:22:08.330025 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.330004 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 01 20:22:08.363047 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.363018 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-mlv8k"] Jul 01 20:22:08.386119 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.386093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4qkh\" (UniqueName: \"kubernetes.io/projected/b9303a6b-b827-4e42-bcd5-9503167eba4a-kube-api-access-p4qkh\") pod \"model-serving-api-5dd488fc48-mlv8k\" (UID: \"b9303a6b-b827-4e42-bcd5-9503167eba4a\") " pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" Jul 01 20:22:08.386281 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.386152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d8abfa-1dc3-4a83-8b96-dbffdc9df80d-cert\") pod \"odh-model-controller-6dc94f689f-9vn79\" (UID: \"81d8abfa-1dc3-4a83-8b96-dbffdc9df80d\") " pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:08.386281 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.386213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9303a6b-b827-4e42-bcd5-9503167eba4a-tls-certs\") pod \"model-serving-api-5dd488fc48-mlv8k\" (UID: \"b9303a6b-b827-4e42-bcd5-9503167eba4a\") " pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" Jul 01 20:22:08.388569 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.388548 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81d8abfa-1dc3-4a83-8b96-dbffdc9df80d-cert\") pod \"odh-model-controller-6dc94f689f-9vn79\" (UID: \"81d8abfa-1dc3-4a83-8b96-dbffdc9df80d\") " pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:08.487367 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.487338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9303a6b-b827-4e42-bcd5-9503167eba4a-tls-certs\") pod \"model-serving-api-5dd488fc48-mlv8k\" (UID: \"b9303a6b-b827-4e42-bcd5-9503167eba4a\") " pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" Jul 01 20:22:08.487535 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.487391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4qkh\" (UniqueName: \"kubernetes.io/projected/b9303a6b-b827-4e42-bcd5-9503167eba4a-kube-api-access-p4qkh\") pod \"model-serving-api-5dd488fc48-mlv8k\" (UID: \"b9303a6b-b827-4e42-bcd5-9503167eba4a\") " pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" Jul 01 20:22:08.489686 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.489666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9303a6b-b827-4e42-bcd5-9503167eba4a-tls-certs\") pod \"model-serving-api-5dd488fc48-mlv8k\" (UID: \"b9303a6b-b827-4e42-bcd5-9503167eba4a\") " pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" Jul 01 20:22:08.499074 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.499040 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4qkh\" (UniqueName: \"kubernetes.io/projected/b9303a6b-b827-4e42-bcd5-9503167eba4a-kube-api-access-p4qkh\") pod \"model-serving-api-5dd488fc48-mlv8k\" (UID: \"b9303a6b-b827-4e42-bcd5-9503167eba4a\") " pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" Jul 01 20:22:08.613887 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.613806 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:08.637397 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.637369 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" Jul 01 20:22:08.794952 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.794924 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-mlv8k"] Jul 01 20:22:08.804355 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:22:08.804308 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9303a6b_b827_4e42_bcd5_9503167eba4a.slice/crio-907af415392eb06fe628931fac55caa6ee3a7c7c4ecf105e628a85996b43e4d4 WatchSource:0}: Error finding container 907af415392eb06fe628931fac55caa6ee3a7c7c4ecf105e628a85996b43e4d4: Status 404 returned error can't find the container with id 907af415392eb06fe628931fac55caa6ee3a7c7c4ecf105e628a85996b43e4d4 Jul 01 20:22:08.916727 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.916658 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv"] Jul 01 20:22:08.919870 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.919851 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:08.923763 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.923736 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dl79l\"" Jul 01 20:22:08.924290 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.924275 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 20:22:08.924403 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.924324 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 20:22:08.924403 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.924324 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 20:22:08.933444 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.933418 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv"] Jul 01 20:22:08.975617 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.975585 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9vn79"] Jul 01 20:22:08.979352 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:22:08.979327 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d8abfa_1dc3_4a83_8b96_dbffdc9df80d.slice/crio-2fe5a0faaa0d94598b0984b0e50dcc8fc4ddd9a12ed7e4f8783d0171773a3a7d WatchSource:0}: Error finding container 2fe5a0faaa0d94598b0984b0e50dcc8fc4ddd9a12ed7e4f8783d0171773a3a7d: Status 404 returned error can't find the container with id 2fe5a0faaa0d94598b0984b0e50dcc8fc4ddd9a12ed7e4f8783d0171773a3a7d Jul 01 20:22:08.992109 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.992050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e629ebe2-405b-4879-a497-408ad778671d-manager-config\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:08.992230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.992150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddg7z\" (UniqueName: \"kubernetes.io/projected/e629ebe2-405b-4879-a497-408ad778671d-kube-api-access-ddg7z\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:08.992230 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.992216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e629ebe2-405b-4879-a497-408ad778671d-cert\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:08.992321 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:08.992247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e629ebe2-405b-4879-a497-408ad778671d-metrics-cert\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:09.093463 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.093429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e629ebe2-405b-4879-a497-408ad778671d-cert\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:09.093628 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.093468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e629ebe2-405b-4879-a497-408ad778671d-metrics-cert\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:09.093628 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.093498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e629ebe2-405b-4879-a497-408ad778671d-manager-config\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:09.093628 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.093531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddg7z\" (UniqueName: \"kubernetes.io/projected/e629ebe2-405b-4879-a497-408ad778671d-kube-api-access-ddg7z\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:09.094244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.094220 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e629ebe2-405b-4879-a497-408ad778671d-manager-config\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:09.095895 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.095876 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e629ebe2-405b-4879-a497-408ad778671d-cert\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:09.095954 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.095939 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e629ebe2-405b-4879-a497-408ad778671d-metrics-cert\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:09.104400 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.104371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddg7z\" (UniqueName: \"kubernetes.io/projected/e629ebe2-405b-4879-a497-408ad778671d-kube-api-access-ddg7z\") pod \"lws-controller-manager-7565f6b689-s45gv\" (UID: \"e629ebe2-405b-4879-a497-408ad778671d\") " pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:09.229309 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.229214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:09.367425 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.367391 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv"] Jul 01 20:22:09.369159 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:22:09.369134 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode629ebe2_405b_4879_a497_408ad778671d.slice/crio-c8554df82b6408c4d3265bcdef4a6cc9190db3504bdfdad50e2cea6c320abf22 WatchSource:0}: Error finding container c8554df82b6408c4d3265bcdef4a6cc9190db3504bdfdad50e2cea6c320abf22: Status 404 returned error can't find the container with id c8554df82b6408c4d3265bcdef4a6cc9190db3504bdfdad50e2cea6c320abf22 Jul 01 20:22:09.653600 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.653522 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" event={"ID":"e629ebe2-405b-4879-a497-408ad778671d","Type":"ContainerStarted","Data":"c8554df82b6408c4d3265bcdef4a6cc9190db3504bdfdad50e2cea6c320abf22"} Jul 01 20:22:09.655306 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.655230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" event={"ID":"81d8abfa-1dc3-4a83-8b96-dbffdc9df80d","Type":"ContainerStarted","Data":"2fe5a0faaa0d94598b0984b0e50dcc8fc4ddd9a12ed7e4f8783d0171773a3a7d"} Jul 01 20:22:09.661207 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:09.661148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" event={"ID":"b9303a6b-b827-4e42-bcd5-9503167eba4a","Type":"ContainerStarted","Data":"907af415392eb06fe628931fac55caa6ee3a7c7c4ecf105e628a85996b43e4d4"} Jul 01 20:22:13.688074 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:13.688030 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" event={"ID":"b9303a6b-b827-4e42-bcd5-9503167eba4a","Type":"ContainerStarted","Data":"bd56e2be8d901059c3a45085d85e85f60b3b00f870a65800e0a647090580e732"} Jul 01 20:22:13.688508 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:13.688119 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" Jul 01 20:22:13.689633 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:13.689603 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" event={"ID":"e629ebe2-405b-4879-a497-408ad778671d","Type":"ContainerStarted","Data":"422008b16347559554dd460b8a8a429a068ee78e33d2442c43b08b305d035a2b"} Jul 01 20:22:13.689769 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:13.689656 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:13.690928 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:13.690902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" event={"ID":"81d8abfa-1dc3-4a83-8b96-dbffdc9df80d","Type":"ContainerStarted","Data":"0804276a7f4f51023c29e98e39b271fcd982784809ab730385644bc49bea9b35"} Jul 01 20:22:13.691095 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:13.691080 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:13.705201 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:13.705125 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" podStartSLOduration=1.048143984 podStartE2EDuration="5.705113832s" totalImagesPullingTime="4.656969848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:13.704685956 +0000 UTC m=+299.912995201" watchObservedRunningTime="2026-07-01 20:22:13.705113832 +0000 UTC m=+299.913423102" Jul 01 20:22:13.723750 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:13.723704 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" podStartSLOduration=1.6390665580000001 podStartE2EDuration="5.723691322s" totalImagesPullingTime="4.084624764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:13.722792465 +0000 UTC m=+299.931101710" watchObservedRunningTime="2026-07-01 20:22:13.723691322 +0000 UTC m=+299.932000574" Jul 01 20:22:13.739924 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:13.739876 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" podStartSLOduration=2.268923917 podStartE2EDuration="6.739860496s" totalImagesPullingTime="4.470936579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:13.73912286 +0000 UTC m=+299.947432111" watchObservedRunningTime="2026-07-01 20:22:13.739860496 +0000 UTC m=+299.948169739" Jul 01 20:22:14.190247 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:14.190210 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-acl-logging/0.log" Jul 01 20:22:14.191936 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:14.191913 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-acl-logging/0.log" Jul 01 20:22:14.199157 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:14.199138 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 20:22:24.698318 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:24.698283 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-9vn79" Jul 01 20:22:24.762972 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:24.698677 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7565f6b689-s45gv" Jul 01 20:22:24.762972 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:24.700770 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-mlv8k" Jul 01 20:22:26.427316 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.427284 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p"] Jul 01 20:22:26.429639 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.429619 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.432399 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.432371 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 20:22:26.432399 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.432378 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 20:22:26.432593 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.432506 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 20:22:26.432593 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.432540 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kb4db\"" Jul 01 20:22:26.443804 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.443779 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p"] Jul 01 20:22:26.553406 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.553365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxjsn\" (UniqueName: \"kubernetes.io/projected/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-kube-api-access-kxjsn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.553596 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.553422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.553596 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.553452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.553596 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.553510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.553596 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.553532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.553596 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.553553 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.553596 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.553586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.553906 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.553634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.553906 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.553725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.654480 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.654439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.654665 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.654492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.654665 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.654536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.654665 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.654575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxjsn\" (UniqueName: \"kubernetes.io/projected/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-kube-api-access-kxjsn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.654665 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.654627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.654665 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.654660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.654913 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.654703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.654913 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.654734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.655035 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.654930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.655035 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.654992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.655180 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.655044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.655575 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.655554 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.655752 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.655669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.655880 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.655789 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.657614 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.657596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.657806 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.657790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.670266 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.670232 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.670505 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.670478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxjsn\" (UniqueName: \"kubernetes.io/projected/7dd78dde-5dbb-4ba0-95a3-47603a4f9d10-kube-api-access-kxjsn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cvc9p\" (UID: \"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.742486 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.742398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:26.886887 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.882274 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p"] Jul 01 20:22:26.888915 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.888892 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:22:26.934090 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.934044 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-74c9cf85ff-8cm5q"] Jul 01 20:22:26.937026 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.937003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" Jul 01 20:22:26.940402 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.940380 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mjpcn\"" Jul 01 20:22:26.940905 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.940884 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 20:22:26.949648 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:26.949615 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-74c9cf85ff-8cm5q"] Jul 01 20:22:27.058807 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:27.058773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rhfs\" (UniqueName: \"kubernetes.io/projected/ccd42da2-cb9e-47b4-8a48-94945c1ca2ce-kube-api-access-4rhfs\") pod \"dashboard-redirect-74c9cf85ff-8cm5q\" (UID: \"ccd42da2-cb9e-47b4-8a48-94945c1ca2ce\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" Jul 01 20:22:27.059018 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:27.058816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ccd42da2-cb9e-47b4-8a48-94945c1ca2ce-redirect-config\") pod \"dashboard-redirect-74c9cf85ff-8cm5q\" (UID: \"ccd42da2-cb9e-47b4-8a48-94945c1ca2ce\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" Jul 01 20:22:27.160178 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:27.160136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rhfs\" (UniqueName: \"kubernetes.io/projected/ccd42da2-cb9e-47b4-8a48-94945c1ca2ce-kube-api-access-4rhfs\") pod \"dashboard-redirect-74c9cf85ff-8cm5q\" (UID: \"ccd42da2-cb9e-47b4-8a48-94945c1ca2ce\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" Jul 01 20:22:27.160375 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:27.160191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ccd42da2-cb9e-47b4-8a48-94945c1ca2ce-redirect-config\") pod \"dashboard-redirect-74c9cf85ff-8cm5q\" (UID: \"ccd42da2-cb9e-47b4-8a48-94945c1ca2ce\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" Jul 01 20:22:27.160929 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:27.160904 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ccd42da2-cb9e-47b4-8a48-94945c1ca2ce-redirect-config\") pod \"dashboard-redirect-74c9cf85ff-8cm5q\" (UID: \"ccd42da2-cb9e-47b4-8a48-94945c1ca2ce\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" Jul 01 20:22:27.169025 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:27.168994 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rhfs\" (UniqueName: \"kubernetes.io/projected/ccd42da2-cb9e-47b4-8a48-94945c1ca2ce-kube-api-access-4rhfs\") pod \"dashboard-redirect-74c9cf85ff-8cm5q\" (UID: \"ccd42da2-cb9e-47b4-8a48-94945c1ca2ce\") " pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" Jul 01 20:22:27.251309 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:27.251274 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" Jul 01 20:22:27.383086 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:27.383040 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-74c9cf85ff-8cm5q"] Jul 01 20:22:27.384498 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:22:27.384475 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd42da2_cb9e_47b4_8a48_94945c1ca2ce.slice/crio-7f43a37962f2b637b1e5b79c8064c51313f73405af2e2c140e68d7f0ff6f1adc WatchSource:0}: Error finding container 7f43a37962f2b637b1e5b79c8064c51313f73405af2e2c140e68d7f0ff6f1adc: Status 404 returned error can't find the container with id 7f43a37962f2b637b1e5b79c8064c51313f73405af2e2c140e68d7f0ff6f1adc Jul 01 20:22:27.762542 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:27.762446 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" event={"ID":"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10","Type":"ContainerStarted","Data":"18eb7931e60ccbe0d0d7421146252cd77ab9ed2ab3373b030ad4fc3eae4d2252"} Jul 01 20:22:27.763609 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:27.763580 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" event={"ID":"ccd42da2-cb9e-47b4-8a48-94945c1ca2ce","Type":"ContainerStarted","Data":"7f43a37962f2b637b1e5b79c8064c51313f73405af2e2c140e68d7f0ff6f1adc"} Jul 01 20:22:33.795626 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:33.795590 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" event={"ID":"ccd42da2-cb9e-47b4-8a48-94945c1ca2ce","Type":"ContainerStarted","Data":"ec45c139e26b81a362040399977682301741e231664fc54cb6955c82778b8f35"} Jul 01 20:22:33.814456 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:33.814409 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-74c9cf85ff-8cm5q" podStartSLOduration=2.423340723 podStartE2EDuration="7.814394406s" totalImagesPullingTime="5.391053683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:33.812907669 +0000 UTC m=+320.021216913" watchObservedRunningTime="2026-07-01 20:22:33.814394406 +0000 UTC m=+320.022703670" Jul 01 20:22:45.624188 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:45.624149 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 20:22:45.624453 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:45.624231 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 20:22:45.624453 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:45.624263 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 20:22:45.861430 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:45.861395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" event={"ID":"7dd78dde-5dbb-4ba0-95a3-47603a4f9d10","Type":"ContainerStarted","Data":"a0439ea8a6375a4fb712a3e559719b5325a1852963cd04801d95bed4aa919bc5"} Jul 01 20:22:46.743485 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:46.743447 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:46.748026 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:46.748001 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:46.772605 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:46.772551 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" podStartSLOduration=2.037675368 podStartE2EDuration="20.772535125s" totalImagesPullingTime="18.734859757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:22:45.884790677 +0000 UTC m=+332.093099922" watchObservedRunningTime="2026-07-01 20:22:46.772535125 +0000 UTC m=+332.980844367" Jul 01 20:22:46.865866 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:46.865841 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:22:46.866818 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:22:46.866801 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cvc9p" Jul 01 20:23:08.715027 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:08.714950 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jphgf"] Jul 01 20:23:08.717986 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:08.717960 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jphgf" Jul 01 20:23:08.720524 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:08.720499 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-85g5h\"" Jul 01 20:23:08.720681 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:08.720666 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 20:23:08.721776 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:08.721750 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 20:23:08.731540 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:08.731519 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jphgf"] Jul 01 20:23:08.797003 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:08.796970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5gt2\" (UniqueName: \"kubernetes.io/projected/ae7a873e-d764-488a-b012-e6e9c623be79-kube-api-access-n5gt2\") pod \"kuadrant-operator-catalog-jphgf\" (UID: \"ae7a873e-d764-488a-b012-e6e9c623be79\") " pod="kuadrant-system/kuadrant-operator-catalog-jphgf" Jul 01 20:23:08.898001 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:08.897970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5gt2\" (UniqueName: \"kubernetes.io/projected/ae7a873e-d764-488a-b012-e6e9c623be79-kube-api-access-n5gt2\") pod \"kuadrant-operator-catalog-jphgf\" (UID: \"ae7a873e-d764-488a-b012-e6e9c623be79\") " pod="kuadrant-system/kuadrant-operator-catalog-jphgf" Jul 01 20:23:08.906564 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:08.906537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5gt2\" (UniqueName: \"kubernetes.io/projected/ae7a873e-d764-488a-b012-e6e9c623be79-kube-api-access-n5gt2\") pod \"kuadrant-operator-catalog-jphgf\" (UID: \"ae7a873e-d764-488a-b012-e6e9c623be79\") " pod="kuadrant-system/kuadrant-operator-catalog-jphgf" Jul 01 20:23:09.030927 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.030868 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jphgf" Jul 01 20:23:09.076109 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.076077 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jphgf"] Jul 01 20:23:09.156112 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.156085 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jphgf"] Jul 01 20:23:09.157257 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:23:09.157227 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7a873e_d764_488a_b012_e6e9c623be79.slice/crio-4bd0012767cc0cf97476bd4169a59f1e8a8d2dc6f4ba9d5cbe77838a62eac00f WatchSource:0}: Error finding container 4bd0012767cc0cf97476bd4169a59f1e8a8d2dc6f4ba9d5cbe77838a62eac00f: Status 404 returned error can't find the container with id 4bd0012767cc0cf97476bd4169a59f1e8a8d2dc6f4ba9d5cbe77838a62eac00f Jul 01 20:23:09.287921 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.287871 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngljr"] Jul 01 20:23:09.292168 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.292153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ngljr" Jul 01 20:23:09.300717 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.300693 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngljr"] Jul 01 20:23:09.401631 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.401601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g4xr\" (UniqueName: \"kubernetes.io/projected/6dca9971-fed0-4a92-9b6e-7db7809b1387-kube-api-access-4g4xr\") pod \"kuadrant-operator-catalog-ngljr\" (UID: \"6dca9971-fed0-4a92-9b6e-7db7809b1387\") " pod="kuadrant-system/kuadrant-operator-catalog-ngljr" Jul 01 20:23:09.502903 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.502879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g4xr\" (UniqueName: \"kubernetes.io/projected/6dca9971-fed0-4a92-9b6e-7db7809b1387-kube-api-access-4g4xr\") pod \"kuadrant-operator-catalog-ngljr\" (UID: \"6dca9971-fed0-4a92-9b6e-7db7809b1387\") " pod="kuadrant-system/kuadrant-operator-catalog-ngljr" Jul 01 20:23:09.511265 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.511249 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g4xr\" (UniqueName: \"kubernetes.io/projected/6dca9971-fed0-4a92-9b6e-7db7809b1387-kube-api-access-4g4xr\") pod \"kuadrant-operator-catalog-ngljr\" (UID: \"6dca9971-fed0-4a92-9b6e-7db7809b1387\") " pod="kuadrant-system/kuadrant-operator-catalog-ngljr" Jul 01 20:23:09.602702 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.602671 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ngljr" Jul 01 20:23:09.738204 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.738178 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ngljr"] Jul 01 20:23:09.739910 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:23:09.739884 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dca9971_fed0_4a92_9b6e_7db7809b1387.slice/crio-7eac6997b0d9ceb79ca85254d86c796100b7d14555ae77306f64b00a49ec7387 WatchSource:0}: Error finding container 7eac6997b0d9ceb79ca85254d86c796100b7d14555ae77306f64b00a49ec7387: Status 404 returned error can't find the container with id 7eac6997b0d9ceb79ca85254d86c796100b7d14555ae77306f64b00a49ec7387 Jul 01 20:23:09.975631 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.975563 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ngljr" event={"ID":"6dca9971-fed0-4a92-9b6e-7db7809b1387","Type":"ContainerStarted","Data":"7eac6997b0d9ceb79ca85254d86c796100b7d14555ae77306f64b00a49ec7387"} Jul 01 20:23:09.976657 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:09.976632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jphgf" event={"ID":"ae7a873e-d764-488a-b012-e6e9c623be79","Type":"ContainerStarted","Data":"4bd0012767cc0cf97476bd4169a59f1e8a8d2dc6f4ba9d5cbe77838a62eac00f"} Jul 01 20:23:11.993462 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:11.993421 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jphgf" event={"ID":"ae7a873e-d764-488a-b012-e6e9c623be79","Type":"ContainerStarted","Data":"cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada"} Jul 01 20:23:11.993865 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:11.993497 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jphgf" podUID="ae7a873e-d764-488a-b012-e6e9c623be79" containerName="registry-server" containerID="cri-o://cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada" gracePeriod=2 Jul 01 20:23:11.995046 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:11.995014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ngljr" event={"ID":"6dca9971-fed0-4a92-9b6e-7db7809b1387","Type":"ContainerStarted","Data":"0810eaa068fec6a9c3f61acfa8dea4cad090d86637692b5efb7d7c4f77664a1f"} Jul 01 20:23:12.011547 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:12.011507 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jphgf" podStartSLOduration=1.380310004 podStartE2EDuration="4.011494085s" totalImagesPullingTime="2.631184081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:23:12.010513417 +0000 UTC m=+358.218822659" watchObservedRunningTime="2026-07-01 20:23:12.011494085 +0000 UTC m=+358.219803328" Jul 01 20:23:12.031635 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:12.027979 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ngljr" podStartSLOduration=0.976002192 podStartE2EDuration="3.027961944s" totalImagesPullingTime="2.051959752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:23:12.025533398 +0000 UTC m=+358.233842642" watchObservedRunningTime="2026-07-01 20:23:12.027961944 +0000 UTC m=+358.236271190" Jul 01 20:23:12.232540 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:12.232516 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jphgf" Jul 01 20:23:12.327328 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:12.327298 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5gt2\" (UniqueName: \"kubernetes.io/projected/ae7a873e-d764-488a-b012-e6e9c623be79-kube-api-access-n5gt2\") pod \"ae7a873e-d764-488a-b012-e6e9c623be79\" (UID: \"ae7a873e-d764-488a-b012-e6e9c623be79\") " Jul 01 20:23:12.329319 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:12.329298 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae7a873e-d764-488a-b012-e6e9c623be79-kube-api-access-n5gt2" (OuterVolumeSpecName: "kube-api-access-n5gt2") pod "ae7a873e-d764-488a-b012-e6e9c623be79" (UID: "ae7a873e-d764-488a-b012-e6e9c623be79"). InnerVolumeSpecName "kube-api-access-n5gt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:23:12.428783 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:12.428718 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5gt2\" (UniqueName: \"kubernetes.io/projected/ae7a873e-d764-488a-b012-e6e9c623be79-kube-api-access-n5gt2\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:13.001196 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:13.001157 2578 generic.go:356] "Generic (PLEG): container finished" podID="ae7a873e-d764-488a-b012-e6e9c623be79" containerID="cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada" exitCode=0 Jul 01 20:23:13.001628 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:13.001208 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jphgf" Jul 01 20:23:13.001628 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:13.001248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jphgf" event={"ID":"ae7a873e-d764-488a-b012-e6e9c623be79","Type":"ContainerDied","Data":"cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada"} Jul 01 20:23:13.001628 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:13.001309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jphgf" event={"ID":"ae7a873e-d764-488a-b012-e6e9c623be79","Type":"ContainerDied","Data":"4bd0012767cc0cf97476bd4169a59f1e8a8d2dc6f4ba9d5cbe77838a62eac00f"} Jul 01 20:23:13.001628 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:13.001341 2578 scope.go:117] "RemoveContainer" containerID="cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada" Jul 01 20:23:13.011156 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:13.011130 2578 scope.go:117] "RemoveContainer" containerID="cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada" Jul 01 20:23:13.011408 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:23:13.011390 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada\": container with ID starting with cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada not found: ID does not exist" containerID="cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada" Jul 01 20:23:13.011476 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:13.011417 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada"} err="failed to get container status \"cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada\": rpc error: code = NotFound desc = could not find container \"cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada\": container with ID starting with cc4d88e5153b81f46d91670264a024856fac6acf2f4d37534910feea2503fada not found: ID does not exist" Jul 01 20:23:13.023181 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:13.023158 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jphgf"] Jul 01 20:23:13.025220 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:13.025198 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jphgf"] Jul 01 20:23:14.226750 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:14.226725 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae7a873e-d764-488a-b012-e6e9c623be79" path="/var/lib/kubelet/pods/ae7a873e-d764-488a-b012-e6e9c623be79/volumes" Jul 01 20:23:19.603760 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:19.603712 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ngljr" Jul 01 20:23:19.603760 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:19.603770 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ngljr" Jul 01 20:23:19.626668 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:19.626645 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ngljr" Jul 01 20:23:20.059136 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:20.059110 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ngljr" Jul 01 20:23:24.331577 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.331547 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp"] Jul 01 20:23:24.331982 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.331870 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7a873e-d764-488a-b012-e6e9c623be79" containerName="registry-server" Jul 01 20:23:24.331982 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.331882 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7a873e-d764-488a-b012-e6e9c623be79" containerName="registry-server" Jul 01 20:23:24.331982 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.331959 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7a873e-d764-488a-b012-e6e9c623be79" containerName="registry-server" Jul 01 20:23:24.336025 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.336005 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.338585 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.338563 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bkgmg\"" Jul 01 20:23:24.344487 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.344463 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp"] Jul 01 20:23:24.416624 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.416594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.416728 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.416640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68t46\" (UniqueName: \"kubernetes.io/projected/a256b11f-e397-4876-899a-9103b48e5739-kube-api-access-68t46\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.416771 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.416728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.517320 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.517297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.517419 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.517336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68t46\" (UniqueName: \"kubernetes.io/projected/a256b11f-e397-4876-899a-9103b48e5739-kube-api-access-68t46\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.517419 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.517396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.517709 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.517694 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.517750 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.517692 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.526243 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.526225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68t46\" (UniqueName: \"kubernetes.io/projected/a256b11f-e397-4876-899a-9103b48e5739-kube-api-access-68t46\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.645518 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.645469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:24.772045 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.772016 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp"] Jul 01 20:23:24.773373 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:23:24.773339 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda256b11f_e397_4876_899a_9103b48e5739.slice/crio-ad5c3014b2d234f595c5d3a49e8caf9f28d34fbe1d1446fa28fb1fc4760d88a3 WatchSource:0}: Error finding container ad5c3014b2d234f595c5d3a49e8caf9f28d34fbe1d1446fa28fb1fc4760d88a3: Status 404 returned error can't find the container with id ad5c3014b2d234f595c5d3a49e8caf9f28d34fbe1d1446fa28fb1fc4760d88a3 Jul 01 20:23:24.935176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.935121 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq"] Jul 01 20:23:24.937956 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.937939 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:24.947791 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:24.947771 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq"] Jul 01 20:23:25.020795 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.020764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:25.020912 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.020813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:25.020976 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.020932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2fdh\" (UniqueName: \"kubernetes.io/projected/d2c0b1fa-9412-46f9-90a7-61ba0656f022-kube-api-access-g2fdh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:25.061107 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.061080 2578 generic.go:356] "Generic (PLEG): container finished" podID="a256b11f-e397-4876-899a-9103b48e5739" containerID="829189984fd673d87f556ca2eca389fe50238f1cc544ba7cba6dae3acc37a015" exitCode=0 Jul 01 20:23:25.061205 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.061107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" event={"ID":"a256b11f-e397-4876-899a-9103b48e5739","Type":"ContainerDied","Data":"829189984fd673d87f556ca2eca389fe50238f1cc544ba7cba6dae3acc37a015"} Jul 01 20:23:25.061205 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.061156 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" event={"ID":"a256b11f-e397-4876-899a-9103b48e5739","Type":"ContainerStarted","Data":"ad5c3014b2d234f595c5d3a49e8caf9f28d34fbe1d1446fa28fb1fc4760d88a3"} Jul 01 20:23:25.121334 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.121307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:25.121447 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.121372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2fdh\" (UniqueName: \"kubernetes.io/projected/d2c0b1fa-9412-46f9-90a7-61ba0656f022-kube-api-access-g2fdh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:25.121447 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.121407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:25.121644 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.121627 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:25.121696 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.121661 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:25.130361 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.130339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2fdh\" (UniqueName: \"kubernetes.io/projected/d2c0b1fa-9412-46f9-90a7-61ba0656f022-kube-api-access-g2fdh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:25.246848 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.246791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:25.373286 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.373259 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq"] Jul 01 20:23:25.374222 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:23:25.374196 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c0b1fa_9412_46f9_90a7_61ba0656f022.slice/crio-60e75eed2211aa6d0646519f1be36a7d065803c89c18da2f37cf7e8e376f18fb WatchSource:0}: Error finding container 60e75eed2211aa6d0646519f1be36a7d065803c89c18da2f37cf7e8e376f18fb: Status 404 returned error can't find the container with id 60e75eed2211aa6d0646519f1be36a7d065803c89c18da2f37cf7e8e376f18fb Jul 01 20:23:25.532787 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.532731 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm"] Jul 01 20:23:25.540616 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.540186 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.545433 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.545404 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm"] Jul 01 20:23:25.625092 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.625048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.625196 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.625109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk8gn\" (UniqueName: \"kubernetes.io/projected/b0ee6842-4453-40cd-a536-96e340dd1c54-kube-api-access-fk8gn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.625196 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.625163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.726619 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.726589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.726757 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.726631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk8gn\" (UniqueName: \"kubernetes.io/projected/b0ee6842-4453-40cd-a536-96e340dd1c54-kube-api-access-fk8gn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.726757 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.726673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.726885 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.726868 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.726988 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.726970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.736644 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.736611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk8gn\" (UniqueName: \"kubernetes.io/projected/b0ee6842-4453-40cd-a536-96e340dd1c54-kube-api-access-fk8gn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.851537 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.851514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:25.933720 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.933691 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp"] Jul 01 20:23:25.939815 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.939797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:25.945210 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:25.945182 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp"] Jul 01 20:23:26.022200 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.022178 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm"] Jul 01 20:23:26.029267 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.029241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:26.029364 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.029286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfspz\" (UniqueName: \"kubernetes.io/projected/982c822b-71ac-4704-a4ef-6f45d901c2a0-kube-api-access-gfspz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:26.029364 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.029343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:26.044074 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:23:26.044027 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ee6842_4453_40cd_a536_96e340dd1c54.slice/crio-0c42bca75d4e2087326499df17c3b95134b405366445ce98b939d13c466389d9 WatchSource:0}: Error finding container 0c42bca75d4e2087326499df17c3b95134b405366445ce98b939d13c466389d9: Status 404 returned error can't find the container with id 0c42bca75d4e2087326499df17c3b95134b405366445ce98b939d13c466389d9 Jul 01 20:23:26.066530 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.066503 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2c0b1fa-9412-46f9-90a7-61ba0656f022" containerID="e8fbb2d9fd4467c0d393d2e075ca0cd7ec76cd04fff9238a51125338d6bf50c8" exitCode=0 Jul 01 20:23:26.066619 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.066582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" event={"ID":"d2c0b1fa-9412-46f9-90a7-61ba0656f022","Type":"ContainerDied","Data":"e8fbb2d9fd4467c0d393d2e075ca0cd7ec76cd04fff9238a51125338d6bf50c8"} Jul 01 20:23:26.066664 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.066627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" event={"ID":"d2c0b1fa-9412-46f9-90a7-61ba0656f022","Type":"ContainerStarted","Data":"60e75eed2211aa6d0646519f1be36a7d065803c89c18da2f37cf7e8e376f18fb"} Jul 01 20:23:26.068547 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.068522 2578 generic.go:356] "Generic (PLEG): container finished" podID="a256b11f-e397-4876-899a-9103b48e5739" containerID="07791b3e7e2a9e5448dddb495e6444ba755be3c284765a0c60f4b0c680a1af25" exitCode=0 Jul 01 20:23:26.068634 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.068598 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" event={"ID":"a256b11f-e397-4876-899a-9103b48e5739","Type":"ContainerDied","Data":"07791b3e7e2a9e5448dddb495e6444ba755be3c284765a0c60f4b0c680a1af25"} Jul 01 20:23:26.069828 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.069809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" event={"ID":"b0ee6842-4453-40cd-a536-96e340dd1c54","Type":"ContainerStarted","Data":"0c42bca75d4e2087326499df17c3b95134b405366445ce98b939d13c466389d9"} Jul 01 20:23:26.130370 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.130338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:26.130506 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.130409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfspz\" (UniqueName: \"kubernetes.io/projected/982c822b-71ac-4704-a4ef-6f45d901c2a0-kube-api-access-gfspz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:26.130506 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.130468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:26.130838 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.130813 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:26.130946 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.130928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:26.138968 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.138950 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfspz\" (UniqueName: \"kubernetes.io/projected/982c822b-71ac-4704-a4ef-6f45d901c2a0-kube-api-access-gfspz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:26.254414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.254386 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:26.379427 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:26.379398 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp"] Jul 01 20:23:26.380642 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:23:26.380620 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982c822b_71ac_4704_a4ef_6f45d901c2a0.slice/crio-c5c35d702e18aeded6551a36797282d889ca9c10acb3a3bf4d303291a51593d7 WatchSource:0}: Error finding container c5c35d702e18aeded6551a36797282d889ca9c10acb3a3bf4d303291a51593d7: Status 404 returned error can't find the container with id c5c35d702e18aeded6551a36797282d889ca9c10acb3a3bf4d303291a51593d7 Jul 01 20:23:27.075845 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:27.075816 2578 generic.go:356] "Generic (PLEG): container finished" podID="b0ee6842-4453-40cd-a536-96e340dd1c54" containerID="fb41b9430f009d533779d2ab7af3024f08db6254de2063191ff9081e2180e990" exitCode=0 Jul 01 20:23:27.075956 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:27.075903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" event={"ID":"b0ee6842-4453-40cd-a536-96e340dd1c54","Type":"ContainerDied","Data":"fb41b9430f009d533779d2ab7af3024f08db6254de2063191ff9081e2180e990"} Jul 01 20:23:27.077906 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:27.077852 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2c0b1fa-9412-46f9-90a7-61ba0656f022" containerID="a8459761248f5fc18e1c084bd699eac61858b9881e4ffc63142c19b40454a1cb" exitCode=0 Jul 01 20:23:27.078007 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:27.077941 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" event={"ID":"d2c0b1fa-9412-46f9-90a7-61ba0656f022","Type":"ContainerDied","Data":"a8459761248f5fc18e1c084bd699eac61858b9881e4ffc63142c19b40454a1cb"} Jul 01 20:23:27.080297 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:27.080276 2578 generic.go:356] "Generic (PLEG): container finished" podID="a256b11f-e397-4876-899a-9103b48e5739" containerID="b85816a7ff0bef7b51b1b3e3fbc1f7313d114441298d7f934571182a8b66fd10" exitCode=0 Jul 01 20:23:27.080379 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:27.080357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" event={"ID":"a256b11f-e397-4876-899a-9103b48e5739","Type":"ContainerDied","Data":"b85816a7ff0bef7b51b1b3e3fbc1f7313d114441298d7f934571182a8b66fd10"} Jul 01 20:23:27.081883 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:27.081863 2578 generic.go:356] "Generic (PLEG): container finished" podID="982c822b-71ac-4704-a4ef-6f45d901c2a0" containerID="5c3cc752bb3ca17f03001666818e32c62617567b60a4eec2fb59fdfd393d0a84" exitCode=0 Jul 01 20:23:27.082000 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:27.081951 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" event={"ID":"982c822b-71ac-4704-a4ef-6f45d901c2a0","Type":"ContainerDied","Data":"5c3cc752bb3ca17f03001666818e32c62617567b60a4eec2fb59fdfd393d0a84"} Jul 01 20:23:27.082000 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:27.081995 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" event={"ID":"982c822b-71ac-4704-a4ef-6f45d901c2a0","Type":"ContainerStarted","Data":"c5c35d702e18aeded6551a36797282d889ca9c10acb3a3bf4d303291a51593d7"} Jul 01 20:23:28.088529 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.088499 2578 generic.go:356] "Generic (PLEG): container finished" podID="982c822b-71ac-4704-a4ef-6f45d901c2a0" containerID="49872725b0719ce26c00ad4ebfe83aeb9e160b3fb459b22d96393ed6562678be" exitCode=0 Jul 01 20:23:28.088828 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.088621 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" event={"ID":"982c822b-71ac-4704-a4ef-6f45d901c2a0","Type":"ContainerDied","Data":"49872725b0719ce26c00ad4ebfe83aeb9e160b3fb459b22d96393ed6562678be"} Jul 01 20:23:28.090493 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.090472 2578 generic.go:356] "Generic (PLEG): container finished" podID="b0ee6842-4453-40cd-a536-96e340dd1c54" containerID="a3fe6af281911adef0d25a3c88763db048632c5e7df3aeee026371f74aeef282" exitCode=0 Jul 01 20:23:28.090577 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.090550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" event={"ID":"b0ee6842-4453-40cd-a536-96e340dd1c54","Type":"ContainerDied","Data":"a3fe6af281911adef0d25a3c88763db048632c5e7df3aeee026371f74aeef282"} Jul 01 20:23:28.092657 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.092631 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2c0b1fa-9412-46f9-90a7-61ba0656f022" containerID="72acf397930d81a87b06bf336c41a6c5ed0b3f15edf848eddf03f527a73e7bad" exitCode=0 Jul 01 20:23:28.092778 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.092696 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" event={"ID":"d2c0b1fa-9412-46f9-90a7-61ba0656f022","Type":"ContainerDied","Data":"72acf397930d81a87b06bf336c41a6c5ed0b3f15edf848eddf03f527a73e7bad"} Jul 01 20:23:28.219617 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.219535 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:28.351916 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.351887 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-bundle\") pod \"a256b11f-e397-4876-899a-9103b48e5739\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " Jul 01 20:23:28.352048 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.351980 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-util\") pod \"a256b11f-e397-4876-899a-9103b48e5739\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " Jul 01 20:23:28.352048 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.352024 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68t46\" (UniqueName: \"kubernetes.io/projected/a256b11f-e397-4876-899a-9103b48e5739-kube-api-access-68t46\") pod \"a256b11f-e397-4876-899a-9103b48e5739\" (UID: \"a256b11f-e397-4876-899a-9103b48e5739\") " Jul 01 20:23:28.352483 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.352458 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-bundle" (OuterVolumeSpecName: "bundle") pod "a256b11f-e397-4876-899a-9103b48e5739" (UID: "a256b11f-e397-4876-899a-9103b48e5739"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:23:28.353924 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.353905 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a256b11f-e397-4876-899a-9103b48e5739-kube-api-access-68t46" (OuterVolumeSpecName: "kube-api-access-68t46") pod "a256b11f-e397-4876-899a-9103b48e5739" (UID: "a256b11f-e397-4876-899a-9103b48e5739"). InnerVolumeSpecName "kube-api-access-68t46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:23:28.356901 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.356882 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-util" (OuterVolumeSpecName: "util") pod "a256b11f-e397-4876-899a-9103b48e5739" (UID: "a256b11f-e397-4876-899a-9103b48e5739"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:23:28.453376 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.453348 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:28.453376 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.453369 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a256b11f-e397-4876-899a-9103b48e5739-util\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:28.453511 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:28.453383 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68t46\" (UniqueName: \"kubernetes.io/projected/a256b11f-e397-4876-899a-9103b48e5739-kube-api-access-68t46\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:29.099457 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.099421 2578 generic.go:356] "Generic (PLEG): container finished" podID="b0ee6842-4453-40cd-a536-96e340dd1c54" containerID="dddbc23542d8d51128d3095d824eb89cb22d40f5923db2ac28c858023cc73610" exitCode=0 Jul 01 20:23:29.099895 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.099508 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" event={"ID":"b0ee6842-4453-40cd-a536-96e340dd1c54","Type":"ContainerDied","Data":"dddbc23542d8d51128d3095d824eb89cb22d40f5923db2ac28c858023cc73610"} Jul 01 20:23:29.101310 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.101289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" event={"ID":"a256b11f-e397-4876-899a-9103b48e5739","Type":"ContainerDied","Data":"ad5c3014b2d234f595c5d3a49e8caf9f28d34fbe1d1446fa28fb1fc4760d88a3"} Jul 01 20:23:29.101414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.101329 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad5c3014b2d234f595c5d3a49e8caf9f28d34fbe1d1446fa28fb1fc4760d88a3" Jul 01 20:23:29.101414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.101298 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp" Jul 01 20:23:29.103286 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.103261 2578 generic.go:356] "Generic (PLEG): container finished" podID="982c822b-71ac-4704-a4ef-6f45d901c2a0" containerID="a21171fb79bd50e1e5f64afffa644166958190b64d03521f6557e97f819fcf4b" exitCode=0 Jul 01 20:23:29.103410 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.103289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" event={"ID":"982c822b-71ac-4704-a4ef-6f45d901c2a0","Type":"ContainerDied","Data":"a21171fb79bd50e1e5f64afffa644166958190b64d03521f6557e97f819fcf4b"} Jul 01 20:23:29.229393 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.229373 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:29.360304 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.360239 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-bundle\") pod \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " Jul 01 20:23:29.360304 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.360276 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-util\") pod \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " Jul 01 20:23:29.360454 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.360342 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2fdh\" (UniqueName: \"kubernetes.io/projected/d2c0b1fa-9412-46f9-90a7-61ba0656f022-kube-api-access-g2fdh\") pod \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\" (UID: \"d2c0b1fa-9412-46f9-90a7-61ba0656f022\") " Jul 01 20:23:29.360832 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.360806 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-bundle" (OuterVolumeSpecName: "bundle") pod "d2c0b1fa-9412-46f9-90a7-61ba0656f022" (UID: "d2c0b1fa-9412-46f9-90a7-61ba0656f022"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:23:29.362477 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.362451 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c0b1fa-9412-46f9-90a7-61ba0656f022-kube-api-access-g2fdh" (OuterVolumeSpecName: "kube-api-access-g2fdh") pod "d2c0b1fa-9412-46f9-90a7-61ba0656f022" (UID: "d2c0b1fa-9412-46f9-90a7-61ba0656f022"). InnerVolumeSpecName "kube-api-access-g2fdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:23:29.365648 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.365626 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-util" (OuterVolumeSpecName: "util") pod "d2c0b1fa-9412-46f9-90a7-61ba0656f022" (UID: "d2c0b1fa-9412-46f9-90a7-61ba0656f022"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:23:29.461042 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.461017 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:29.461042 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.461037 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c0b1fa-9412-46f9-90a7-61ba0656f022-util\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:29.461187 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:29.461046 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2fdh\" (UniqueName: \"kubernetes.io/projected/d2c0b1fa-9412-46f9-90a7-61ba0656f022-kube-api-access-g2fdh\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:30.110306 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.110280 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" Jul 01 20:23:30.110741 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.110303 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq" event={"ID":"d2c0b1fa-9412-46f9-90a7-61ba0656f022","Type":"ContainerDied","Data":"60e75eed2211aa6d0646519f1be36a7d065803c89c18da2f37cf7e8e376f18fb"} Jul 01 20:23:30.110741 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.110351 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60e75eed2211aa6d0646519f1be36a7d065803c89c18da2f37cf7e8e376f18fb" Jul 01 20:23:30.241458 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.241436 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:30.266301 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.266277 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:30.367822 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.367756 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk8gn\" (UniqueName: \"kubernetes.io/projected/b0ee6842-4453-40cd-a536-96e340dd1c54-kube-api-access-fk8gn\") pod \"b0ee6842-4453-40cd-a536-96e340dd1c54\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " Jul 01 20:23:30.367822 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.367794 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-util\") pod \"982c822b-71ac-4704-a4ef-6f45d901c2a0\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " Jul 01 20:23:30.367994 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.367838 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-bundle\") pod \"982c822b-71ac-4704-a4ef-6f45d901c2a0\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " Jul 01 20:23:30.367994 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.367866 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfspz\" (UniqueName: \"kubernetes.io/projected/982c822b-71ac-4704-a4ef-6f45d901c2a0-kube-api-access-gfspz\") pod \"982c822b-71ac-4704-a4ef-6f45d901c2a0\" (UID: \"982c822b-71ac-4704-a4ef-6f45d901c2a0\") " Jul 01 20:23:30.367994 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.367914 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-util\") pod \"b0ee6842-4453-40cd-a536-96e340dd1c54\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " Jul 01 20:23:30.367994 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.367936 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-bundle\") pod \"b0ee6842-4453-40cd-a536-96e340dd1c54\" (UID: \"b0ee6842-4453-40cd-a536-96e340dd1c54\") " Jul 01 20:23:30.368437 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.368382 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-bundle" (OuterVolumeSpecName: "bundle") pod "982c822b-71ac-4704-a4ef-6f45d901c2a0" (UID: "982c822b-71ac-4704-a4ef-6f45d901c2a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:23:30.368596 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.368565 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-bundle" (OuterVolumeSpecName: "bundle") pod "b0ee6842-4453-40cd-a536-96e340dd1c54" (UID: "b0ee6842-4453-40cd-a536-96e340dd1c54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:23:30.370013 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.369986 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/982c822b-71ac-4704-a4ef-6f45d901c2a0-kube-api-access-gfspz" (OuterVolumeSpecName: "kube-api-access-gfspz") pod "982c822b-71ac-4704-a4ef-6f45d901c2a0" (UID: "982c822b-71ac-4704-a4ef-6f45d901c2a0"). InnerVolumeSpecName "kube-api-access-gfspz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:23:30.370258 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.370238 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ee6842-4453-40cd-a536-96e340dd1c54-kube-api-access-fk8gn" (OuterVolumeSpecName: "kube-api-access-fk8gn") pod "b0ee6842-4453-40cd-a536-96e340dd1c54" (UID: "b0ee6842-4453-40cd-a536-96e340dd1c54"). InnerVolumeSpecName "kube-api-access-fk8gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:23:30.373863 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.373819 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-util" (OuterVolumeSpecName: "util") pod "982c822b-71ac-4704-a4ef-6f45d901c2a0" (UID: "982c822b-71ac-4704-a4ef-6f45d901c2a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:23:30.374288 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.374268 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-util" (OuterVolumeSpecName: "util") pod "b0ee6842-4453-40cd-a536-96e340dd1c54" (UID: "b0ee6842-4453-40cd-a536-96e340dd1c54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:23:30.469126 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.469104 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfspz\" (UniqueName: \"kubernetes.io/projected/982c822b-71ac-4704-a4ef-6f45d901c2a0-kube-api-access-gfspz\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:30.469126 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.469125 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-util\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:30.469244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.469134 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0ee6842-4453-40cd-a536-96e340dd1c54-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:30.469244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.469143 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk8gn\" (UniqueName: \"kubernetes.io/projected/b0ee6842-4453-40cd-a536-96e340dd1c54-kube-api-access-fk8gn\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:30.469244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.469152 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-util\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:30.469244 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:30.469161 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/982c822b-71ac-4704-a4ef-6f45d901c2a0-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:23:31.117555 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:31.117523 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" Jul 01 20:23:31.117555 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:31.117546 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm" event={"ID":"b0ee6842-4453-40cd-a536-96e340dd1c54","Type":"ContainerDied","Data":"0c42bca75d4e2087326499df17c3b95134b405366445ce98b939d13c466389d9"} Jul 01 20:23:31.118000 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:31.117591 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c42bca75d4e2087326499df17c3b95134b405366445ce98b939d13c466389d9" Jul 01 20:23:31.119291 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:31.119263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" event={"ID":"982c822b-71ac-4704-a4ef-6f45d901c2a0","Type":"ContainerDied","Data":"c5c35d702e18aeded6551a36797282d889ca9c10acb3a3bf4d303291a51593d7"} Jul 01 20:23:31.119434 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:31.119301 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp" Jul 01 20:23:31.119434 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:31.119303 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5c35d702e18aeded6551a36797282d889ca9c10acb3a3bf4d303291a51593d7" Jul 01 20:23:44.636474 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636438 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f74666dcf-nxxng"] Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636758 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a256b11f-e397-4876-899a-9103b48e5739" containerName="util" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636769 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a256b11f-e397-4876-899a-9103b48e5739" containerName="util" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636777 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a256b11f-e397-4876-899a-9103b48e5739" containerName="pull" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636783 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a256b11f-e397-4876-899a-9103b48e5739" containerName="pull" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636788 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c0b1fa-9412-46f9-90a7-61ba0656f022" containerName="extract" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636794 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c0b1fa-9412-46f9-90a7-61ba0656f022" containerName="extract" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636801 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ee6842-4453-40cd-a536-96e340dd1c54" containerName="pull" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636805 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ee6842-4453-40cd-a536-96e340dd1c54" containerName="pull" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636816 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a256b11f-e397-4876-899a-9103b48e5739" containerName="extract" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636821 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a256b11f-e397-4876-899a-9103b48e5739" containerName="extract" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636827 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c0b1fa-9412-46f9-90a7-61ba0656f022" containerName="pull" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636832 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c0b1fa-9412-46f9-90a7-61ba0656f022" containerName="pull" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636843 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982c822b-71ac-4704-a4ef-6f45d901c2a0" containerName="util" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636848 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="982c822b-71ac-4704-a4ef-6f45d901c2a0" containerName="util" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636858 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ee6842-4453-40cd-a536-96e340dd1c54" containerName="util" Jul 01 20:23:44.636857 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636864 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ee6842-4453-40cd-a536-96e340dd1c54" containerName="util" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636872 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c0b1fa-9412-46f9-90a7-61ba0656f022" containerName="util" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636876 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c0b1fa-9412-46f9-90a7-61ba0656f022" containerName="util" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636882 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982c822b-71ac-4704-a4ef-6f45d901c2a0" containerName="pull" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636887 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="982c822b-71ac-4704-a4ef-6f45d901c2a0" containerName="pull" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636894 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982c822b-71ac-4704-a4ef-6f45d901c2a0" containerName="extract" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636899 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="982c822b-71ac-4704-a4ef-6f45d901c2a0" containerName="extract" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636904 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ee6842-4453-40cd-a536-96e340dd1c54" containerName="extract" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636908 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ee6842-4453-40cd-a536-96e340dd1c54" containerName="extract" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636963 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ee6842-4453-40cd-a536-96e340dd1c54" containerName="extract" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636970 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a256b11f-e397-4876-899a-9103b48e5739" containerName="extract" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636975 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c0b1fa-9412-46f9-90a7-61ba0656f022" containerName="extract" Jul 01 20:23:44.637357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.636980 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="982c822b-71ac-4704-a4ef-6f45d901c2a0" containerName="extract" Jul 01 20:23:44.640663 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.640645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.650529 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.650504 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f74666dcf-nxxng"] Jul 01 20:23:44.771795 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.771761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t2sj\" (UniqueName: \"kubernetes.io/projected/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-kube-api-access-4t2sj\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.771940 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.771803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-console-serving-cert\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.771940 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.771818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-trusted-ca-bundle\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.771940 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.771835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-console-oauth-config\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.772149 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.771941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-console-config\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.772149 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.772007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-oauth-serving-cert\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.772149 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.772043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-service-ca\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.826774 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.826747 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2"] Jul 01 20:23:44.828950 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.828936 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2" Jul 01 20:23:44.831560 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.831545 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dg7lh\"" Jul 01 20:23:44.838952 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.838933 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2"] Jul 01 20:23:44.873213 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.873186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-oauth-serving-cert\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.873326 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.873218 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-service-ca\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.873326 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.873251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t2sj\" (UniqueName: \"kubernetes.io/projected/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-kube-api-access-4t2sj\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.873326 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.873291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-console-serving-cert\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.873326 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.873314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-trusted-ca-bundle\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.873536 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.873342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-console-oauth-config\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.873536 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.873389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-console-config\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.873917 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.873892 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-oauth-serving-cert\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.874038 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.874015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-service-ca\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.874147 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.874018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-console-config\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.874332 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.874309 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-trusted-ca-bundle\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.875809 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.875787 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-console-oauth-config\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.875887 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.875798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-console-serving-cert\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.883015 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.882994 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t2sj\" (UniqueName: \"kubernetes.io/projected/d1f847e9-eb78-48f8-8943-59cc57ab0e3e-kube-api-access-4t2sj\") pod \"console-5f74666dcf-nxxng\" (UID: \"d1f847e9-eb78-48f8-8943-59cc57ab0e3e\") " pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.950851 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.950801 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:44.974189 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:44.974167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmlp9\" (UniqueName: \"kubernetes.io/projected/aa2c21e3-f4a9-48c8-b801-3dc05b6920f7-kube-api-access-pmlp9\") pod \"authorino-operator-75cc8d5cb7-bm6p2\" (UID: \"aa2c21e3-f4a9-48c8-b801-3dc05b6920f7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2" Jul 01 20:23:45.074809 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:45.074773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmlp9\" (UniqueName: \"kubernetes.io/projected/aa2c21e3-f4a9-48c8-b801-3dc05b6920f7-kube-api-access-pmlp9\") pod \"authorino-operator-75cc8d5cb7-bm6p2\" (UID: \"aa2c21e3-f4a9-48c8-b801-3dc05b6920f7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2" Jul 01 20:23:45.086718 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:45.086688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmlp9\" (UniqueName: \"kubernetes.io/projected/aa2c21e3-f4a9-48c8-b801-3dc05b6920f7-kube-api-access-pmlp9\") pod \"authorino-operator-75cc8d5cb7-bm6p2\" (UID: \"aa2c21e3-f4a9-48c8-b801-3dc05b6920f7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2" Jul 01 20:23:45.100364 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:45.100345 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f74666dcf-nxxng"] Jul 01 20:23:45.102341 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:23:45.102314 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f847e9_eb78_48f8_8943_59cc57ab0e3e.slice/crio-ded32174e17c02e1ef493338a7d43353c61b5e587d2b42fbd79bd65fa59fd2cd WatchSource:0}: Error finding container ded32174e17c02e1ef493338a7d43353c61b5e587d2b42fbd79bd65fa59fd2cd: Status 404 returned error can't find the container with id ded32174e17c02e1ef493338a7d43353c61b5e587d2b42fbd79bd65fa59fd2cd Jul 01 20:23:45.138747 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:45.138727 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2" Jul 01 20:23:45.192784 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:45.192632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f74666dcf-nxxng" event={"ID":"d1f847e9-eb78-48f8-8943-59cc57ab0e3e","Type":"ContainerStarted","Data":"17e1292c2816112b349f9dd105e342a4631e490dc5a392af250d10de999ba15c"} Jul 01 20:23:45.192784 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:45.192696 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f74666dcf-nxxng" event={"ID":"d1f847e9-eb78-48f8-8943-59cc57ab0e3e","Type":"ContainerStarted","Data":"ded32174e17c02e1ef493338a7d43353c61b5e587d2b42fbd79bd65fa59fd2cd"} Jul 01 20:23:45.214233 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:45.214144 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f74666dcf-nxxng" podStartSLOduration=1.214123082 podStartE2EDuration="1.214123082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:23:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:23:45.212613942 +0000 UTC m=+391.420923188" watchObservedRunningTime="2026-07-01 20:23:45.214123082 +0000 UTC m=+391.422432327" Jul 01 20:23:45.278969 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:45.278944 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2"] Jul 01 20:23:45.280017 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:23:45.279989 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2c21e3_f4a9_48c8_b801_3dc05b6920f7.slice/crio-eaaede9f7f347a2eda716bd416ef42978cc8bbd5bdbe5d0ca835a53674492df4 WatchSource:0}: Error finding container eaaede9f7f347a2eda716bd416ef42978cc8bbd5bdbe5d0ca835a53674492df4: Status 404 returned error can't find the container with id eaaede9f7f347a2eda716bd416ef42978cc8bbd5bdbe5d0ca835a53674492df4 Jul 01 20:23:46.206774 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:46.206724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2" event={"ID":"aa2c21e3-f4a9-48c8-b801-3dc05b6920f7","Type":"ContainerStarted","Data":"eaaede9f7f347a2eda716bd416ef42978cc8bbd5bdbe5d0ca835a53674492df4"} Jul 01 20:23:48.218879 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:48.218835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2" event={"ID":"aa2c21e3-f4a9-48c8-b801-3dc05b6920f7","Type":"ContainerStarted","Data":"6ae0890e613f0d762c692ae09fc9be0925a1ae9e4c94d9bb1b577c057875e1ec"} Jul 01 20:23:48.219323 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:48.218926 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2" Jul 01 20:23:48.238525 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:48.238485 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2" podStartSLOduration=2.043675587 podStartE2EDuration="4.23847106s" totalImagesPullingTime="2.194795473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:23:48.237334914 +0000 UTC m=+394.445644167" watchObservedRunningTime="2026-07-01 20:23:48.23847106 +0000 UTC m=+394.446780299" Jul 01 20:23:54.951932 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:54.951900 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:54.952327 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:54.951950 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:54.956415 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:54.956394 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:55.256874 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:55.256803 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f74666dcf-nxxng" Jul 01 20:23:55.312369 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:55.312340 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ddf5bf8c5-pjwt2"] Jul 01 20:23:59.227424 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:23:59.227392 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bm6p2" Jul 01 20:24:03.592099 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.592065 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9"] Jul 01 20:24:03.595460 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.595442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:03.598697 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.598678 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 01 20:24:03.598798 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.598683 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bkgmg\"" Jul 01 20:24:03.598798 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.598683 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 01 20:24:03.603630 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.603606 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9"] Jul 01 20:24:03.619258 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.619234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6c612ee-9511-49e1-8d09-b14d46b3b8b9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-p6pz9\" (UID: \"b6c612ee-9511-49e1-8d09-b14d46b3b8b9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:03.619363 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.619264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6c612ee-9511-49e1-8d09-b14d46b3b8b9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-p6pz9\" (UID: \"b6c612ee-9511-49e1-8d09-b14d46b3b8b9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:03.619363 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.619312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgvw\" (UniqueName: \"kubernetes.io/projected/b6c612ee-9511-49e1-8d09-b14d46b3b8b9-kube-api-access-zrgvw\") pod \"kuadrant-console-plugin-66b5774985-p6pz9\" (UID: \"b6c612ee-9511-49e1-8d09-b14d46b3b8b9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:03.719846 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.719818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgvw\" (UniqueName: \"kubernetes.io/projected/b6c612ee-9511-49e1-8d09-b14d46b3b8b9-kube-api-access-zrgvw\") pod \"kuadrant-console-plugin-66b5774985-p6pz9\" (UID: \"b6c612ee-9511-49e1-8d09-b14d46b3b8b9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:03.719946 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.719889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6c612ee-9511-49e1-8d09-b14d46b3b8b9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-p6pz9\" (UID: \"b6c612ee-9511-49e1-8d09-b14d46b3b8b9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:03.719946 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.719925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6c612ee-9511-49e1-8d09-b14d46b3b8b9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-p6pz9\" (UID: \"b6c612ee-9511-49e1-8d09-b14d46b3b8b9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:03.720650 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.720628 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6c612ee-9511-49e1-8d09-b14d46b3b8b9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-p6pz9\" (UID: \"b6c612ee-9511-49e1-8d09-b14d46b3b8b9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:03.722580 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.722554 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6c612ee-9511-49e1-8d09-b14d46b3b8b9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-p6pz9\" (UID: \"b6c612ee-9511-49e1-8d09-b14d46b3b8b9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:03.729623 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.729598 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgvw\" (UniqueName: \"kubernetes.io/projected/b6c612ee-9511-49e1-8d09-b14d46b3b8b9-kube-api-access-zrgvw\") pod \"kuadrant-console-plugin-66b5774985-p6pz9\" (UID: \"b6c612ee-9511-49e1-8d09-b14d46b3b8b9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:03.905124 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:03.905049 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" Jul 01 20:24:04.033924 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:04.033900 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9"] Jul 01 20:24:04.035503 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:24:04.035475 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6c612ee_9511_49e1_8d09_b14d46b3b8b9.slice/crio-7526bba454091db17d33da6e12aa620d75235ea743139b251e4472d7d6978ad6 WatchSource:0}: Error finding container 7526bba454091db17d33da6e12aa620d75235ea743139b251e4472d7d6978ad6: Status 404 returned error can't find the container with id 7526bba454091db17d33da6e12aa620d75235ea743139b251e4472d7d6978ad6 Jul 01 20:24:04.297385 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:04.297317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" event={"ID":"b6c612ee-9511-49e1-8d09-b14d46b3b8b9","Type":"ContainerStarted","Data":"7526bba454091db17d33da6e12aa620d75235ea743139b251e4472d7d6978ad6"} Jul 01 20:24:20.332514 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:20.332454 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7ddf5bf8c5-pjwt2" podUID="53083167-0375-4657-85f2-d572379730e8" containerName="console" containerID="cri-o://f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b" gracePeriod=15 Jul 01 20:24:21.154311 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:21.154274 2578 patch_prober.go:28] interesting pod/console-7ddf5bf8c5-pjwt2 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jul 01 20:24:21.154496 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:21.154351 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7ddf5bf8c5-pjwt2" podUID="53083167-0375-4657-85f2-d572379730e8" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jul 01 20:24:27.066898 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.066873 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:24:27.132854 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.132823 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-oauth-config\") pod \"53083167-0375-4657-85f2-d572379730e8\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " Jul 01 20:24:27.132854 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.132857 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-serving-cert\") pod \"53083167-0375-4657-85f2-d572379730e8\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " Jul 01 20:24:27.133098 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.132903 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-console-config\") pod \"53083167-0375-4657-85f2-d572379730e8\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " Jul 01 20:24:27.133098 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.132923 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmrm6\" (UniqueName: \"kubernetes.io/projected/53083167-0375-4657-85f2-d572379730e8-kube-api-access-hmrm6\") pod \"53083167-0375-4657-85f2-d572379730e8\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " Jul 01 20:24:27.133098 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.132950 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-oauth-serving-cert\") pod \"53083167-0375-4657-85f2-d572379730e8\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " Jul 01 20:24:27.133098 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.132999 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-service-ca\") pod \"53083167-0375-4657-85f2-d572379730e8\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " Jul 01 20:24:27.133098 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.133022 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-trusted-ca-bundle\") pod \"53083167-0375-4657-85f2-d572379730e8\" (UID: \"53083167-0375-4657-85f2-d572379730e8\") " Jul 01 20:24:27.133505 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.133425 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53083167-0375-4657-85f2-d572379730e8" (UID: "53083167-0375-4657-85f2-d572379730e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:24:27.133602 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.133396 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-console-config" (OuterVolumeSpecName: "console-config") pod "53083167-0375-4657-85f2-d572379730e8" (UID: "53083167-0375-4657-85f2-d572379730e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:24:27.133602 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.133581 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "53083167-0375-4657-85f2-d572379730e8" (UID: "53083167-0375-4657-85f2-d572379730e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:24:27.133691 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.133589 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "53083167-0375-4657-85f2-d572379730e8" (UID: "53083167-0375-4657-85f2-d572379730e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:24:27.135012 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.134987 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53083167-0375-4657-85f2-d572379730e8" (UID: "53083167-0375-4657-85f2-d572379730e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:24:27.135106 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.135003 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53083167-0375-4657-85f2-d572379730e8" (UID: "53083167-0375-4657-85f2-d572379730e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:24:27.135106 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.135009 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53083167-0375-4657-85f2-d572379730e8-kube-api-access-hmrm6" (OuterVolumeSpecName: "kube-api-access-hmrm6") pod "53083167-0375-4657-85f2-d572379730e8" (UID: "53083167-0375-4657-85f2-d572379730e8"). InnerVolumeSpecName "kube-api-access-hmrm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:24:27.234600 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.234542 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-oauth-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:24:27.234600 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.234562 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53083167-0375-4657-85f2-d572379730e8-console-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:24:27.234600 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.234572 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-console-config\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:24:27.234600 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.234581 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmrm6\" (UniqueName: \"kubernetes.io/projected/53083167-0375-4657-85f2-d572379730e8-kube-api-access-hmrm6\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:24:27.234600 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.234589 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-oauth-serving-cert\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:24:27.234600 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.234597 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-service-ca\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:24:27.234600 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.234605 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53083167-0375-4657-85f2-d572379730e8-trusted-ca-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:24:27.438242 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.438207 2578 generic.go:356] "Generic (PLEG): container finished" podID="53083167-0375-4657-85f2-d572379730e8" containerID="f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b" exitCode=0 Jul 01 20:24:27.438386 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.438265 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddf5bf8c5-pjwt2" Jul 01 20:24:27.438386 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.438332 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddf5bf8c5-pjwt2" event={"ID":"53083167-0375-4657-85f2-d572379730e8","Type":"ContainerDied","Data":"f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b"} Jul 01 20:24:27.438477 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.438388 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddf5bf8c5-pjwt2" event={"ID":"53083167-0375-4657-85f2-d572379730e8","Type":"ContainerDied","Data":"abbb4f71cc94ebd12a9b7052ccadbe8f4a080036d75b2a3c7bebf3891144b229"} Jul 01 20:24:27.438477 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.438419 2578 scope.go:117] "RemoveContainer" containerID="f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b" Jul 01 20:24:27.440180 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.440146 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" event={"ID":"b6c612ee-9511-49e1-8d09-b14d46b3b8b9","Type":"ContainerStarted","Data":"f3897c1516a395d22d59a62244014d6b8d87f7ae2463dfd5d8e9683992ffe331"} Jul 01 20:24:27.447610 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.447594 2578 scope.go:117] "RemoveContainer" containerID="f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b" Jul 01 20:24:27.447843 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:24:27.447826 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b\": container with ID starting with f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b not found: ID does not exist" containerID="f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b" Jul 01 20:24:27.447909 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.447860 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b"} err="failed to get container status \"f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b\": rpc error: code = NotFound desc = could not find container \"f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b\": container with ID starting with f31327241aa91cf4c61c5d191f406ed3b81db75ab8483f32462106eafeba801b not found: ID does not exist" Jul 01 20:24:27.484729 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.484663 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6pz9" podStartSLOduration=1.52910335 podStartE2EDuration="24.484649287s" totalImagesPullingTime="22.955545937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:24:27.484571178 +0000 UTC m=+433.692880421" watchObservedRunningTime="2026-07-01 20:24:27.484649287 +0000 UTC m=+433.692958531" Jul 01 20:24:27.516505 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.516481 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ddf5bf8c5-pjwt2"] Jul 01 20:24:27.526357 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:27.526333 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ddf5bf8c5-pjwt2"] Jul 01 20:24:28.226709 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:28.226643 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53083167-0375-4657-85f2-d572379730e8" path="/var/lib/kubelet/pods/53083167-0375-4657-85f2-d572379730e8/volumes" Jul 01 20:24:44.269704 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.269667 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw"] Jul 01 20:24:44.270282 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.270259 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53083167-0375-4657-85f2-d572379730e8" containerName="console" Jul 01 20:24:44.270400 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.270286 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="53083167-0375-4657-85f2-d572379730e8" containerName="console" Jul 01 20:24:44.270459 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.270436 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="53083167-0375-4657-85f2-d572379730e8" containerName="console" Jul 01 20:24:44.290569 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.290542 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw"] Jul 01 20:24:44.290712 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.290622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.293333 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.293310 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lxsvb\"" Jul 01 20:24:44.464387 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.464356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.464553 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.464396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.464553 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.464413 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.464553 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.464428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.464553 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.464470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.464553 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.464517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsnw8\" (UniqueName: \"kubernetes.io/projected/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-kube-api-access-zsnw8\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.464780 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.464613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.464780 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.464667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.464780 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.464739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.565679 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.565656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.565806 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.565690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.565806 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.565708 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.565806 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.565724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.565806 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.565742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.565990 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.565798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsnw8\" (UniqueName: \"kubernetes.io/projected/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-kube-api-access-zsnw8\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.565990 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.565886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.565990 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.565943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.565990 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.565978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.566404 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.566248 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.566404 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.566275 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.566404 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.566311 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.566404 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.566365 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.566797 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.566775 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.568143 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.568123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.568348 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.568330 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.573832 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.573807 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.574176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.574160 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsnw8\" (UniqueName: \"kubernetes.io/projected/18c25c3b-a9d7-4c04-99c2-e79f8ac23265-kube-api-access-zsnw8\") pod \"maas-default-gateway-openshift-default-56654dcf7-tcqqw\" (UID: \"18c25c3b-a9d7-4c04-99c2-e79f8ac23265\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.600676 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.600654 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:44.735466 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.735440 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw"] Jul 01 20:24:44.736626 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:24:44.736603 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c25c3b_a9d7_4c04_99c2_e79f8ac23265.slice/crio-b2f427df6b75aa34a95bcd30a44914369fd047d2f1e0960c8d1be6795d2b4c42 WatchSource:0}: Error finding container b2f427df6b75aa34a95bcd30a44914369fd047d2f1e0960c8d1be6795d2b4c42: Status 404 returned error can't find the container with id b2f427df6b75aa34a95bcd30a44914369fd047d2f1e0960c8d1be6795d2b4c42 Jul 01 20:24:44.739287 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.739246 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 20:24:44.739374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.739315 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 20:24:44.739374 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:44.739343 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 20:24:45.536248 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:45.536215 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" event={"ID":"18c25c3b-a9d7-4c04-99c2-e79f8ac23265","Type":"ContainerStarted","Data":"86f0e193335aaff260ffd06c4b2a73335cc905f9d1ce666041205744537a0bad"} Jul 01 20:24:45.536603 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:45.536268 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" event={"ID":"18c25c3b-a9d7-4c04-99c2-e79f8ac23265","Type":"ContainerStarted","Data":"b2f427df6b75aa34a95bcd30a44914369fd047d2f1e0960c8d1be6795d2b4c42"} Jul 01 20:24:45.557720 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:45.557651 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" podStartSLOduration=1.557633493 podStartE2EDuration="1.557633493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:24:45.557468544 +0000 UTC m=+451.765777798" watchObservedRunningTime="2026-07-01 20:24:45.557633493 +0000 UTC m=+451.765942739" Jul 01 20:24:45.601145 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:45.601119 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:45.605329 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:45.605302 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:46.542102 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:46.542075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:46.542929 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:46.542910 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:24:56.192734 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.192699 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-krv9p"] Jul 01 20:24:56.279126 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.279095 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:24:56.280265 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.279141 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-krv9p"] Jul 01 20:24:56.283985 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.283965 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 20:24:56.288849 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.288826 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-krv9p"] Jul 01 20:24:56.359625 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.359599 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvrpx\" (UniqueName: \"kubernetes.io/projected/54a9d0c7-beda-40c1-a38b-2d7121b805f5-kube-api-access-mvrpx\") pod \"limitador-limitador-64c94fd64f-krv9p\" (UID: \"54a9d0c7-beda-40c1-a38b-2d7121b805f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:24:56.360079 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.360029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54a9d0c7-beda-40c1-a38b-2d7121b805f5-config-file\") pod \"limitador-limitador-64c94fd64f-krv9p\" (UID: \"54a9d0c7-beda-40c1-a38b-2d7121b805f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:24:56.461158 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.461036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvrpx\" (UniqueName: \"kubernetes.io/projected/54a9d0c7-beda-40c1-a38b-2d7121b805f5-kube-api-access-mvrpx\") pod \"limitador-limitador-64c94fd64f-krv9p\" (UID: \"54a9d0c7-beda-40c1-a38b-2d7121b805f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:24:56.461158 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.461138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54a9d0c7-beda-40c1-a38b-2d7121b805f5-config-file\") pod \"limitador-limitador-64c94fd64f-krv9p\" (UID: \"54a9d0c7-beda-40c1-a38b-2d7121b805f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:24:56.461751 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.461732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54a9d0c7-beda-40c1-a38b-2d7121b805f5-config-file\") pod \"limitador-limitador-64c94fd64f-krv9p\" (UID: \"54a9d0c7-beda-40c1-a38b-2d7121b805f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:24:56.469909 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.469886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvrpx\" (UniqueName: \"kubernetes.io/projected/54a9d0c7-beda-40c1-a38b-2d7121b805f5-kube-api-access-mvrpx\") pod \"limitador-limitador-64c94fd64f-krv9p\" (UID: \"54a9d0c7-beda-40c1-a38b-2d7121b805f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:24:56.594388 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.594360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:24:56.752112 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:56.752088 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-krv9p"] Jul 01 20:24:56.752940 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:24:56.752914 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a9d0c7_beda_40c1_a38b_2d7121b805f5.slice/crio-85f479bfe0ae3fea9706ddc3df96329210b129f1777086e14644a3e32dcf0d1f WatchSource:0}: Error finding container 85f479bfe0ae3fea9706ddc3df96329210b129f1777086e14644a3e32dcf0d1f: Status 404 returned error can't find the container with id 85f479bfe0ae3fea9706ddc3df96329210b129f1777086e14644a3e32dcf0d1f Jul 01 20:24:57.603774 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:57.603735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" event={"ID":"54a9d0c7-beda-40c1-a38b-2d7121b805f5","Type":"ContainerStarted","Data":"85f479bfe0ae3fea9706ddc3df96329210b129f1777086e14644a3e32dcf0d1f"} Jul 01 20:24:59.620350 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:59.620278 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" event={"ID":"54a9d0c7-beda-40c1-a38b-2d7121b805f5","Type":"ContainerStarted","Data":"e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5"} Jul 01 20:24:59.620689 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:59.620400 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:24:59.639573 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:24:59.639530 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" podStartSLOduration=1.046292067 podStartE2EDuration="3.639516526s" totalImagesPullingTime="2.593224459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:24:59.638551118 +0000 UTC m=+465.846860361" watchObservedRunningTime="2026-07-01 20:24:59.639516526 +0000 UTC m=+465.847825767" Jul 01 20:25:10.625660 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:10.625631 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:25:13.318433 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:13.318400 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-krv9p"] Jul 01 20:25:13.318880 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:13.318566 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" podUID="54a9d0c7-beda-40c1-a38b-2d7121b805f5" containerName="limitador" containerID="cri-o://e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5" gracePeriod=30 Jul 01 20:25:13.857262 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:13.857237 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:25:13.895710 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:13.895642 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvrpx\" (UniqueName: \"kubernetes.io/projected/54a9d0c7-beda-40c1-a38b-2d7121b805f5-kube-api-access-mvrpx\") pod \"54a9d0c7-beda-40c1-a38b-2d7121b805f5\" (UID: \"54a9d0c7-beda-40c1-a38b-2d7121b805f5\") " Jul 01 20:25:13.895829 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:13.895727 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54a9d0c7-beda-40c1-a38b-2d7121b805f5-config-file\") pod \"54a9d0c7-beda-40c1-a38b-2d7121b805f5\" (UID: \"54a9d0c7-beda-40c1-a38b-2d7121b805f5\") " Jul 01 20:25:13.896080 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:13.896045 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54a9d0c7-beda-40c1-a38b-2d7121b805f5-config-file" (OuterVolumeSpecName: "config-file") pod "54a9d0c7-beda-40c1-a38b-2d7121b805f5" (UID: "54a9d0c7-beda-40c1-a38b-2d7121b805f5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:25:13.897621 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:13.897599 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54a9d0c7-beda-40c1-a38b-2d7121b805f5-kube-api-access-mvrpx" (OuterVolumeSpecName: "kube-api-access-mvrpx") pod "54a9d0c7-beda-40c1-a38b-2d7121b805f5" (UID: "54a9d0c7-beda-40c1-a38b-2d7121b805f5"). InnerVolumeSpecName "kube-api-access-mvrpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:25:13.997485 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:13.997455 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvrpx\" (UniqueName: \"kubernetes.io/projected/54a9d0c7-beda-40c1-a38b-2d7121b805f5-kube-api-access-mvrpx\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:25:13.997485 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:13.997483 2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54a9d0c7-beda-40c1-a38b-2d7121b805f5-config-file\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:25:14.697459 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:14.697432 2578 generic.go:356] "Generic (PLEG): container finished" podID="54a9d0c7-beda-40c1-a38b-2d7121b805f5" containerID="e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5" exitCode=0 Jul 01 20:25:14.697858 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:14.697467 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" event={"ID":"54a9d0c7-beda-40c1-a38b-2d7121b805f5","Type":"ContainerDied","Data":"e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5"} Jul 01 20:25:14.697858 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:14.697515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" event={"ID":"54a9d0c7-beda-40c1-a38b-2d7121b805f5","Type":"ContainerDied","Data":"85f479bfe0ae3fea9706ddc3df96329210b129f1777086e14644a3e32dcf0d1f"} Jul 01 20:25:14.697858 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:14.697541 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-krv9p" Jul 01 20:25:14.697858 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:14.697544 2578 scope.go:117] "RemoveContainer" containerID="e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5" Jul 01 20:25:14.706270 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:14.706253 2578 scope.go:117] "RemoveContainer" containerID="e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5" Jul 01 20:25:14.706508 ip-10-0-140-83 kubenswrapper[2578]: E0701 20:25:14.706491 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5\": container with ID starting with e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5 not found: ID does not exist" containerID="e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5" Jul 01 20:25:14.706559 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:14.706515 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5"} err="failed to get container status \"e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5\": rpc error: code = NotFound desc = could not find container \"e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5\": container with ID starting with e7d66e74f7d6aea4782d5f9fbec12e10d9add13b7474e96cfe6d0a165a6ce4e5 not found: ID does not exist" Jul 01 20:25:14.723837 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:14.723815 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-krv9p"] Jul 01 20:25:14.727520 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:14.727501 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-krv9p"] Jul 01 20:25:16.227190 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:16.227153 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54a9d0c7-beda-40c1-a38b-2d7121b805f5" path="/var/lib/kubelet/pods/54a9d0c7-beda-40c1-a38b-2d7121b805f5/volumes" Jul 01 20:25:27.780437 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.780406 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7"] Jul 01 20:25:27.780811 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.780759 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54a9d0c7-beda-40c1-a38b-2d7121b805f5" containerName="limitador" Jul 01 20:25:27.780811 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.780769 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54a9d0c7-beda-40c1-a38b-2d7121b805f5" containerName="limitador" Jul 01 20:25:27.780883 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.780841 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54a9d0c7-beda-40c1-a38b-2d7121b805f5" containerName="limitador" Jul 01 20:25:27.784032 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.784014 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:27.786752 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.786729 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 20:25:27.786878 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.786750 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 20:25:27.786878 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.786852 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kjvjv\"" Jul 01 20:25:27.793689 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.793669 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7"] Jul 01 20:25:27.907769 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.907743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c5fc\" (UniqueName: \"kubernetes.io/projected/d1f94cd7-f221-422e-951c-12147d045995-kube-api-access-5c5fc\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:27.907900 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.907789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:27.907900 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:27.907844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:28.008945 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.008919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:28.009047 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.008951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:28.009047 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.008999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c5fc\" (UniqueName: \"kubernetes.io/projected/d1f94cd7-f221-422e-951c-12147d045995-kube-api-access-5c5fc\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:28.009301 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.009283 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:28.009335 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.009301 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:28.019106 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.019084 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c5fc\" (UniqueName: \"kubernetes.io/projected/d1f94cd7-f221-422e-951c-12147d045995-kube-api-access-5c5fc\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:28.094489 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.094466 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:28.235425 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.235400 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7"] Jul 01 20:25:28.236382 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:25:28.236358 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f94cd7_f221_422e_951c_12147d045995.slice/crio-55a379555dde65aaa5b96b591d5c1e1292a44763b004e561b35e63fbe62c8864 WatchSource:0}: Error finding container 55a379555dde65aaa5b96b591d5c1e1292a44763b004e561b35e63fbe62c8864: Status 404 returned error can't find the container with id 55a379555dde65aaa5b96b591d5c1e1292a44763b004e561b35e63fbe62c8864 Jul 01 20:25:28.780293 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.780257 2578 generic.go:356] "Generic (PLEG): container finished" podID="d1f94cd7-f221-422e-951c-12147d045995" containerID="3563af70236827a3541b336eefa0418e797dab58b73836121b729b47fdc4576f" exitCode=0 Jul 01 20:25:28.780470 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.780345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" event={"ID":"d1f94cd7-f221-422e-951c-12147d045995","Type":"ContainerDied","Data":"3563af70236827a3541b336eefa0418e797dab58b73836121b729b47fdc4576f"} Jul 01 20:25:28.780470 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:28.780402 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" event={"ID":"d1f94cd7-f221-422e-951c-12147d045995","Type":"ContainerStarted","Data":"55a379555dde65aaa5b96b591d5c1e1292a44763b004e561b35e63fbe62c8864"} Jul 01 20:25:29.787037 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:29.786944 2578 generic.go:356] "Generic (PLEG): container finished" podID="d1f94cd7-f221-422e-951c-12147d045995" containerID="77d5a2b3318bb2df9e3b353c990dfd8a79dc8fc8c843811bfdc096c99505c2bf" exitCode=0 Jul 01 20:25:29.787037 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:29.787000 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" event={"ID":"d1f94cd7-f221-422e-951c-12147d045995","Type":"ContainerDied","Data":"77d5a2b3318bb2df9e3b353c990dfd8a79dc8fc8c843811bfdc096c99505c2bf"} Jul 01 20:25:30.795313 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:30.795278 2578 generic.go:356] "Generic (PLEG): container finished" podID="d1f94cd7-f221-422e-951c-12147d045995" containerID="7ce4feeee755587445bbe0d13d3d5fa2ee806a602a7ce3ed1a1da95eccf647a2" exitCode=0 Jul 01 20:25:30.795691 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:30.795337 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" event={"ID":"d1f94cd7-f221-422e-951c-12147d045995","Type":"ContainerDied","Data":"7ce4feeee755587445bbe0d13d3d5fa2ee806a602a7ce3ed1a1da95eccf647a2"} Jul 01 20:25:31.929396 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:31.929374 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:32.043813 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.043777 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-bundle\") pod \"d1f94cd7-f221-422e-951c-12147d045995\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " Jul 01 20:25:32.043971 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.043846 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c5fc\" (UniqueName: \"kubernetes.io/projected/d1f94cd7-f221-422e-951c-12147d045995-kube-api-access-5c5fc\") pod \"d1f94cd7-f221-422e-951c-12147d045995\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " Jul 01 20:25:32.043971 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.043937 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-util\") pod \"d1f94cd7-f221-422e-951c-12147d045995\" (UID: \"d1f94cd7-f221-422e-951c-12147d045995\") " Jul 01 20:25:32.044315 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.044286 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-bundle" (OuterVolumeSpecName: "bundle") pod "d1f94cd7-f221-422e-951c-12147d045995" (UID: "d1f94cd7-f221-422e-951c-12147d045995"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:25:32.045845 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.045822 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1f94cd7-f221-422e-951c-12147d045995-kube-api-access-5c5fc" (OuterVolumeSpecName: "kube-api-access-5c5fc") pod "d1f94cd7-f221-422e-951c-12147d045995" (UID: "d1f94cd7-f221-422e-951c-12147d045995"). InnerVolumeSpecName "kube-api-access-5c5fc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:25:32.049760 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.049736 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-util" (OuterVolumeSpecName: "util") pod "d1f94cd7-f221-422e-951c-12147d045995" (UID: "d1f94cd7-f221-422e-951c-12147d045995"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:25:32.145227 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.145194 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-util\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:25:32.145227 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.145221 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1f94cd7-f221-422e-951c-12147d045995-bundle\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:25:32.145227 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.145230 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c5fc\" (UniqueName: \"kubernetes.io/projected/d1f94cd7-f221-422e-951c-12147d045995-kube-api-access-5c5fc\") on node \"ip-10-0-140-83.ec2.internal\" DevicePath \"\"" Jul 01 20:25:32.807371 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.807333 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" event={"ID":"d1f94cd7-f221-422e-951c-12147d045995","Type":"ContainerDied","Data":"55a379555dde65aaa5b96b591d5c1e1292a44763b004e561b35e63fbe62c8864"} Jul 01 20:25:32.807552 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.807384 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c8s2qp7" Jul 01 20:25:32.807552 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:32.807422 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55a379555dde65aaa5b96b591d5c1e1292a44763b004e561b35e63fbe62c8864" Jul 01 20:25:35.205123 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.205087 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj"] Jul 01 20:25:35.205512 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.205442 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f94cd7-f221-422e-951c-12147d045995" containerName="util" Jul 01 20:25:35.205512 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.205452 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f94cd7-f221-422e-951c-12147d045995" containerName="util" Jul 01 20:25:35.205512 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.205476 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f94cd7-f221-422e-951c-12147d045995" containerName="extract" Jul 01 20:25:35.205512 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.205482 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f94cd7-f221-422e-951c-12147d045995" containerName="extract" Jul 01 20:25:35.205512 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.205491 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f94cd7-f221-422e-951c-12147d045995" containerName="pull" Jul 01 20:25:35.205512 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.205496 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f94cd7-f221-422e-951c-12147d045995" containerName="pull" Jul 01 20:25:35.205731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.205550 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1f94cd7-f221-422e-951c-12147d045995" containerName="extract" Jul 01 20:25:35.210552 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.210535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj" Jul 01 20:25:35.214111 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.214011 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 20:25:35.214268 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.214074 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 20:25:35.215255 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.215236 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-qzlx5\"" Jul 01 20:25:35.219290 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.219271 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj"] Jul 01 20:25:35.278492 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.278470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thckp\" (UniqueName: \"kubernetes.io/projected/7d17812f-ea20-42b6-bcae-c701fc9b685c-kube-api-access-thckp\") pod \"keycloak-operator-d8b9d7b4d-gq6gj\" (UID: \"7d17812f-ea20-42b6-bcae-c701fc9b685c\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj" Jul 01 20:25:35.379861 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.379831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thckp\" (UniqueName: \"kubernetes.io/projected/7d17812f-ea20-42b6-bcae-c701fc9b685c-kube-api-access-thckp\") pod \"keycloak-operator-d8b9d7b4d-gq6gj\" (UID: \"7d17812f-ea20-42b6-bcae-c701fc9b685c\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj" Jul 01 20:25:35.388319 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.388294 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thckp\" (UniqueName: \"kubernetes.io/projected/7d17812f-ea20-42b6-bcae-c701fc9b685c-kube-api-access-thckp\") pod \"keycloak-operator-d8b9d7b4d-gq6gj\" (UID: \"7d17812f-ea20-42b6-bcae-c701fc9b685c\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj" Jul 01 20:25:35.522404 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.522330 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj" Jul 01 20:25:35.653536 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.653510 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj"] Jul 01 20:25:35.654616 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:25:35.654585 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d17812f_ea20_42b6_bcae_c701fc9b685c.slice/crio-1cf6d6e689f361974306df2bc2eceef49b1e76a451146847345b0ad2196fa674 WatchSource:0}: Error finding container 1cf6d6e689f361974306df2bc2eceef49b1e76a451146847345b0ad2196fa674: Status 404 returned error can't find the container with id 1cf6d6e689f361974306df2bc2eceef49b1e76a451146847345b0ad2196fa674 Jul 01 20:25:35.825026 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:35.824991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj" event={"ID":"7d17812f-ea20-42b6-bcae-c701fc9b685c","Type":"ContainerStarted","Data":"1cf6d6e689f361974306df2bc2eceef49b1e76a451146847345b0ad2196fa674"} Jul 01 20:25:42.867360 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:42.867319 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj" event={"ID":"7d17812f-ea20-42b6-bcae-c701fc9b685c","Type":"ContainerStarted","Data":"b75ba6ae37f7e1d8e75c4fa95d4281355b0bc8ff71a98e6785cdf33aaf4b94c2"} Jul 01 20:25:42.888304 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:25:42.888255 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-gq6gj" podStartSLOduration=1.6727349839999999 podStartE2EDuration="7.888240545s" totalImagesPullingTime="6.215505561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:25:42.885573481 +0000 UTC m=+509.093882723" watchObservedRunningTime="2026-07-01 20:25:42.888240545 +0000 UTC m=+509.096549788" Jul 01 20:27:14.230500 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:14.230469 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-acl-logging/0.log" Jul 01 20:27:14.231510 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:14.231481 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-acl-logging/0.log" Jul 01 20:27:15.356225 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:15.356193 2578 generic.go:356] "Generic (PLEG): container finished" podID="18c25c3b-a9d7-4c04-99c2-e79f8ac23265" containerID="86f0e193335aaff260ffd06c4b2a73335cc905f9d1ce666041205744537a0bad" exitCode=0 Jul 01 20:27:15.356660 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:15.356237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" event={"ID":"18c25c3b-a9d7-4c04-99c2-e79f8ac23265","Type":"ContainerDied","Data":"86f0e193335aaff260ffd06c4b2a73335cc905f9d1ce666041205744537a0bad"} Jul 01 20:27:15.356660 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:15.356549 2578 scope.go:117] "RemoveContainer" containerID="86f0e193335aaff260ffd06c4b2a73335cc905f9d1ce666041205744537a0bad" Jul 01 20:27:15.357458 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:15.357430 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 20:27:15.357513 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:15.357494 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 20:27:15.357549 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:15.357526 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 20:27:16.363587 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:16.363549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" event={"ID":"18c25c3b-a9d7-4c04-99c2-e79f8ac23265","Type":"ContainerStarted","Data":"bdbe37f98b9425e1a1afc2b2478d4910ce4d4c6ca6d62e53ec7072d826ff303d"} Jul 01 20:27:16.542898 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:16.542809 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:27:16.601326 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:16.601291 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:27:16.602522 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:16.602498 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tcqqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 01 20:27:16.602631 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:16.602560 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" podUID="18c25c3b-a9d7-4c04-99c2-e79f8ac23265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 01 20:27:17.601627 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:17.601595 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tcqqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 01 20:27:17.602009 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:17.601662 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" podUID="18c25c3b-a9d7-4c04-99c2-e79f8ac23265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 01 20:27:18.602021 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:18.601985 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tcqqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 01 20:27:18.602714 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:18.602038 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" podUID="18c25c3b-a9d7-4c04-99c2-e79f8ac23265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 01 20:27:19.601410 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:19.601375 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-tcqqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 01 20:27:19.601608 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:19.601430 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" podUID="18c25c3b-a9d7-4c04-99c2-e79f8ac23265" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 01 20:27:20.605168 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:20.605140 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:27:20.606032 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:27:20.606013 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-tcqqw" Jul 01 20:28:11.972071 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:11.972029 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw"] Jul 01 20:28:11.975543 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:11.975527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:11.978395 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:11.978375 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 20:28:11.979664 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:11.979647 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 20:28:11.979664 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:11.979659 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 01 20:28:11.979879 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:11.979652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s2778\"" Jul 01 20:28:11.987023 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:11.987000 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw"] Jul 01 20:28:12.107959 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.107932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6bnd\" (UniqueName: \"kubernetes.io/projected/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-kube-api-access-x6bnd\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.108096 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.107970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.108096 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.108041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.108176 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.108120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.108216 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.108184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.208927 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.208891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6bnd\" (UniqueName: \"kubernetes.io/projected/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-kube-api-access-x6bnd\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.209111 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.208935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.209111 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.208983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.209111 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.209029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.209111 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.209088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.209490 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.209453 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.209490 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.209478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.211184 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.211163 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.211557 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.211536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.217839 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.217817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6bnd\" (UniqueName: \"kubernetes.io/projected/f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef-kube-api-access-x6bnd\") pod \"e2e-distinct-simulated-kserve-ff95456df-pnfdw\" (UID: \"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.287107 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.287012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:12.416907 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.416881 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw"] Jul 01 20:28:12.417604 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:28:12.417575 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a22e3a_ea9e_49a4_99c9_9b76a513c7ef.slice/crio-e69b6ce34befc4c29ff3fc6a0293a7c59f62b1cd58385d140258c0c2bc337c7e WatchSource:0}: Error finding container e69b6ce34befc4c29ff3fc6a0293a7c59f62b1cd58385d140258c0c2bc337c7e: Status 404 returned error can't find the container with id e69b6ce34befc4c29ff3fc6a0293a7c59f62b1cd58385d140258c0c2bc337c7e Jul 01 20:28:12.418882 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.418864 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:28:12.675195 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:12.675153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" event={"ID":"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef","Type":"ContainerStarted","Data":"e69b6ce34befc4c29ff3fc6a0293a7c59f62b1cd58385d140258c0c2bc337c7e"} Jul 01 20:28:13.682664 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:13.682562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" event={"ID":"f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef","Type":"ContainerStarted","Data":"3e551475b8568a2bfc829130d82e69f22caf1b5c17e438c534e5883d5da1e7df"} Jul 01 20:28:13.710802 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:13.710749 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" podStartSLOduration=1.70292453 podStartE2EDuration="2.710733528s" totalImagesPullingTime="1.007808998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:28:13.710119978 +0000 UTC m=+659.918429214" watchObservedRunningTime="2026-07-01 20:28:13.710733528 +0000 UTC m=+659.919042772" Jul 01 20:28:22.287602 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:22.287568 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:22.288080 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:22.287624 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:22.300415 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:22.300395 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:28:22.744030 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:28:22.743999 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-pnfdw" Jul 01 20:29:00.782084 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:00.782035 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb"] Jul 01 20:29:00.788154 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:00.788134 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:00.790924 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:00.790898 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 01 20:29:00.792710 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:00.792683 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb"] Jul 01 20:29:00.920406 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:00.920375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd400217-df70-4532-b34d-1287fce510d0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:00.920525 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:00.920409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd400217-df70-4532-b34d-1287fce510d0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:00.920525 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:00.920438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7wcj\" (UniqueName: \"kubernetes.io/projected/cd400217-df70-4532-b34d-1287fce510d0-kube-api-access-j7wcj\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:00.920525 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:00.920497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd400217-df70-4532-b34d-1287fce510d0-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:00.920661 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:00.920564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd400217-df70-4532-b34d-1287fce510d0-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.021382 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.021349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd400217-df70-4532-b34d-1287fce510d0-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.021549 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.021410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd400217-df70-4532-b34d-1287fce510d0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.021549 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.021429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd400217-df70-4532-b34d-1287fce510d0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.021549 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.021460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7wcj\" (UniqueName: \"kubernetes.io/projected/cd400217-df70-4532-b34d-1287fce510d0-kube-api-access-j7wcj\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.021549 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.021492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd400217-df70-4532-b34d-1287fce510d0-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.021884 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.021858 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd400217-df70-4532-b34d-1287fce510d0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.021949 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.021867 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd400217-df70-4532-b34d-1287fce510d0-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.023767 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.023746 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd400217-df70-4532-b34d-1287fce510d0-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.023915 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.023898 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd400217-df70-4532-b34d-1287fce510d0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.029748 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.029725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7wcj\" (UniqueName: \"kubernetes.io/projected/cd400217-df70-4532-b34d-1287fce510d0-kube-api-access-j7wcj\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb\" (UID: \"cd400217-df70-4532-b34d-1287fce510d0\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.099588 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.099566 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:01.231772 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.231745 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb"] Jul 01 20:29:01.233007 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:29:01.232983 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd400217_df70_4532_b34d_1287fce510d0.slice/crio-c457851eba4a1c52dfb0baffc1ecaf2e8a785f403b27fc5a23d815444e1aba0d WatchSource:0}: Error finding container c457851eba4a1c52dfb0baffc1ecaf2e8a785f403b27fc5a23d815444e1aba0d: Status 404 returned error can't find the container with id c457851eba4a1c52dfb0baffc1ecaf2e8a785f403b27fc5a23d815444e1aba0d Jul 01 20:29:01.941742 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.941708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" event={"ID":"cd400217-df70-4532-b34d-1287fce510d0","Type":"ContainerStarted","Data":"e1adba4f47217c9a71316aac2e1970fda20c20d3f5fd8ffd996f9a3cd1b49475"} Jul 01 20:29:01.942125 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.941771 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" event={"ID":"cd400217-df70-4532-b34d-1287fce510d0","Type":"ContainerStarted","Data":"c457851eba4a1c52dfb0baffc1ecaf2e8a785f403b27fc5a23d815444e1aba0d"} Jul 01 20:29:01.965731 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:01.965684 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" podStartSLOduration=1.779322283 podStartE2EDuration="1.965671163s" totalImagesPullingTime="186.34888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:29:01.962269209 +0000 UTC m=+708.170578452" watchObservedRunningTime="2026-07-01 20:29:01.965671163 +0000 UTC m=+708.173980405" Jul 01 20:29:11.100474 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:11.100393 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:11.100894 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:11.100481 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:11.112858 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:11.112836 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:12.009467 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.009438 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb" Jul 01 20:29:12.172869 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.172836 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh"] Jul 01 20:29:12.176178 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.176159 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.179643 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.179612 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 01 20:29:12.185561 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.185537 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh"] Jul 01 20:29:12.315859 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.315828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0983e57-c012-4cd6-b201-67eea5742ccf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.316001 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.315868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0983e57-c012-4cd6-b201-67eea5742ccf-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.316001 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.315891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt6ng\" (UniqueName: \"kubernetes.io/projected/b0983e57-c012-4cd6-b201-67eea5742ccf-kube-api-access-xt6ng\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.316001 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.315986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0983e57-c012-4cd6-b201-67eea5742ccf-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.316156 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.316087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0983e57-c012-4cd6-b201-67eea5742ccf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.416825 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.416793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0983e57-c012-4cd6-b201-67eea5742ccf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.416825 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.416827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0983e57-c012-4cd6-b201-67eea5742ccf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.417035 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.416858 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0983e57-c012-4cd6-b201-67eea5742ccf-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.417035 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.416897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt6ng\" (UniqueName: \"kubernetes.io/projected/b0983e57-c012-4cd6-b201-67eea5742ccf-kube-api-access-xt6ng\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.417168 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.417080 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0983e57-c012-4cd6-b201-67eea5742ccf-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.417292 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.417273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0983e57-c012-4cd6-b201-67eea5742ccf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.417292 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.417284 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0983e57-c012-4cd6-b201-67eea5742ccf-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.419129 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.419108 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0983e57-c012-4cd6-b201-67eea5742ccf-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.419395 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.419375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0983e57-c012-4cd6-b201-67eea5742ccf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.425041 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.425017 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt6ng\" (UniqueName: \"kubernetes.io/projected/b0983e57-c012-4cd6-b201-67eea5742ccf-kube-api-access-xt6ng\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh\" (UID: \"b0983e57-c012-4cd6-b201-67eea5742ccf\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.487743 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.487723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:12.622446 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:12.622415 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh"] Jul 01 20:29:12.623318 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:29:12.623287 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0983e57_c012_4cd6_b201_67eea5742ccf.slice/crio-588619a9f1c161b00fc13e758eb0dd1fd768f0e5f95064a8c3513173293702fb WatchSource:0}: Error finding container 588619a9f1c161b00fc13e758eb0dd1fd768f0e5f95064a8c3513173293702fb: Status 404 returned error can't find the container with id 588619a9f1c161b00fc13e758eb0dd1fd768f0e5f95064a8c3513173293702fb Jul 01 20:29:13.004945 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:13.004904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" event={"ID":"b0983e57-c012-4cd6-b201-67eea5742ccf","Type":"ContainerStarted","Data":"d919f749a30144a7aa8836ceee710bab4587a4b66aca48291b8ff5b8226002e0"} Jul 01 20:29:13.004945 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:13.004948 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" event={"ID":"b0983e57-c012-4cd6-b201-67eea5742ccf","Type":"ContainerStarted","Data":"588619a9f1c161b00fc13e758eb0dd1fd768f0e5f95064a8c3513173293702fb"} Jul 01 20:29:13.023663 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:13.023620 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" podStartSLOduration=0.863305618 podStartE2EDuration="1.023607178s" totalImagesPullingTime="160.30156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:29:13.023187722 +0000 UTC m=+719.231496965" watchObservedRunningTime="2026-07-01 20:29:13.023607178 +0000 UTC m=+719.231916455" Jul 01 20:29:22.488175 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:22.488141 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:22.488557 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:22.488189 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:22.500689 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:22.500663 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:29:23.071632 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:29:23.071603 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh" Jul 01 20:30:39.676861 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:39.676792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-74c9cf85ff-8cm5q_ccd42da2-cb9e-47b4-8a48-94945c1ca2ce/nginx/0.log" Jul 01 20:30:40.446257 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:40.446228 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-mlv8k_b9303a6b-b827-4e42-bcd5-9503167eba4a/server/0.log" Jul 01 20:30:40.564833 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:40.564803 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9vn79_81d8abfa-1dc3-4a83-8b96-dbffdc9df80d/manager/0.log" Jul 01 20:30:40.687266 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:40.687237 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-5v6hz_3ae6a625-d233-4c4e-b838-b5b542174deb/manager/0.log" Jul 01 20:30:40.694517 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:40.694499 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-5v6hz_3ae6a625-d233-4c4e-b838-b5b542174deb/copy-manifests/0.log" Jul 01 20:30:41.759561 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:41.759534 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp_982c822b-71ac-4704-a4ef-6f45d901c2a0/util/0.log" Jul 01 20:30:41.767289 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:41.767262 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp_982c822b-71ac-4704-a4ef-6f45d901c2a0/pull/0.log" Jul 01 20:30:41.775223 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:41.775199 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp_982c822b-71ac-4704-a4ef-6f45d901c2a0/extract/0.log" Jul 01 20:30:41.881356 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:41.881334 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm_b0ee6842-4453-40cd-a536-96e340dd1c54/util/0.log" Jul 01 20:30:41.889533 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:41.889514 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm_b0ee6842-4453-40cd-a536-96e340dd1c54/pull/0.log" Jul 01 20:30:41.896764 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:41.896745 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm_b0ee6842-4453-40cd-a536-96e340dd1c54/extract/0.log" Jul 01 20:30:42.001011 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:42.000986 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq_d2c0b1fa-9412-46f9-90a7-61ba0656f022/util/0.log" Jul 01 20:30:42.007921 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:42.007902 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq_d2c0b1fa-9412-46f9-90a7-61ba0656f022/pull/0.log" Jul 01 20:30:42.015358 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:42.015300 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq_d2c0b1fa-9412-46f9-90a7-61ba0656f022/extract/0.log" Jul 01 20:30:42.116785 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:42.116764 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp_a256b11f-e397-4876-899a-9103b48e5739/util/0.log" Jul 01 20:30:42.123480 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:42.123461 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp_a256b11f-e397-4876-899a-9103b48e5739/pull/0.log" Jul 01 20:30:42.130149 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:42.130117 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp_a256b11f-e397-4876-899a-9103b48e5739/extract/0.log" Jul 01 20:30:42.366009 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:42.365963 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bm6p2_aa2c21e3-f4a9-48c8-b801-3dc05b6920f7/manager/0.log" Jul 01 20:30:42.579440 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:42.579415 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-p6pz9_b6c612ee-9511-49e1-8d09-b14d46b3b8b9/kuadrant-console-plugin/0.log" Jul 01 20:30:42.699140 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:42.699043 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ngljr_6dca9971-fed0-4a92-9b6e-7db7809b1387/registry-server/0.log" Jul 01 20:30:43.401531 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:43.401497 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cvc9p_7dd78dde-5dbb-4ba0-95a3-47603a4f9d10/istio-proxy/0.log" Jul 01 20:30:44.174149 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:44.174112 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tcqqw_18c25c3b-a9d7-4c04-99c2-e79f8ac23265/istio-proxy/1.log" Jul 01 20:30:45.221453 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:45.221424 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-ff95456df-pnfdw_f2a22e3a-ea9e-49a4-99c9-9b76a513c7ef/main/0.log" Jul 01 20:30:45.535733 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:45.535664 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-99c7dfb5c-xsfbb_cd400217-df70-4532-b34d-1287fce510d0/main/0.log" Jul 01 20:30:45.645279 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:45.645255 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6cfb9f9b9c-8p7dh_b0983e57-c012-4cd6-b201-67eea5742ccf/main/0.log" Jul 01 20:30:49.264130 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.264095 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zq556/must-gather-xrtkn"] Jul 01 20:30:49.268261 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.268239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq556/must-gather-xrtkn" Jul 01 20:30:49.271052 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.271031 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zq556\"/\"kube-root-ca.crt\"" Jul 01 20:30:49.272147 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.272124 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zq556\"/\"openshift-service-ca.crt\"" Jul 01 20:30:49.272237 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.272172 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zq556\"/\"default-dockercfg-sn5vm\"" Jul 01 20:30:49.275992 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.275973 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq556/must-gather-xrtkn"] Jul 01 20:30:49.305935 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.305912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/15b1639e-4950-4225-a6c2-825b4679bc86-must-gather-output\") pod \"must-gather-xrtkn\" (UID: \"15b1639e-4950-4225-a6c2-825b4679bc86\") " pod="openshift-must-gather-zq556/must-gather-xrtkn" Jul 01 20:30:49.306025 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.305990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98k8k\" (UniqueName: \"kubernetes.io/projected/15b1639e-4950-4225-a6c2-825b4679bc86-kube-api-access-98k8k\") pod \"must-gather-xrtkn\" (UID: \"15b1639e-4950-4225-a6c2-825b4679bc86\") " pod="openshift-must-gather-zq556/must-gather-xrtkn" Jul 01 20:30:49.406868 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.406846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98k8k\" (UniqueName: \"kubernetes.io/projected/15b1639e-4950-4225-a6c2-825b4679bc86-kube-api-access-98k8k\") pod \"must-gather-xrtkn\" (UID: \"15b1639e-4950-4225-a6c2-825b4679bc86\") " pod="openshift-must-gather-zq556/must-gather-xrtkn" Jul 01 20:30:49.406958 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.406893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/15b1639e-4950-4225-a6c2-825b4679bc86-must-gather-output\") pod \"must-gather-xrtkn\" (UID: \"15b1639e-4950-4225-a6c2-825b4679bc86\") " pod="openshift-must-gather-zq556/must-gather-xrtkn" Jul 01 20:30:49.407216 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.407198 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/15b1639e-4950-4225-a6c2-825b4679bc86-must-gather-output\") pod \"must-gather-xrtkn\" (UID: \"15b1639e-4950-4225-a6c2-825b4679bc86\") " pod="openshift-must-gather-zq556/must-gather-xrtkn" Jul 01 20:30:49.419987 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.419958 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98k8k\" (UniqueName: \"kubernetes.io/projected/15b1639e-4950-4225-a6c2-825b4679bc86-kube-api-access-98k8k\") pod \"must-gather-xrtkn\" (UID: \"15b1639e-4950-4225-a6c2-825b4679bc86\") " pod="openshift-must-gather-zq556/must-gather-xrtkn" Jul 01 20:30:49.577983 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.577960 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq556/must-gather-xrtkn" Jul 01 20:30:49.711328 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:49.711302 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq556/must-gather-xrtkn"] Jul 01 20:30:49.712846 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:30:49.712820 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15b1639e_4950_4225_a6c2_825b4679bc86.slice/crio-4f73966f358728a17c86ae78c2a0978dc485242d319186c3aaaf83a95a855545 WatchSource:0}: Error finding container 4f73966f358728a17c86ae78c2a0978dc485242d319186c3aaaf83a95a855545: Status 404 returned error can't find the container with id 4f73966f358728a17c86ae78c2a0978dc485242d319186c3aaaf83a95a855545 Jul 01 20:30:50.533810 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:50.533775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq556/must-gather-xrtkn" event={"ID":"15b1639e-4950-4225-a6c2-825b4679bc86","Type":"ContainerStarted","Data":"4f73966f358728a17c86ae78c2a0978dc485242d319186c3aaaf83a95a855545"} Jul 01 20:30:51.549591 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:51.547956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq556/must-gather-xrtkn" event={"ID":"15b1639e-4950-4225-a6c2-825b4679bc86","Type":"ContainerStarted","Data":"c234fd86679d5a63c72080140f8b4e133b31552bc6a01f9e36bf6a577db4bce0"} Jul 01 20:30:51.549591 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:51.548012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq556/must-gather-xrtkn" event={"ID":"15b1639e-4950-4225-a6c2-825b4679bc86","Type":"ContainerStarted","Data":"08c980bdca6b0f05f09c73e597b1d1ce635ee04af127e996a10c5f446a6fcc0e"} Jul 01 20:30:51.567844 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:51.567790 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zq556/must-gather-xrtkn" podStartSLOduration=1.5947588769999999 podStartE2EDuration="2.567770066s" totalImagesPullingTime="973.011189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:30:51.564326751 +0000 UTC m=+817.772635997" watchObservedRunningTime="2026-07-01 20:30:51.567770066 +0000 UTC m=+817.776079310" Jul 01 20:30:52.209321 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:52.209294 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bcwn6_95b6f23d-fd06-4986-b91b-45e323a8ba3f/global-pull-secret-syncer/0.log" Jul 01 20:30:52.393665 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:52.393638 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xnxmc_f2f84134-907d-4db8-8791-0c83da22f474/konnectivity-agent/0.log" Jul 01 20:30:52.432461 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:52.432408 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-83.ec2.internal_b8636df1471c502dd21f18b789ab0075/haproxy/0.log" Jul 01 20:30:56.314197 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.314163 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp_982c822b-71ac-4704-a4ef-6f45d901c2a0/extract/0.log" Jul 01 20:30:56.343426 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.343334 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp_982c822b-71ac-4704-a4ef-6f45d901c2a0/util/0.log" Jul 01 20:30:56.396663 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.396628 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75925lgp_982c822b-71ac-4704-a4ef-6f45d901c2a0/pull/0.log" Jul 01 20:30:56.427349 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.427267 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm_b0ee6842-4453-40cd-a536-96e340dd1c54/extract/0.log" Jul 01 20:30:56.449961 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.449933 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm_b0ee6842-4453-40cd-a536-96e340dd1c54/util/0.log" Jul 01 20:30:56.474469 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.474442 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0477wm_b0ee6842-4453-40cd-a536-96e340dd1c54/pull/0.log" Jul 01 20:30:56.501348 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.501317 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq_d2c0b1fa-9412-46f9-90a7-61ba0656f022/extract/0.log" Jul 01 20:30:56.521190 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.521157 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq_d2c0b1fa-9412-46f9-90a7-61ba0656f022/util/0.log" Jul 01 20:30:56.544157 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.544107 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qtdq_d2c0b1fa-9412-46f9-90a7-61ba0656f022/pull/0.log" Jul 01 20:30:56.576377 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.576301 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp_a256b11f-e397-4876-899a-9103b48e5739/extract/0.log" Jul 01 20:30:56.605158 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.605132 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp_a256b11f-e397-4876-899a-9103b48e5739/util/0.log" Jul 01 20:30:56.632156 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.632016 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmxsp_a256b11f-e397-4876-899a-9103b48e5739/pull/0.log" Jul 01 20:30:56.720125 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.720098 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bm6p2_aa2c21e3-f4a9-48c8-b801-3dc05b6920f7/manager/0.log" Jul 01 20:30:56.771015 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.770990 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-p6pz9_b6c612ee-9511-49e1-8d09-b14d46b3b8b9/kuadrant-console-plugin/0.log" Jul 01 20:30:56.835150 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:56.835073 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ngljr_6dca9971-fed0-4a92-9b6e-7db7809b1387/registry-server/0.log" Jul 01 20:30:58.730697 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:58.730662 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7665232-5799-4f6e-a049-727c48fe7d78/alertmanager/0.log" Jul 01 20:30:58.752802 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:58.752764 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7665232-5799-4f6e-a049-727c48fe7d78/config-reloader/0.log" Jul 01 20:30:58.773363 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:58.773319 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7665232-5799-4f6e-a049-727c48fe7d78/kube-rbac-proxy-web/0.log" Jul 01 20:30:58.799003 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:58.798974 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7665232-5799-4f6e-a049-727c48fe7d78/kube-rbac-proxy/0.log" Jul 01 20:30:58.828531 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:58.828262 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7665232-5799-4f6e-a049-727c48fe7d78/kube-rbac-proxy-metric/0.log" Jul 01 20:30:58.860786 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:58.860763 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7665232-5799-4f6e-a049-727c48fe7d78/prom-label-proxy/0.log" Jul 01 20:30:58.904750 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:58.904701 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e7665232-5799-4f6e-a049-727c48fe7d78/init-config-reloader/0.log" Jul 01 20:30:59.035401 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.035324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5c97bdddb5-m65vq_f1a98db9-b63a-4156-a767-424c03e412ad/metrics-server/0.log" Jul 01 20:30:59.070363 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.070335 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-krbkf_0ced35dd-1b4b-4193-8f27-56aa9ea6ffbc/monitoring-plugin/0.log" Jul 01 20:30:59.174343 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.174310 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6lmc_879292c5-a443-4890-949d-5e650decee29/node-exporter/0.log" Jul 01 20:30:59.197745 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.197713 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6lmc_879292c5-a443-4890-949d-5e650decee29/kube-rbac-proxy/0.log" Jul 01 20:30:59.218009 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.217976 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l6lmc_879292c5-a443-4890-949d-5e650decee29/init-textfile/0.log" Jul 01 20:30:59.714523 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.714498 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-rjkr5_3a92cb29-d9df-4e33-a598-2e9f7fd37f6d/prometheus-operator-admission-webhook/0.log" Jul 01 20:30:59.758447 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.758419 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b77f56865-vc8zt_7046366b-bb41-44b8-9239-a4c7d8d97f20/telemeter-client/0.log" Jul 01 20:30:59.799455 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.799425 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b77f56865-vc8zt_7046366b-bb41-44b8-9239-a4c7d8d97f20/reload/0.log" Jul 01 20:30:59.827836 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.827806 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b77f56865-vc8zt_7046366b-bb41-44b8-9239-a4c7d8d97f20/kube-rbac-proxy/0.log" Jul 01 20:30:59.873954 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.873921 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dfd8bf9dc-rnlp5_b223771d-b6a3-40fa-9d91-b753b8af4c58/thanos-query/0.log" Jul 01 20:30:59.903414 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.903382 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dfd8bf9dc-rnlp5_b223771d-b6a3-40fa-9d91-b753b8af4c58/kube-rbac-proxy-web/0.log" Jul 01 20:30:59.927765 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.927664 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dfd8bf9dc-rnlp5_b223771d-b6a3-40fa-9d91-b753b8af4c58/kube-rbac-proxy/0.log" Jul 01 20:30:59.952724 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.952693 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dfd8bf9dc-rnlp5_b223771d-b6a3-40fa-9d91-b753b8af4c58/prom-label-proxy/0.log" Jul 01 20:30:59.991614 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:30:59.991584 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dfd8bf9dc-rnlp5_b223771d-b6a3-40fa-9d91-b753b8af4c58/kube-rbac-proxy-rules/0.log" Jul 01 20:31:00.046292 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:00.044663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dfd8bf9dc-rnlp5_b223771d-b6a3-40fa-9d91-b753b8af4c58/kube-rbac-proxy-metrics/0.log" Jul 01 20:31:02.583209 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.583177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f74666dcf-nxxng_d1f847e9-eb78-48f8-8943-59cc57ab0e3e/console/0.log" Jul 01 20:31:02.584754 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.584725 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc"] Jul 01 20:31:02.593099 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.593076 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.594150 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.594128 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc"] Jul 01 20:31:02.772903 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.772860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-proc\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.773107 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.772933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-podres\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.773107 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.773084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-lib-modules\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.773250 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.773117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tldwl\" (UniqueName: \"kubernetes.io/projected/37e2f61e-de25-45e6-8e24-97da713fd546-kube-api-access-tldwl\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.773250 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.773147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-sys\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.874534 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.874439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-lib-modules\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.874534 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.874482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tldwl\" (UniqueName: \"kubernetes.io/projected/37e2f61e-de25-45e6-8e24-97da713fd546-kube-api-access-tldwl\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.874778 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.874576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-sys\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.874778 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.874645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-lib-modules\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.874778 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.874660 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-sys\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.874778 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.874757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-proc\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.874988 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.874796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-podres\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.874988 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.874836 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-proc\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.874988 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.874975 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37e2f61e-de25-45e6-8e24-97da713fd546-podres\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.883546 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.883519 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tldwl\" (UniqueName: \"kubernetes.io/projected/37e2f61e-de25-45e6-8e24-97da713fd546-kube-api-access-tldwl\") pod \"perf-node-gather-daemonset-sjhrc\" (UID: \"37e2f61e-de25-45e6-8e24-97da713fd546\") " pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:02.908402 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:02.908370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:03.082907 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:03.082873 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc"] Jul 01 20:31:03.083193 ip-10-0-140-83 kubenswrapper[2578]: W0701 20:31:03.083170 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod37e2f61e_de25_45e6_8e24_97da713fd546.slice/crio-0a9ef4231c0c8fa85fdf5c8dcf00730cfd6e220fad29173a85f54fca00f8869c WatchSource:0}: Error finding container 0a9ef4231c0c8fa85fdf5c8dcf00730cfd6e220fad29173a85f54fca00f8869c: Status 404 returned error can't find the container with id 0a9ef4231c0c8fa85fdf5c8dcf00730cfd6e220fad29173a85f54fca00f8869c Jul 01 20:31:03.653892 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:03.653854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" event={"ID":"37e2f61e-de25-45e6-8e24-97da713fd546","Type":"ContainerStarted","Data":"4a94d28e7494a0b36548c9a2ae9556c741ee4abf4381b2b45f1a6d0a3e21c3a4"} Jul 01 20:31:03.654452 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:03.654436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" event={"ID":"37e2f61e-de25-45e6-8e24-97da713fd546","Type":"ContainerStarted","Data":"0a9ef4231c0c8fa85fdf5c8dcf00730cfd6e220fad29173a85f54fca00f8869c"} Jul 01 20:31:03.654529 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:03.654492 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:03.672543 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:03.672484 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" podStartSLOduration=1.6724657490000001 podStartE2EDuration="1.672465749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:31:03.669959555 +0000 UTC m=+829.878268809" watchObservedRunningTime="2026-07-01 20:31:03.672465749 +0000 UTC m=+829.880774987" Jul 01 20:31:04.333578 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:04.333545 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fh72z_c70c9714-0f1f-406a-a810-bb4328cdeacc/dns/0.log" Jul 01 20:31:04.352745 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:04.352718 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fh72z_c70c9714-0f1f-406a-a810-bb4328cdeacc/kube-rbac-proxy/0.log" Jul 01 20:31:04.374440 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:04.374416 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cs9mh_60903657-c82f-4222-911c-121e9ffcf6a5/dns-node-resolver/0.log" Jul 01 20:31:04.913923 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:04.913892 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54fccf8966-l7vfq_1aba7b0c-8d52-4ee7-bdab-8a4d7eb05ea5/registry/0.log" Jul 01 20:31:04.975046 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:04.975013 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qfzbq_64be0627-f73b-455b-b7dd-6bbcbb7a54f7/node-ca/0.log" Jul 01 20:31:05.875189 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:05.875150 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cvc9p_7dd78dde-5dbb-4ba0-95a3-47603a4f9d10/istio-proxy/0.log" Jul 01 20:31:06.007830 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:06.007793 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tcqqw_18c25c3b-a9d7-4c04-99c2-e79f8ac23265/istio-proxy/1.log" Jul 01 20:31:06.008705 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:06.008664 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tcqqw_18c25c3b-a9d7-4c04-99c2-e79f8ac23265/istio-proxy/0.log" Jul 01 20:31:06.652271 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:06.652239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5bn7l_67cccb88-4445-405a-a931-b0f6d16b532a/serve-healthcheck-canary/0.log" Jul 01 20:31:07.210498 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:07.210466 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxmhp_e4e810c5-6e22-4618-88d8-dd8c006bd13f/kube-rbac-proxy/0.log" Jul 01 20:31:07.231586 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:07.231547 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxmhp_e4e810c5-6e22-4618-88d8-dd8c006bd13f/exporter/0.log" Jul 01 20:31:07.251015 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:07.250982 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxmhp_e4e810c5-6e22-4618-88d8-dd8c006bd13f/extractor/0.log" Jul 01 20:31:09.513433 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:09.513400 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-74c9cf85ff-8cm5q_ccd42da2-cb9e-47b4-8a48-94945c1ca2ce/nginx/0.log" Jul 01 20:31:09.672089 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:09.672047 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zq556/perf-node-gather-daemonset-sjhrc" Jul 01 20:31:09.721581 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:09.721556 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-mlv8k_b9303a6b-b827-4e42-bcd5-9503167eba4a/server/0.log" Jul 01 20:31:09.798444 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:09.798356 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9vn79_81d8abfa-1dc3-4a83-8b96-dbffdc9df80d/manager/0.log" Jul 01 20:31:09.875685 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:09.875651 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-5v6hz_3ae6a625-d233-4c4e-b838-b5b542174deb/manager/0.log" Jul 01 20:31:09.906739 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:09.906711 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bb96b6fd-5v6hz_3ae6a625-d233-4c4e-b838-b5b542174deb/copy-manifests/0.log" Jul 01 20:31:11.537952 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:11.537922 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7565f6b689-s45gv_e629ebe2-405b-4879-a497-408ad778671d/manager/0.log" Jul 01 20:31:11.581595 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:11.581541 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-nhdnw_abcb268b-5527-4be5-9385-4435a8d03563/openshift-lws-operator/0.log" Jul 01 20:31:12.464867 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:12.464831 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cvc9p_7dd78dde-5dbb-4ba0-95a3-47603a4f9d10/istio-proxy/0.log" Jul 01 20:31:12.587111 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:12.587080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tcqqw_18c25c3b-a9d7-4c04-99c2-e79f8ac23265/istio-proxy/1.log" Jul 01 20:31:12.587584 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:12.587396 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tcqqw_18c25c3b-a9d7-4c04-99c2-e79f8ac23265/istio-proxy/0.log" Jul 01 20:31:13.643782 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:13.643751 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cvc9p_7dd78dde-5dbb-4ba0-95a3-47603a4f9d10/istio-proxy/0.log" Jul 01 20:31:13.748458 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:13.748427 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tcqqw_18c25c3b-a9d7-4c04-99c2-e79f8ac23265/istio-proxy/1.log" Jul 01 20:31:13.749027 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:13.749001 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-tcqqw_18c25c3b-a9d7-4c04-99c2-e79f8ac23265/istio-proxy/0.log" Jul 01 20:31:18.007782 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:18.007755 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mpdp_d6e3305b-c2fe-4eb3-9e4e-858041f6e262/kube-multus-additional-cni-plugins/0.log" Jul 01 20:31:18.025899 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:18.025873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mpdp_d6e3305b-c2fe-4eb3-9e4e-858041f6e262/egress-router-binary-copy/0.log" Jul 01 20:31:18.045671 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:18.045652 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mpdp_d6e3305b-c2fe-4eb3-9e4e-858041f6e262/cni-plugins/0.log" Jul 01 20:31:18.065416 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:18.065394 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mpdp_d6e3305b-c2fe-4eb3-9e4e-858041f6e262/bond-cni-plugin/0.log" Jul 01 20:31:18.086271 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:18.086252 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mpdp_d6e3305b-c2fe-4eb3-9e4e-858041f6e262/routeoverride-cni/0.log" Jul 01 20:31:18.106231 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:18.106210 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mpdp_d6e3305b-c2fe-4eb3-9e4e-858041f6e262/whereabouts-cni-bincopy/0.log" Jul 01 20:31:18.128179 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:18.128160 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mpdp_d6e3305b-c2fe-4eb3-9e4e-858041f6e262/whereabouts-cni/0.log" Jul 01 20:31:18.500507 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:18.500479 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wv2q7_8b7a756d-f983-45af-9dfe-6df81ac07903/kube-multus/0.log" Jul 01 20:31:18.522358 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:18.522328 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5dbjk_30acf1f4-d2f9-4ec5-8344-8fea6a81513d/network-metrics-daemon/0.log" Jul 01 20:31:18.541180 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:18.541159 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5dbjk_30acf1f4-d2f9-4ec5-8344-8fea6a81513d/kube-rbac-proxy/0.log" Jul 01 20:31:19.592853 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:19.592800 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-controller/0.log" Jul 01 20:31:19.608084 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:19.608045 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-acl-logging/1.log" Jul 01 20:31:19.608207 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:19.608145 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovn-acl-logging/0.log" Jul 01 20:31:19.628366 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:19.628341 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/kube-rbac-proxy-node/0.log" Jul 01 20:31:19.653010 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:19.652991 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 20:31:19.673690 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:19.673669 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/northd/0.log" Jul 01 20:31:19.692275 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:19.692254 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/nbdb/0.log" Jul 01 20:31:19.710958 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:19.710935 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/sbdb/0.log" Jul 01 20:31:19.775190 ip-10-0-140-83 kubenswrapper[2578]: I0701 20:31:19.775127 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b74d4_20f93818-00f2-4891-bfe8-ab2848dec6bf/ovnkube-controller/0.log"