Jul 20 18:13:25.561903 ip-10-0-142-149 systemd[1]: Starting Kubernetes Kubelet... Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.987610 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995576 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995587 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995591 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995594 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995597 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995600 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995603 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 18:13:26.039294 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995606 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995608 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995611 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995614 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995616 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995618 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995622 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995625 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995627 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995630 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995632 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995648 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995652 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995660 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995663 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995665 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995668 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995670 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995673 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 18:13:26.040247 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995676 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995679 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995682 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995684 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995687 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995690 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995692 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995695 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995698 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995700 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995703 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995705 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995708 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995711 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995713 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995716 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995718 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995723 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995726 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 18:13:26.040743 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995729 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995732 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995735 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995737 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995742 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995745 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995747 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995750 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995752 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995755 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995757 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995760 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995762 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995765 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995768 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995771 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995773 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995776 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995779 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995781 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 18:13:26.260033 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995784 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 18:13:26.056590 ip-10-0-142-149 systemd[1]: Started Kubernetes Kubelet. Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995787 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995789 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995792 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995795 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995797 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995800 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995802 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995805 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995807 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995810 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995812 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995815 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995818 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995821 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995824 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995828 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995831 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995835 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 18:13:26.274932 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995838 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995841 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995843 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995846 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995849 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995851 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995854 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995856 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995859 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995861 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995864 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995867 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995869 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995872 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.995875 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996528 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996534 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996537 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996540 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996543 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 18:13:26.281429 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996545 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996548 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996551 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996554 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996556 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996559 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996562 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996565 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996567 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996570 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996573 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996576 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996578 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996581 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996585 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996588 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996591 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996593 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996596 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996599 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 18:13:26.282692 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996602 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996605 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996607 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996610 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996612 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996615 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996618 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996620 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996622 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996625 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996627 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996630 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996632 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996635 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996652 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996655 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996657 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996660 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996662 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996665 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 18:13:26.284089 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996667 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996670 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996673 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996676 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996679 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996682 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996684 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996687 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996689 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996691 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996694 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996696 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996699 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996702 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996705 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996708 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996711 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996714 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996716 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996719 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 18:13:26.285674 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996721 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996724 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996727 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996729 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996731 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996734 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996736 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996739 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996741 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996744 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996746 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996749 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996751 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996754 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996758 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996761 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996763 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996766 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996769 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 18:13:26.286688 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996771 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996774 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996776 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996779 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996781 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996788 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996791 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996794 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996797 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996800 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996803 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996806 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996808 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996811 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.996815 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997163 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997167 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997170 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997173 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 18:13:26.288117 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997177 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997179 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997182 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997184 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997187 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997190 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997192 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997195 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997197 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997200 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997202 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997205 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997208 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997210 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997212 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997215 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997217 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997220 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997224 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 18:13:26.289076 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997226 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997229 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997232 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997234 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997237 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997239 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997242 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997244 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997248 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997250 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997253 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997257 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997259 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997262 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997265 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997267 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997269 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997272 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997274 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 18:13:26.290347 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997277 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997279 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997282 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997284 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997290 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997292 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997295 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997297 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997300 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997302 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997306 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997309 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997314 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997317 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997320 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997323 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997325 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997328 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997331 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 18:13:26.292369 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997333 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997338 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997342 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997345 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997348 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997351 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997353 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997356 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997358 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997360 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997363 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997365 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997368 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997371 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997373 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997375 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997378 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997380 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997383 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 18:13:26.293272 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997385 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997388 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997390 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997393 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997396 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997398 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997402 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997406 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997409 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997411 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997414 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997416 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997419 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997421 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997424 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997427 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997430 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997432 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.997434 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997502 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997515 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 18:13:26.294095 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997521 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997525 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997529 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997533 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997537 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997540 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997544 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997547 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997550 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997553 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997556 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997559 2576 flags.go:64] FLAG: --cgroup-root="" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997562 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997566 2576 flags.go:64] FLAG: --client-ca-file="" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997569 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997572 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997576 2576 flags.go:64] FLAG: --cluster-domain="" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997581 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997584 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997587 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997590 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997593 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997596 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 18:13:26.294920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997599 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997602 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997605 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997609 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997613 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997616 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997619 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997623 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997626 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997628 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997631 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997634 2576 flags.go:64] FLAG: --enable-server="true" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997654 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997659 2576 flags.go:64] FLAG: --event-burst="100" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997662 2576 flags.go:64] FLAG: --event-qps="50" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997665 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997668 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997671 2576 flags.go:64] FLAG: --eviction-hard="" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997675 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997678 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997681 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997684 2576 flags.go:64] FLAG: --eviction-soft="" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997687 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997690 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997693 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 18:13:26.295805 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997696 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997700 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997703 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997706 2576 flags.go:64] FLAG: --feature-gates="" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997710 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997713 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997716 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997719 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997722 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997725 2576 flags.go:64] FLAG: --help="false" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997729 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997732 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997735 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997738 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997741 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997745 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997748 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997751 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997753 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997756 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997759 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997762 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997765 2576 flags.go:64] FLAG: --kube-reserved="" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997768 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 18:13:26.296822 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997770 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997774 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997776 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997779 2576 flags.go:64] FLAG: --lock-file="" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997782 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997785 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997788 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997793 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997796 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997800 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997803 2576 flags.go:64] FLAG: --logging-format="text" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997806 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997809 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997812 2576 flags.go:64] FLAG: --manifest-url="" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997814 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997818 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997821 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997825 2576 flags.go:64] FLAG: --max-pods="110" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997831 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997834 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997837 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997840 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997843 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997846 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997849 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 18:13:26.297769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997855 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997858 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997861 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997864 2576 flags.go:64] FLAG: --pod-cidr="" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997867 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997873 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997875 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997878 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997881 2576 flags.go:64] FLAG: --port="10250" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997884 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997887 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00b99ad6e9c695c50" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997890 2576 flags.go:64] FLAG: --qos-reserved="" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997894 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997896 2576 flags.go:64] FLAG: --register-node="true" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997899 2576 flags.go:64] FLAG: --register-with-taints="" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997904 2576 flags.go:64] FLAG: --registry-burst="10" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997907 2576 flags.go:64] FLAG: --registry-qps="5" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997911 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997914 2576 flags.go:64] FLAG: --reserved-memory="" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997917 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997920 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997923 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997926 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997929 2576 flags.go:64] FLAG: --runonce="false" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997932 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 18:13:26.298813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997936 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997939 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997941 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997944 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997947 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997950 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997953 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997956 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997959 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997961 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997964 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997967 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997970 2576 flags.go:64] FLAG: --system-cgroups="" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997973 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997978 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997980 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997983 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997987 2576 flags.go:64] FLAG: --tls-min-version="" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997990 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997993 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997996 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.997998 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.998001 2576 flags.go:64] FLAG: --v="2" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.998006 2576 flags.go:64] FLAG: --version="false" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.998011 2576 flags.go:64] FLAG: --vmodule="" Jul 20 18:13:26.299806 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.998014 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.998018 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998127 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998130 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998133 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998136 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998139 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998143 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998146 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998149 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998152 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998154 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998157 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998159 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998162 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998165 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998167 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998170 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998172 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998175 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 18:13:26.300801 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998177 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998179 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998182 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998184 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998187 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998189 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998192 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998194 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998197 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998199 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998202 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998207 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998210 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998212 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998215 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998218 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998220 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998223 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998225 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998230 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998232 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 18:13:26.301590 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998235 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998237 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998240 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998242 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998245 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998247 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998250 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998252 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998255 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998257 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998261 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998265 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998267 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998270 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998273 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998275 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998277 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998280 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998283 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998285 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 18:13:26.302437 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998288 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998291 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998294 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998297 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998300 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998303 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998306 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998308 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998311 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998313 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998317 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998321 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998324 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998327 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998330 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998333 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998335 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998338 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998340 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 18:13:26.303240 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998343 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998345 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998349 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998353 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998356 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998359 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998362 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998365 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998367 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998370 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998372 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998375 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998378 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998380 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998383 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998386 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998389 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998392 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998394 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 18:13:26.303999 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998397 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:25.998399 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:25.998407 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.007659 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.007673 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.008653 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.008662 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008721 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008726 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008729 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008732 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008736 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008739 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008742 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 18:13:26.304747 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008745 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008747 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008750 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008753 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008755 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008758 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008761 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008763 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008766 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008770 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008772 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008775 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008777 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008780 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008782 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008785 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008787 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008790 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008793 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008796 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 18:13:26.305309 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008799 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008801 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008804 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008807 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008809 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008812 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008814 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008817 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008819 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008822 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008824 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008827 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008830 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008832 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008835 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008837 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008840 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008843 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008845 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008848 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 18:13:26.306112 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008851 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008854 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008856 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008859 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008862 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008864 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008866 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008869 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008871 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008874 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008879 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008881 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008884 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008886 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008889 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008892 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008894 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008897 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008899 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008902 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 18:13:26.306901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008904 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008907 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008909 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008912 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008914 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008917 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008921 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008925 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008927 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008930 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008933 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008935 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008939 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008942 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008944 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008948 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008951 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008954 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008957 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008959 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 18:13:26.307746 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008962 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008964 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008968 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008971 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008974 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008977 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008981 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008984 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008987 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008989 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008992 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.008995 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.009000 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009106 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 18:13:26.308518 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009111 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009114 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009117 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009119 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009122 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009124 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009128 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009133 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009137 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009140 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009143 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009147 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009150 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009153 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009155 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009158 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009161 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009164 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009167 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 18:13:26.309083 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009170 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009174 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009176 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009180 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009184 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009187 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009190 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009192 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009195 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009197 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009200 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009202 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009205 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009207 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009210 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009212 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009215 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009217 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009220 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 18:13:26.309854 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009223 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009225 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009229 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009232 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009234 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009237 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009240 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009243 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009245 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009248 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009251 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009253 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009256 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009258 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009262 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009264 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009267 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009271 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009274 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009277 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 18:13:26.310581 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009280 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009282 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009285 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009287 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009290 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009292 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009295 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009297 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009300 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009302 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009305 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009307 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009310 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009312 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009316 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009318 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009321 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009323 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009326 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009329 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 20 18:13:26.311376 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009332 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009334 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009337 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009340 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009342 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009344 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009348 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009351 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009353 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009356 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009358 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009361 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009363 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009366 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009368 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009371 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009373 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009376 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009378 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 18:13:26.312176 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:26.009381 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.009386 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.009506 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.011785 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.013122 2576 server.go:1019] "Starting client certificate rotation" Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.013231 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.013269 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.015487 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.016570 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.024972 2576 log.go:25] "Validated CRI v1 runtime API" Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.026940 2576 log.go:25] "Validated CRI v1 image API" Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.027802 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 18:13:26.312966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.030769 2576 fs.go:135] Filesystem UUIDs: map[381733db-b4ed-4a37-8318-e06b0a3c8dc6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b567bacf-5b0b-4f02-a250-cd6a1f0c7fdf:/dev/nvme0n1p4] Jul 20 18:13:26.313457 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.030782 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 18:13:26.313507 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.035414 2576 manager.go:216] Machine: {Timestamp:2026-07-20 18:13:26.034868312 +0000 UTC m=+0.355026626 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099008 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e36f7d7e1d4fea7c933e538a49352 SystemUUID:ec2e36f7-d7e1-d4fe-a7c9-33e538a49352 BootID:29ed0665-8c36-404e-96f3-887f3fb23e93 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:df:87:b1:ea:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:df:87:b1:ea:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:cb:2f:fc:5b:32 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 18:13:26.313507 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.035541 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 18:13:26.313507 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.035667 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 18:13:26.313507 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.037248 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 18:13:26.313507 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.037834 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-149.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 18:13:26.313507 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.038556 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 18:13:26.313507 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.038567 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 18:13:26.313507 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.038575 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.039306 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.040491 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.043543 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.043670 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.044436 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.044446 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.044455 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.044464 2576 kubelet.go:398] "Adding apiserver pod source" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.044472 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.044907 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.044931 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.047137 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.048857 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.048885 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049928 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049941 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049947 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049952 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049960 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049965 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049973 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049978 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049984 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049990 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.049998 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.050003 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.050580 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.050588 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.055458 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-149.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.055518 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.055578 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.055799 2576 server.go:1268] "Started kubelet" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.055827 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.055856 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.055929 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.057807 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.060209 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 18:13:26.313892 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.062587 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.063802 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-149.ec2.internal.18c4120e8d5841ed default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-149.ec2.internal,UID:ip-10-0-142-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-149.ec2.internal,},FirstTimestamp:2026-07-20 18:13:26.055772653 +0000 UTC m=+0.375930964,LastTimestamp:2026-07-20 18:13:26.055772653 +0000 UTC m=+0.375930964,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-149.ec2.internal,}" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.065933 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.065962 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.066002 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.066463 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.066471 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.066485 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.066592 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.066601 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.066728 2576 factory.go:55] Registering systemd factory Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.066744 2576 factory.go:223] Registration of the systemd container factory successfully Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.066943 2576 factory.go:153] Registering CRI-O factory Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.066956 2576 factory.go:223] Registration of the crio container factory successfully Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.067002 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.067026 2576 factory.go:103] Registering Raw factory Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.067039 2576 manager.go:1196] Started watching for new ooms in manager Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.067355 2576 manager.go:349] Starting recovery of all containers Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.068265 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.068422 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h8rb9" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.076451 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h8rb9" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.077188 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-149.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.077232 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.081165 2576 manager.go:354] Recovery completed Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.085303 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.087121 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.087144 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.087154 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.087633 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.087657 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.087660 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.087672 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 20 18:13:26.315395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.088364 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.088384 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.088400 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.088727 2576 policy_none.go:49] "None policy: Start" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.088750 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.088761 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.089113 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-149.ec2.internal.18c4120e8f36c5a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-149.ec2.internal,UID:ip-10-0-142-149.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-149.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-149.ec2.internal,},FirstTimestamp:2026-07-20 18:13:26.087132576 +0000 UTC m=+0.407290889,LastTimestamp:2026-07-20 18:13:26.087132576 +0000 UTC m=+0.407290889,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-149.ec2.internal,}" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.089631 2576 policy_none.go:47] "Start" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.117179 2576 manager.go:337] "Starting Device Plugin manager" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.117331 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.117370 2576 server.go:87] "Starting device plugin registration server" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.117562 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.117572 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.117691 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.117778 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.117787 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.118893 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.118929 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.217890 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.218651 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.218673 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.218682 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.218705 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.227136 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.227153 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-149.ec2.internal\": node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.243951 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.264798 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.266040 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.266076 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.266099 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.266128 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 18:13:26.316664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.268535 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 18:13:26.344685 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.344666 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:26.367569 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.367542 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal"] Jul 20 18:13:26.368284 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.368270 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 18:13:26.371359 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.371325 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory" Jul 20 18:13:26.371359 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.371357 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 18:13:26.371519 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.371373 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID" Jul 20 18:13:26.372547 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.372533 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 18:13:26.372743 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.372721 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.372810 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.372766 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 18:13:26.373300 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.373283 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory" Jul 20 18:13:26.373366 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.373283 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory" Jul 20 18:13:26.373366 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.373331 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 18:13:26.373366 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.373342 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID" Jul 20 18:13:26.373463 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.373309 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 18:13:26.373463 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.373404 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID" Jul 20 18:13:26.374632 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.374616 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.374686 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.374644 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 18:13:26.375432 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.375411 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientMemory" Jul 20 18:13:26.375497 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.375448 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 18:13:26.375497 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.375465 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeHasSufficientPID" Jul 20 18:13:26.407364 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.407346 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-149.ec2.internal\" not found" node="ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.412086 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.412071 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-149.ec2.internal\" not found" node="ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.445373 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.445351 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:26.468526 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.468506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/050ebd4d45e7f09a481ee99742944a20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"050ebd4d45e7f09a481ee99742944a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.468574 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.468531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7e85b7071d89f6d9d1647bbf823b423-config\") pod \"kube-apiserver-proxy-ip-10-0-142-149.ec2.internal\" (UID: \"e7e85b7071d89f6d9d1647bbf823b423\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.468574 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.468548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/050ebd4d45e7f09a481ee99742944a20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"050ebd4d45e7f09a481ee99742944a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.546376 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.546323 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:26.569395 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.569378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/050ebd4d45e7f09a481ee99742944a20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"050ebd4d45e7f09a481ee99742944a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.569438 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.569402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/050ebd4d45e7f09a481ee99742944a20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"050ebd4d45e7f09a481ee99742944a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.569438 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.569427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7e85b7071d89f6d9d1647bbf823b423-config\") pod \"kube-apiserver-proxy-ip-10-0-142-149.ec2.internal\" (UID: \"e7e85b7071d89f6d9d1647bbf823b423\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.569506 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.569473 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/050ebd4d45e7f09a481ee99742944a20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"050ebd4d45e7f09a481ee99742944a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.569547 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.569480 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7e85b7071d89f6d9d1647bbf823b423-config\") pod \"kube-apiserver-proxy-ip-10-0-142-149.ec2.internal\" (UID: \"e7e85b7071d89f6d9d1647bbf823b423\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.569547 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.569522 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/050ebd4d45e7f09a481ee99742944a20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal\" (UID: \"050ebd4d45e7f09a481ee99742944a20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.652887 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.652863 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:26.712792 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.712772 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.715676 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:26.715659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" Jul 20 18:13:26.753608 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.753588 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:26.854104 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.854073 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:26.955461 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:26.955430 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:27.012389 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.012361 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 18:13:27.012537 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.012520 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 18:13:27.055968 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:27.055928 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:27.077090 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.077065 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 18:13:27.080734 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.080695 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 18:08:26 +0000 UTC" deadline="2028-04-18 08:48:35.986648942 +0000 UTC" Jul 20 18:13:27.080734 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.080732 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15302h35m8.905919333s" Jul 20 18:13:27.156779 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:27.156723 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-149.ec2.internal\" not found" Jul 20 18:13:27.233054 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.233035 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 18:13:27.256801 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.256778 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 18:13:27.266358 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.266335 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" Jul 20 18:13:27.277771 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.277755 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 18:13:27.279632 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.279618 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" Jul 20 18:13:27.286088 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.286073 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 18:13:27.335698 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:27.335684 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 18:13:28.046829 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.046794 2576 apiserver.go:52] "Watching apiserver" Jul 20 18:13:28.053781 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.053762 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 18:13:28.054140 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.054117 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-xhfl2","openshift-dns/node-resolver-h2htm","openshift-multus/multus-75bfs","openshift-multus/multus-additional-cni-plugins-cb5xn","openshift-network-operator/iptables-alerter-9ddl2","kube-system/global-pull-secret-syncer-skln6","kube-system/konnectivity-agent-w8szj","openshift-image-registry/node-ca-97dml","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal","openshift-multus/network-metrics-daemon-cmnwz","openshift-network-diagnostics/network-check-target-t76r8","openshift-ovn-kubernetes/ovnkube-node-qz2b5","kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl"] Jul 20 18:13:28.056605 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.056583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:28.057780 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.057760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:28.057873 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.057824 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:28.059012 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.058994 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.059321 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.059300 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 18:13:28.059613 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.059595 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k9zql\"" Jul 20 18:13:28.059716 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.059625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 18:13:28.060330 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.060312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.061461 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.061439 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 18:13:28.061660 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.061617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.061949 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.061824 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 18:13:28.061949 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.061872 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w285p\"" Jul 20 18:13:28.062224 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.062205 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 18:13:28.062317 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.062221 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 18:13:28.062520 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.062505 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mhhpr\"" Jul 20 18:13:28.062565 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.062553 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 18:13:28.062830 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.062810 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 18:13:28.062972 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.062957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:28.063058 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.063037 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:28.064200 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.064177 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-597tm\"" Jul 20 18:13:28.064306 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.064254 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 18:13:28.064475 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.064458 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.064541 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.064513 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 18:13:28.064767 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.064686 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 18:13:28.065984 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.065967 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.066841 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.066823 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 18:13:28.067101 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.067078 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 18:13:28.067179 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.067106 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 18:13:28.067179 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.067134 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jkf4p\"" Jul 20 18:13:28.067286 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.067181 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 18:13:28.067615 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.067595 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.068153 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.068136 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 18:13:28.068733 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.068706 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 18:13:28.069309 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.068884 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 18:13:28.069309 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.068931 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6kvwq\"" Jul 20 18:13:28.069448 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.069395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:28.069509 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.069482 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:28.070508 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.070481 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 18:13:28.070596 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.070521 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5scjm\"" Jul 20 18:13:28.070847 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.070826 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 18:13:28.072837 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.072816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.074013 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.073989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.076080 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.076065 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-775jc\"" Jul 20 18:13:28.076301 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.076283 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 18:13:28.077045 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.077028 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 18:13:28.077130 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.077115 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 18:13:28.077194 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.077119 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 18:13:28.077598 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.077577 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cg6j5\"" Jul 20 18:13:28.078273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078232 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 18:13:28.078273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078226 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 18:13:28.078437 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078312 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 18:13:28.078437 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078337 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 18:13:28.078547 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09254229-a029-4b42-8634-cc3a565e811c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.078547 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09254229-a029-4b42-8634-cc3a565e811c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.078547 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791e7482-6d04-4043-bc16-f1d3e16814e3-iptables-alerter-script\") pod \"iptables-alerter-9ddl2\" (UID: \"791e7482-6d04-4043-bc16-f1d3e16814e3\") " pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.078726 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.078726 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-device-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.078726 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt684\" (UniqueName: \"kubernetes.io/projected/ab97338f-01d9-46e9-b46f-ed69f687cb91-kube-api-access-wt684\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.078726 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prtbh\" (UniqueName: \"kubernetes.io/projected/2a522f41-ca65-459c-824e-ece681eb3413-kube-api-access-prtbh\") pod \"node-ca-97dml\" (UID: \"2a522f41-ca65-459c-824e-ece681eb3413\") " pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.078726 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a522f41-ca65-459c-824e-ece681eb3413-serviceca\") pod \"node-ca-97dml\" (UID: \"2a522f41-ca65-459c-824e-ece681eb3413\") " pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.078726 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8sbq\" (UniqueName: \"kubernetes.io/projected/2549c6b2-1753-461c-b823-8db9cc671d86-kube-api-access-s8sbq\") pod \"node-resolver-h2htm\" (UID: \"2549c6b2-1753-461c-b823-8db9cc671d86\") " pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw8w8\" (UniqueName: \"kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8\") pod \"network-check-target-t76r8\" (UID: \"89de84f2-65dd-436e-b1e9-42eafeb58dde\") " pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-run-netns\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-var-lib-kubelet\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20a22dbd-217f-4cc6-af47-37c63f7e968d-dbus\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqfr8\" (UniqueName: \"kubernetes.io/projected/09254229-a029-4b42-8634-cc3a565e811c-kube-api-access-fqfr8\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-sys-fs\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.078955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2549c6b2-1753-461c-b823-8db9cc671d86-tmp-dir\") pod \"node-resolver-h2htm\" (UID: \"2549c6b2-1753-461c-b823-8db9cc671d86\") " pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-cni-dir\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079030 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-os-release\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-conf-dir\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f80181e-e10d-4cb8-8a45-dfe5c6142d82-agent-certs\") pod \"konnectivity-agent-w8szj\" (UID: \"3f80181e-e10d-4cb8-8a45-dfe5c6142d82\") " pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-cnibin\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-cni-binary-copy\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-run-k8s-cni-cncf-io\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-var-lib-cni-multus\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-run-multus-certs\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20a22dbd-217f-4cc6-af47-37c63f7e968d-kubelet-config\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-cnibin\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd45d\" (UniqueName: \"kubernetes.io/projected/791e7482-6d04-4043-bc16-f1d3e16814e3-kube-api-access-zd45d\") pod \"iptables-alerter-9ddl2\" (UID: \"791e7482-6d04-4043-bc16-f1d3e16814e3\") " pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-system-cni-dir\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9nrc\" (UniqueName: \"kubernetes.io/projected/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-kube-api-access-d9nrc\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-system-cni-dir\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079452 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-os-release\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791e7482-6d04-4043-bc16-f1d3e16814e3-host-slash\") pod \"iptables-alerter-9ddl2\" (UID: \"791e7482-6d04-4043-bc16-f1d3e16814e3\") " pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a522f41-ca65-459c-824e-ece681eb3413-host\") pod \"node-ca-97dml\" (UID: \"2a522f41-ca65-459c-824e-ece681eb3413\") " pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079536 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-socket-dir-parent\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.079715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-etc-kubernetes\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.080212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-socket-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.080212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-registration-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.080212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-etc-selinux\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.080212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-var-lib-cni-bin\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.080212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09254229-a029-4b42-8634-cc3a565e811c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.080212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2549c6b2-1753-461c-b823-8db9cc671d86-hosts-file\") pod \"node-resolver-h2htm\" (UID: \"2549c6b2-1753-461c-b823-8db9cc671d86\") " pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.080212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f80181e-e10d-4cb8-8a45-dfe5c6142d82-konnectivity-ca\") pod \"konnectivity-agent-w8szj\" (UID: \"3f80181e-e10d-4cb8-8a45-dfe5c6142d82\") " pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:28.080212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-hostroot\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.080212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-daemon-config\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.080212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.079867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:28.081603 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.081587 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 18:13:28.112660 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.112638 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fhsqk" Jul 20 18:13:28.124106 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.124086 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fhsqk" Jul 20 18:13:28.167494 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.167472 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 18:13:28.180056 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09254229-a029-4b42-8634-cc3a565e811c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.180158 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09254229-a029-4b42-8634-cc3a565e811c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.180158 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-device-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.180158 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prtbh\" (UniqueName: \"kubernetes.io/projected/2a522f41-ca65-459c-824e-ece681eb3413-kube-api-access-prtbh\") pod \"node-ca-97dml\" (UID: \"2a522f41-ca65-459c-824e-ece681eb3413\") " pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.180158 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53121c2e-6d3e-4b04-9aa9-1772f259f653-env-overrides\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.180384 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180164 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-device-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.180384 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-run-netns\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.180384 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180213 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-run-netns\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.180384 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-modprobe-d\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.180384 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-kubelet\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.180384 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53121c2e-6d3e-4b04-9aa9-1772f259f653-ovn-node-metrics-cert\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.180384 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqfr8\" (UniqueName: \"kubernetes.io/projected/09254229-a029-4b42-8634-cc3a565e811c-kube-api-access-fqfr8\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.180384 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-sys-fs\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2549c6b2-1753-461c-b823-8db9cc671d86-tmp-dir\") pod \"node-resolver-h2htm\" (UID: \"2549c6b2-1753-461c-b823-8db9cc671d86\") " pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180465 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-sys-fs\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-cni-dir\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-conf-dir\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f80181e-e10d-4cb8-8a45-dfe5c6142d82-agent-certs\") pod \"konnectivity-agent-w8szj\" (UID: \"3f80181e-e10d-4cb8-8a45-dfe5c6142d82\") " pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-var-lib-cni-multus\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180685 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2549c6b2-1753-461c-b823-8db9cc671d86-tmp-dir\") pod \"node-resolver-h2htm\" (UID: \"2549c6b2-1753-461c-b823-8db9cc671d86\") " pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-run-multus-certs\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180685 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-conf-dir\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180754 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09254229-a029-4b42-8634-cc3a565e811c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180744 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-var-lib-cni-multus\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180756 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09254229-a029-4b42-8634-cc3a565e811c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.180800 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180783 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-cni-dir\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.181551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-slash\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.181551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180911 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.181551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180947 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-system-cni-dir\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.181551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181100 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 18:13:28.181551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-system-cni-dir\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.181551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.180954 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-run-multus-certs\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.181551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-os-release\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791e7482-6d04-4043-bc16-f1d3e16814e3-host-slash\") pod \"iptables-alerter-9ddl2\" (UID: \"791e7482-6d04-4043-bc16-f1d3e16814e3\") " pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181628 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-os-release\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a522f41-ca65-459c-824e-ece681eb3413-host\") pod \"node-ca-97dml\" (UID: \"2a522f41-ca65-459c-824e-ece681eb3413\") " pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-socket-dir-parent\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-etc-kubernetes\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181761 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a522f41-ca65-459c-824e-ece681eb3413-host\") pod \"node-ca-97dml\" (UID: \"2a522f41-ca65-459c-824e-ece681eb3413\") " pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791e7482-6d04-4043-bc16-f1d3e16814e3-host-slash\") pod \"iptables-alerter-9ddl2\" (UID: \"791e7482-6d04-4043-bc16-f1d3e16814e3\") " pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181790 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-socket-dir-parent\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4245c\" (UniqueName: \"kubernetes.io/projected/1c37edf7-0b78-44c5-8223-de838b9908dd-kube-api-access-4245c\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181811 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-etc-kubernetes\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-kubernetes\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-registration-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-etc-selinux\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.181894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-sysconfig\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-sysctl-conf\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181953 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-registration-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-var-lib-kubelet\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.181987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lg5h\" (UniqueName: \"kubernetes.io/projected/f45a8484-4233-4d2f-a825-ef48a1cbb704-kube-api-access-8lg5h\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-run-netns\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182016 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-etc-selinux\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09254229-a029-4b42-8634-cc3a565e811c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-hostroot\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-systemd-units\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182109 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-hostroot\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-etc-openvswitch\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53121c2e-6d3e-4b04-9aa9-1772f259f653-ovnkube-config\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53121c2e-6d3e-4b04-9aa9-1772f259f653-ovnkube-script-lib\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.182639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791e7482-6d04-4043-bc16-f1d3e16814e3-iptables-alerter-script\") pod \"iptables-alerter-9ddl2\" (UID: \"791e7482-6d04-4043-bc16-f1d3e16814e3\") " pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt684\" (UniqueName: \"kubernetes.io/projected/ab97338f-01d9-46e9-b46f-ed69f687cb91-kube-api-access-wt684\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20a22dbd-217f-4cc6-af47-37c63f7e968d-dbus\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182326 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-run-ovn\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzwzm\" (UniqueName: \"kubernetes.io/projected/53121c2e-6d3e-4b04-9aa9-1772f259f653-kube-api-access-jzwzm\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20a22dbd-217f-4cc6-af47-37c63f7e968d-dbus\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182422 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09254229-a029-4b42-8634-cc3a565e811c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a522f41-ca65-459c-824e-ece681eb3413-serviceca\") pod \"node-ca-97dml\" (UID: \"2a522f41-ca65-459c-824e-ece681eb3413\") " pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8sbq\" (UniqueName: \"kubernetes.io/projected/2549c6b2-1753-461c-b823-8db9cc671d86-kube-api-access-s8sbq\") pod \"node-resolver-h2htm\" (UID: \"2549c6b2-1753-461c-b823-8db9cc671d86\") " pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8w8\" (UniqueName: \"kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8\") pod \"network-check-target-t76r8\" (UID: \"89de84f2-65dd-436e-b1e9-42eafeb58dde\") " pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-var-lib-kubelet\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-sys\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.183271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-run-openvswitch\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182621 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-var-lib-kubelet\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-os-release\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-systemd\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182697 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791e7482-6d04-4043-bc16-f1d3e16814e3-iptables-alerter-script\") pod \"iptables-alerter-9ddl2\" (UID: \"791e7482-6d04-4043-bc16-f1d3e16814e3\") " pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-log-socket\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-cni-netd\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-cnibin\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-cni-binary-copy\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-run-k8s-cni-cncf-io\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182812 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-os-release\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20a22dbd-217f-4cc6-af47-37c63f7e968d-kubelet-config\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182870 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-cnibin\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182909 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-run-k8s-cni-cncf-io\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182921 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a522f41-ca65-459c-824e-ece681eb3413-serviceca\") pod \"node-ca-97dml\" (UID: \"2a522f41-ca65-459c-824e-ece681eb3413\") " pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.183825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20a22dbd-217f-4cc6-af47-37c63f7e968d-kubelet-config\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f45a8484-4233-4d2f-a825-ef48a1cbb704-tmp\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.182991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-cnibin\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd45d\" (UniqueName: \"kubernetes.io/projected/791e7482-6d04-4043-bc16-f1d3e16814e3-kube-api-access-zd45d\") pod \"iptables-alerter-9ddl2\" (UID: \"791e7482-6d04-4043-bc16-f1d3e16814e3\") " pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-system-cni-dir\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183092 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09254229-a029-4b42-8634-cc3a565e811c-cnibin\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183112 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-system-cni-dir\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9nrc\" (UniqueName: \"kubernetes.io/projected/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-kube-api-access-d9nrc\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-sysctl-d\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-lib-modules\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-tuned\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183287 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-cni-binary-copy\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-cni-bin\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.184276 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-socket-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-var-lib-cni-bin\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-run\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-run-systemd\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab97338f-01d9-46e9-b46f-ed69f687cb91-socket-dir\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183464 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-host-var-lib-cni-bin\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-run-ovn-kubernetes\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2549c6b2-1753-461c-b823-8db9cc671d86-hosts-file\") pod \"node-resolver-h2htm\" (UID: \"2549c6b2-1753-461c-b823-8db9cc671d86\") " pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f80181e-e10d-4cb8-8a45-dfe5c6142d82-konnectivity-ca\") pod \"konnectivity-agent-w8szj\" (UID: \"3f80181e-e10d-4cb8-8a45-dfe5c6142d82\") " pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183622 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2549c6b2-1753-461c-b823-8db9cc671d86-hosts-file\") pod \"node-resolver-h2htm\" (UID: \"2549c6b2-1753-461c-b823-8db9cc671d86\") " pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-daemon-config\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-host\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.183736 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:28.184920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-var-lib-openvswitch\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.185798 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.183765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-node-log\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.185798 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.183818 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret podName:20a22dbd-217f-4cc6-af47-37c63f7e968d nodeName:}" failed. No retries permitted until 2026-07-20 18:13:28.683777908 +0000 UTC m=+3.003936226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret") pod "global-pull-secret-syncer-skln6" (UID: "20a22dbd-217f-4cc6-af47-37c63f7e968d") : object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:28.185798 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.184073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-multus-daemon-config\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.185798 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.184129 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f80181e-e10d-4cb8-8a45-dfe5c6142d82-konnectivity-ca\") pod \"konnectivity-agent-w8szj\" (UID: \"3f80181e-e10d-4cb8-8a45-dfe5c6142d82\") " pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:28.185798 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.184954 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f80181e-e10d-4cb8-8a45-dfe5c6142d82-agent-certs\") pod \"konnectivity-agent-w8szj\" (UID: \"3f80181e-e10d-4cb8-8a45-dfe5c6142d82\") " pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:28.188606 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.188576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqfr8\" (UniqueName: \"kubernetes.io/projected/09254229-a029-4b42-8634-cc3a565e811c-kube-api-access-fqfr8\") pod \"multus-additional-cni-plugins-cb5xn\" (UID: \"09254229-a029-4b42-8634-cc3a565e811c\") " pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.189151 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.189117 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 18:13:28.190326 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.189149 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 18:13:28.190326 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.189174 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vw8w8 for pod openshift-network-diagnostics/network-check-target-t76r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:28.190326 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.189177 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prtbh\" (UniqueName: \"kubernetes.io/projected/2a522f41-ca65-459c-824e-ece681eb3413-kube-api-access-prtbh\") pod \"node-ca-97dml\" (UID: \"2a522f41-ca65-459c-824e-ece681eb3413\") " pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.190326 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.189242 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8 podName:89de84f2-65dd-436e-b1e9-42eafeb58dde nodeName:}" failed. No retries permitted until 2026-07-20 18:13:28.689217383 +0000 UTC m=+3.009375695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vw8w8" (UniqueName: "kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8") pod "network-check-target-t76r8" (UID: "89de84f2-65dd-436e-b1e9-42eafeb58dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:28.190870 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.190848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt684\" (UniqueName: \"kubernetes.io/projected/ab97338f-01d9-46e9-b46f-ed69f687cb91-kube-api-access-wt684\") pod \"aws-ebs-csi-driver-node-748hl\" (UID: \"ab97338f-01d9-46e9-b46f-ed69f687cb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.193844 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.193821 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd45d\" (UniqueName: \"kubernetes.io/projected/791e7482-6d04-4043-bc16-f1d3e16814e3-kube-api-access-zd45d\") pod \"iptables-alerter-9ddl2\" (UID: \"791e7482-6d04-4043-bc16-f1d3e16814e3\") " pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.193943 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.193885 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9nrc\" (UniqueName: \"kubernetes.io/projected/32d33bd2-2458-4df8-9aca-37ec4d66a9f1-kube-api-access-d9nrc\") pod \"multus-75bfs\" (UID: \"32d33bd2-2458-4df8-9aca-37ec4d66a9f1\") " pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.194122 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.194103 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8sbq\" (UniqueName: \"kubernetes.io/projected/2549c6b2-1753-461c-b823-8db9cc671d86-kube-api-access-s8sbq\") pod \"node-resolver-h2htm\" (UID: \"2549c6b2-1753-461c-b823-8db9cc671d86\") " pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.269979 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.269944 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" event={"ID":"050ebd4d45e7f09a481ee99742944a20","Type":"ContainerStarted","Data":"7473dbbc5ddb9401411adff4940293fc8d9c6996dc406662a4f417edfd145a79"} Jul 20 18:13:28.284750 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-slash\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.284847 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4245c\" (UniqueName: \"kubernetes.io/projected/1c37edf7-0b78-44c5-8223-de838b9908dd-kube-api-access-4245c\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:28.284847 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-kubernetes\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.284847 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-sysconfig\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.284847 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-sysctl-conf\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.284847 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-var-lib-kubelet\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284858 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-slash\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lg5h\" (UniqueName: \"kubernetes.io/projected/f45a8484-4233-4d2f-a825-ef48a1cbb704-kube-api-access-8lg5h\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-sysconfig\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-run-netns\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284922 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-kubernetes\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284940 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-var-lib-kubelet\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284952 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-run-netns\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-systemd-units\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.284986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-etc-openvswitch\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53121c2e-6d3e-4b04-9aa9-1772f259f653-ovnkube-config\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285008 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-sysctl-conf\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285032 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-systemd-units\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285049 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-etc-openvswitch\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285108 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53121c2e-6d3e-4b04-9aa9-1772f259f653-ovnkube-script-lib\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-run-ovn\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzwzm\" (UniqueName: \"kubernetes.io/projected/53121c2e-6d3e-4b04-9aa9-1772f259f653-kube-api-access-jzwzm\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-sys\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285201 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-run-ovn\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-run-openvswitch\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-systemd\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285290 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-run-openvswitch\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-log-socket\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-cni-netd\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285326 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-systemd\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f45a8484-4233-4d2f-a825-ef48a1cbb704-tmp\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285356 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-cni-netd\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285269 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-sys\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285366 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-log-socket\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.285904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-sysctl-d\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-lib-modules\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-tuned\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285480 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-sysctl-d\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-cni-bin\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-run\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-run-systemd\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53121c2e-6d3e-4b04-9aa9-1772f259f653-ovnkube-config\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.285579 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285617 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-cni-bin\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285620 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-run-ovn-kubernetes\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285671 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-run\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-run-systemd\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286429 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.285626 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs podName:1c37edf7-0b78-44c5-8223-de838b9908dd nodeName:}" failed. No retries permitted until 2026-07-20 18:13:28.785610012 +0000 UTC m=+3.105768326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs") pod "network-metrics-daemon-cmnwz" (UID: "1c37edf7-0b78-44c5-8223-de838b9908dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-run-ovn-kubernetes\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285785 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-host\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-lib-modules\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285735 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53121c2e-6d3e-4b04-9aa9-1772f259f653-ovnkube-script-lib\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-var-lib-openvswitch\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285851 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-host\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-node-log\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53121c2e-6d3e-4b04-9aa9-1772f259f653-env-overrides\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-node-log\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285860 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-var-lib-openvswitch\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-modprobe-d\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.286877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-kubelet\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.287353 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.285980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53121c2e-6d3e-4b04-9aa9-1772f259f653-ovn-node-metrics-cert\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.287353 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.286026 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53121c2e-6d3e-4b04-9aa9-1772f259f653-host-kubelet\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.287353 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.286098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-modprobe-d\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.287353 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.286318 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53121c2e-6d3e-4b04-9aa9-1772f259f653-env-overrides\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.287489 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.287451 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f45a8484-4233-4d2f-a825-ef48a1cbb704-tmp\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.287601 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.287567 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f45a8484-4233-4d2f-a825-ef48a1cbb704-etc-tuned\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.287869 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.287853 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53121c2e-6d3e-4b04-9aa9-1772f259f653-ovn-node-metrics-cert\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.294111 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.294085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzwzm\" (UniqueName: \"kubernetes.io/projected/53121c2e-6d3e-4b04-9aa9-1772f259f653-kube-api-access-jzwzm\") pod \"ovnkube-node-qz2b5\" (UID: \"53121c2e-6d3e-4b04-9aa9-1772f259f653\") " pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.294312 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.294293 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lg5h\" (UniqueName: \"kubernetes.io/projected/f45a8484-4233-4d2f-a825-ef48a1cbb704-kube-api-access-8lg5h\") pod \"tuned-xhfl2\" (UID: \"f45a8484-4233-4d2f-a825-ef48a1cbb704\") " pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.294665 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.294646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4245c\" (UniqueName: \"kubernetes.io/projected/1c37edf7-0b78-44c5-8223-de838b9908dd-kube-api-access-4245c\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:28.370971 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.370947 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:28.375963 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.375946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-75bfs" Jul 20 18:13:28.380978 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:28.380953 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f80181e_e10d_4cb8_8a45_dfe5c6142d82.slice/crio-1c90703bc584ca56eeaa5567c4c6e06b92c42926c249d8386bf41ddf2d4f8a03 WatchSource:0}: Error finding container 1c90703bc584ca56eeaa5567c4c6e06b92c42926c249d8386bf41ddf2d4f8a03: Status 404 returned error can't find the container with id 1c90703bc584ca56eeaa5567c4c6e06b92c42926c249d8386bf41ddf2d4f8a03 Jul 20 18:13:28.383122 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.383073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" Jul 20 18:13:28.384776 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:28.384754 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d33bd2_2458_4df8_9aca_37ec4d66a9f1.slice/crio-cef066f8f547647aeebfdd1a04160a9a1554eee9bb953d0ab336c1cd59780e9f WatchSource:0}: Error finding container cef066f8f547647aeebfdd1a04160a9a1554eee9bb953d0ab336c1cd59780e9f: Status 404 returned error can't find the container with id cef066f8f547647aeebfdd1a04160a9a1554eee9bb953d0ab336c1cd59780e9f Jul 20 18:13:28.387742 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.387724 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9ddl2" Jul 20 18:13:28.391847 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:28.391824 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09254229_a029_4b42_8634_cc3a565e811c.slice/crio-e2139b8324325bd281a04cecd29a7a9cd5fd3e84643ef92c55e31dd5fb12e41f WatchSource:0}: Error finding container e2139b8324325bd281a04cecd29a7a9cd5fd3e84643ef92c55e31dd5fb12e41f: Status 404 returned error can't find the container with id e2139b8324325bd281a04cecd29a7a9cd5fd3e84643ef92c55e31dd5fb12e41f Jul 20 18:13:28.394404 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.394385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" Jul 20 18:13:28.398678 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.398644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-97dml" Jul 20 18:13:28.400556 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:28.400514 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791e7482_6d04_4043_bc16_f1d3e16814e3.slice/crio-1314d2b373afac54f67d85f17945c15915a39212c1c25cfe27220f0f5905f07b WatchSource:0}: Error finding container 1314d2b373afac54f67d85f17945c15915a39212c1c25cfe27220f0f5905f07b: Status 404 returned error can't find the container with id 1314d2b373afac54f67d85f17945c15915a39212c1c25cfe27220f0f5905f07b Jul 20 18:13:28.405169 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.405148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h2htm" Jul 20 18:13:28.410879 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.410858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" Jul 20 18:13:28.411131 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:28.411113 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a522f41_ca65_459c_824e_ece681eb3413.slice/crio-d6d661f472715838b829ea9b8452392eeaef8250da637316fd6f0fc6a217d3b3 WatchSource:0}: Error finding container d6d661f472715838b829ea9b8452392eeaef8250da637316fd6f0fc6a217d3b3: Status 404 returned error can't find the container with id d6d661f472715838b829ea9b8452392eeaef8250da637316fd6f0fc6a217d3b3 Jul 20 18:13:28.413789 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:28.413766 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e85b7071d89f6d9d1647bbf823b423.slice/crio-3365979fb7abb6069af7e5e22c83a706621526696f0a7b2f2c480a2d3892d3ab WatchSource:0}: Error finding container 3365979fb7abb6069af7e5e22c83a706621526696f0a7b2f2c480a2d3892d3ab: Status 404 returned error can't find the container with id 3365979fb7abb6069af7e5e22c83a706621526696f0a7b2f2c480a2d3892d3ab Jul 20 18:13:28.414608 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:28.414533 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab97338f_01d9_46e9_b46f_ed69f687cb91.slice/crio-6f8ec0f2fc9d36c75907401806583dd34159098117d400beb1b81e4d39713a56 WatchSource:0}: Error finding container 6f8ec0f2fc9d36c75907401806583dd34159098117d400beb1b81e4d39713a56: Status 404 returned error can't find the container with id 6f8ec0f2fc9d36c75907401806583dd34159098117d400beb1b81e4d39713a56 Jul 20 18:13:28.415031 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.415014 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:28.418174 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:28.418149 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2549c6b2_1753_461c_b823_8db9cc671d86.slice/crio-8784b563303d5e611dcd7469511b5f9db09c273a47af694c389a99bc565c1031 WatchSource:0}: Error finding container 8784b563303d5e611dcd7469511b5f9db09c273a47af694c389a99bc565c1031: Status 404 returned error can't find the container with id 8784b563303d5e611dcd7469511b5f9db09c273a47af694c389a99bc565c1031 Jul 20 18:13:28.422514 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:28.422488 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45a8484_4233_4d2f_a825_ef48a1cbb704.slice/crio-1545b2ac0f1fa43fa8c3e28e722e44166ac9ef565c35b8afc120be72176519ab WatchSource:0}: Error finding container 1545b2ac0f1fa43fa8c3e28e722e44166ac9ef565c35b8afc120be72176519ab: Status 404 returned error can't find the container with id 1545b2ac0f1fa43fa8c3e28e722e44166ac9ef565c35b8afc120be72176519ab Jul 20 18:13:28.425901 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:13:28.425882 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53121c2e_6d3e_4b04_9aa9_1772f259f653.slice/crio-cc724c90767e957947d639a8dc8874ac44b5fcbf20d9acf015060aaa75990805 WatchSource:0}: Error finding container cc724c90767e957947d639a8dc8874ac44b5fcbf20d9acf015060aaa75990805: Status 404 returned error can't find the container with id cc724c90767e957947d639a8dc8874ac44b5fcbf20d9acf015060aaa75990805 Jul 20 18:13:28.499360 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.499337 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 18:13:28.688505 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.688423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:28.688632 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.688575 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:28.688632 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.688629 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret podName:20a22dbd-217f-4cc6-af47-37c63f7e968d nodeName:}" failed. No retries permitted until 2026-07-20 18:13:29.688614228 +0000 UTC m=+4.008772531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret") pod "global-pull-secret-syncer-skln6" (UID: "20a22dbd-217f-4cc6-af47-37c63f7e968d") : object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:28.788887 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.788849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:28.789042 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:28.789016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8w8\" (UniqueName: \"kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8\") pod \"network-check-target-t76r8\" (UID: \"89de84f2-65dd-436e-b1e9-42eafeb58dde\") " pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:28.789042 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.789023 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:28.789232 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.789102 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs podName:1c37edf7-0b78-44c5-8223-de838b9908dd nodeName:}" failed. No retries permitted until 2026-07-20 18:13:29.789067766 +0000 UTC m=+4.109226070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs") pod "network-metrics-daemon-cmnwz" (UID: "1c37edf7-0b78-44c5-8223-de838b9908dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:28.789232 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.789168 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 18:13:28.789232 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.789193 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 18:13:28.789232 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.789207 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vw8w8 for pod openshift-network-diagnostics/network-check-target-t76r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:28.789458 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:28.789257 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8 podName:89de84f2-65dd-436e-b1e9-42eafeb58dde nodeName:}" failed. No retries permitted until 2026-07-20 18:13:29.789240928 +0000 UTC m=+4.109399232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw8w8" (UniqueName: "kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8") pod "network-check-target-t76r8" (UID: "89de84f2-65dd-436e-b1e9-42eafeb58dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:29.126894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.126834 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 18:08:28 +0000 UTC" deadline="2027-12-28 08:33:46.712595124 +0000 UTC" Jul 20 18:13:29.126894 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.126892 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12614h20m17.585707318s" Jul 20 18:13:29.266600 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.266566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:29.266800 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:29.266720 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:29.285198 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.285140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9ddl2" event={"ID":"791e7482-6d04-4043-bc16-f1d3e16814e3","Type":"ContainerStarted","Data":"1314d2b373afac54f67d85f17945c15915a39212c1c25cfe27220f0f5905f07b"} Jul 20 18:13:29.297577 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.297545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" event={"ID":"09254229-a029-4b42-8634-cc3a565e811c","Type":"ContainerStarted","Data":"e2139b8324325bd281a04cecd29a7a9cd5fd3e84643ef92c55e31dd5fb12e41f"} Jul 20 18:13:29.308460 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.308427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" event={"ID":"53121c2e-6d3e-4b04-9aa9-1772f259f653","Type":"ContainerStarted","Data":"cc724c90767e957947d639a8dc8874ac44b5fcbf20d9acf015060aaa75990805"} Jul 20 18:13:29.330799 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.330730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" event={"ID":"f45a8484-4233-4d2f-a825-ef48a1cbb704","Type":"ContainerStarted","Data":"1545b2ac0f1fa43fa8c3e28e722e44166ac9ef565c35b8afc120be72176519ab"} Jul 20 18:13:29.355954 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.355924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" event={"ID":"e7e85b7071d89f6d9d1647bbf823b423","Type":"ContainerStarted","Data":"3365979fb7abb6069af7e5e22c83a706621526696f0a7b2f2c480a2d3892d3ab"} Jul 20 18:13:29.376153 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.376118 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-75bfs" event={"ID":"32d33bd2-2458-4df8-9aca-37ec4d66a9f1","Type":"ContainerStarted","Data":"cef066f8f547647aeebfdd1a04160a9a1554eee9bb953d0ab336c1cd59780e9f"} Jul 20 18:13:29.385569 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.385501 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w8szj" event={"ID":"3f80181e-e10d-4cb8-8a45-dfe5c6142d82","Type":"ContainerStarted","Data":"1c90703bc584ca56eeaa5567c4c6e06b92c42926c249d8386bf41ddf2d4f8a03"} Jul 20 18:13:29.393329 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.393297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h2htm" event={"ID":"2549c6b2-1753-461c-b823-8db9cc671d86","Type":"ContainerStarted","Data":"8784b563303d5e611dcd7469511b5f9db09c273a47af694c389a99bc565c1031"} Jul 20 18:13:29.405663 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.405633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" event={"ID":"ab97338f-01d9-46e9-b46f-ed69f687cb91","Type":"ContainerStarted","Data":"6f8ec0f2fc9d36c75907401806583dd34159098117d400beb1b81e4d39713a56"} Jul 20 18:13:29.418743 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.418664 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-97dml" event={"ID":"2a522f41-ca65-459c-824e-ece681eb3413","Type":"ContainerStarted","Data":"d6d661f472715838b829ea9b8452392eeaef8250da637316fd6f0fc6a217d3b3"} Jul 20 18:13:29.695827 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.695495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:29.695827 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:29.695654 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:29.695827 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:29.695738 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret podName:20a22dbd-217f-4cc6-af47-37c63f7e968d nodeName:}" failed. No retries permitted until 2026-07-20 18:13:31.695718248 +0000 UTC m=+6.015876565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret") pod "global-pull-secret-syncer-skln6" (UID: "20a22dbd-217f-4cc6-af47-37c63f7e968d") : object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:29.796017 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.795921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8w8\" (UniqueName: \"kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8\") pod \"network-check-target-t76r8\" (UID: \"89de84f2-65dd-436e-b1e9-42eafeb58dde\") " pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:29.796017 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:29.795984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:29.796332 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:29.796120 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 18:13:29.796332 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:29.796155 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 18:13:29.796332 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:29.796169 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vw8w8 for pod openshift-network-diagnostics/network-check-target-t76r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:29.796332 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:29.796229 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8 podName:89de84f2-65dd-436e-b1e9-42eafeb58dde nodeName:}" failed. No retries permitted until 2026-07-20 18:13:31.796210557 +0000 UTC m=+6.116368873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw8w8" (UniqueName: "kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8") pod "network-check-target-t76r8" (UID: "89de84f2-65dd-436e-b1e9-42eafeb58dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:29.796668 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:29.796128 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:29.796668 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:29.796660 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs podName:1c37edf7-0b78-44c5-8223-de838b9908dd nodeName:}" failed. No retries permitted until 2026-07-20 18:13:31.79664264 +0000 UTC m=+6.116800942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs") pod "network-metrics-daemon-cmnwz" (UID: "1c37edf7-0b78-44c5-8223-de838b9908dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:30.127229 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:30.127186 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 18:08:28 +0000 UTC" deadline="2028-01-11 07:53:11.600111817 +0000 UTC" Jul 20 18:13:30.127229 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:30.127228 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12949h39m41.472888753s" Jul 20 18:13:30.267111 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:30.267028 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:30.267274 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:30.267175 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:30.267630 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:30.267608 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:30.267776 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:30.267753 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:31.266367 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:31.266328 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:31.266897 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:31.266522 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:31.717075 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:31.717031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:31.717264 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:31.717184 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:31.717343 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:31.717309 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret podName:20a22dbd-217f-4cc6-af47-37c63f7e968d nodeName:}" failed. No retries permitted until 2026-07-20 18:13:35.717286868 +0000 UTC m=+10.037445173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret") pod "global-pull-secret-syncer-skln6" (UID: "20a22dbd-217f-4cc6-af47-37c63f7e968d") : object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:31.817639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:31.817579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8w8\" (UniqueName: \"kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8\") pod \"network-check-target-t76r8\" (UID: \"89de84f2-65dd-436e-b1e9-42eafeb58dde\") " pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:31.817639 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:31.817639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:31.817893 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:31.817852 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:31.817950 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:31.817924 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs podName:1c37edf7-0b78-44c5-8223-de838b9908dd nodeName:}" failed. No retries permitted until 2026-07-20 18:13:35.817902624 +0000 UTC m=+10.138060940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs") pod "network-metrics-daemon-cmnwz" (UID: "1c37edf7-0b78-44c5-8223-de838b9908dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:31.818380 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:31.818351 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 18:13:31.818380 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:31.818376 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 18:13:31.818546 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:31.818391 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vw8w8 for pod openshift-network-diagnostics/network-check-target-t76r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:31.818546 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:31.818439 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8 podName:89de84f2-65dd-436e-b1e9-42eafeb58dde nodeName:}" failed. No retries permitted until 2026-07-20 18:13:35.818423526 +0000 UTC m=+10.138581827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw8w8" (UniqueName: "kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8") pod "network-check-target-t76r8" (UID: "89de84f2-65dd-436e-b1e9-42eafeb58dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:32.267089 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:32.267051 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:32.267575 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:32.267204 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:32.267575 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:32.267051 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:32.267718 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:32.267649 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:33.267484 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:33.267106 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:33.267484 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:33.267244 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:34.266694 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:34.266601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:34.266853 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:34.266755 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:34.266916 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:34.266842 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:34.267041 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:34.266993 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:35.266354 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:35.266292 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:35.266805 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:35.266409 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:35.752295 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:35.752253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:35.752467 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:35.752411 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:35.752526 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:35.752488 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret podName:20a22dbd-217f-4cc6-af47-37c63f7e968d nodeName:}" failed. No retries permitted until 2026-07-20 18:13:43.752467188 +0000 UTC m=+18.072625487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret") pod "global-pull-secret-syncer-skln6" (UID: "20a22dbd-217f-4cc6-af47-37c63f7e968d") : object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:35.853694 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:35.853629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:35.853863 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:35.853810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8w8\" (UniqueName: \"kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8\") pod \"network-check-target-t76r8\" (UID: \"89de84f2-65dd-436e-b1e9-42eafeb58dde\") " pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:35.853936 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:35.853871 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:35.853989 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:35.853944 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs podName:1c37edf7-0b78-44c5-8223-de838b9908dd nodeName:}" failed. No retries permitted until 2026-07-20 18:13:43.853922784 +0000 UTC m=+18.174081085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs") pod "network-metrics-daemon-cmnwz" (UID: "1c37edf7-0b78-44c5-8223-de838b9908dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:35.853989 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:35.853967 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 18:13:35.854104 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:35.854006 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 18:13:35.854104 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:35.854023 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vw8w8 for pod openshift-network-diagnostics/network-check-target-t76r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:35.854204 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:35.854148 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8 podName:89de84f2-65dd-436e-b1e9-42eafeb58dde nodeName:}" failed. No retries permitted until 2026-07-20 18:13:43.854096196 +0000 UTC m=+18.174254496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw8w8" (UniqueName: "kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8") pod "network-check-target-t76r8" (UID: "89de84f2-65dd-436e-b1e9-42eafeb58dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:36.268765 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:36.268729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:36.269143 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:36.268864 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:36.269143 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:36.268979 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:36.269143 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:36.268860 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:37.266268 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:37.266233 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:37.266446 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:37.266359 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:38.266443 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:38.266418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:38.266833 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:38.266540 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:38.266833 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:38.266591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:38.266833 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:38.266744 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:39.266905 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:39.266870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:39.267334 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:39.267005 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:40.269069 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:40.269045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:40.269405 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:40.269148 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:40.269405 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:40.269222 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:40.269405 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:40.269318 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:41.266602 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:41.266564 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:41.266814 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:41.266708 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:42.266869 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:42.266826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:42.266869 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:42.266857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:42.267386 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:42.266966 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:42.267386 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:42.267102 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:43.267162 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:43.267128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:43.267577 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:43.267253 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:43.815697 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:43.815664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:43.815881 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:43.815804 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:43.815881 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:43.815863 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret podName:20a22dbd-217f-4cc6-af47-37c63f7e968d nodeName:}" failed. No retries permitted until 2026-07-20 18:13:59.815844753 +0000 UTC m=+34.136003052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret") pod "global-pull-secret-syncer-skln6" (UID: "20a22dbd-217f-4cc6-af47-37c63f7e968d") : object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:43.916594 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:43.916555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8w8\" (UniqueName: \"kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8\") pod \"network-check-target-t76r8\" (UID: \"89de84f2-65dd-436e-b1e9-42eafeb58dde\") " pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:43.916785 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:43.916620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:43.916785 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:43.916742 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 18:13:43.916785 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:43.916753 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:43.916785 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:43.916769 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 18:13:43.916785 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:43.916782 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vw8w8 for pod openshift-network-diagnostics/network-check-target-t76r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:43.917039 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:43.916813 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs podName:1c37edf7-0b78-44c5-8223-de838b9908dd nodeName:}" failed. No retries permitted until 2026-07-20 18:13:59.916797266 +0000 UTC m=+34.236955564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs") pod "network-metrics-daemon-cmnwz" (UID: "1c37edf7-0b78-44c5-8223-de838b9908dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:43.917039 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:43.916835 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8 podName:89de84f2-65dd-436e-b1e9-42eafeb58dde nodeName:}" failed. No retries permitted until 2026-07-20 18:13:59.91681991 +0000 UTC m=+34.236978208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw8w8" (UniqueName: "kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8") pod "network-check-target-t76r8" (UID: "89de84f2-65dd-436e-b1e9-42eafeb58dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:44.267069 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:44.267041 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:44.267184 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:44.267142 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:44.267425 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:44.267219 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:44.267425 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:44.267314 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:45.267236 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:45.267199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:45.267663 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:45.267317 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:46.267423 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:46.267383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:46.267920 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:46.267389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:46.267920 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:46.267498 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:46.267920 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:46.267563 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:47.266432 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:47.266397 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:47.266598 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:47.266515 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:48.267364 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:48.267330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:48.267914 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:48.267344 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:48.267914 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:48.267451 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:48.267914 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:48.267553 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:49.267064 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.267036 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:49.267157 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:49.267136 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:49.487779 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.487600 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:13:49.488204 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.488083 2576 generic.go:356] "Generic (PLEG): container finished" podID="53121c2e-6d3e-4b04-9aa9-1772f259f653" containerID="ed339937d1f4f1f2f987e2b95c1e13b2ad8559186967efcc87f09b9d684f8e2c" exitCode=1 Jul 20 18:13:49.488204 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.488153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" event={"ID":"53121c2e-6d3e-4b04-9aa9-1772f259f653","Type":"ContainerStarted","Data":"3899614624a52f65c566c59dab8f891e28e4005fda610b72f60e7f5a0566f5b4"} Jul 20 18:13:49.488318 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.488237 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" event={"ID":"53121c2e-6d3e-4b04-9aa9-1772f259f653","Type":"ContainerStarted","Data":"534464e659f8fb3f2f3793bb95f1c1ef0fc86bff0a06d375a8aa268090fc6bd6"} Jul 20 18:13:49.488318 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.488290 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" event={"ID":"53121c2e-6d3e-4b04-9aa9-1772f259f653","Type":"ContainerDied","Data":"ed339937d1f4f1f2f987e2b95c1e13b2ad8559186967efcc87f09b9d684f8e2c"} Jul 20 18:13:49.488431 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.488340 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" event={"ID":"53121c2e-6d3e-4b04-9aa9-1772f259f653","Type":"ContainerStarted","Data":"e3557a1c9b00b72de8878127be80bfb2191ab97b95d8c953549d48667340b141"} Jul 20 18:13:49.489573 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.489550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" event={"ID":"f45a8484-4233-4d2f-a825-ef48a1cbb704","Type":"ContainerStarted","Data":"1a402db3c5f9f509e8708c9ec228147463dd56ffd27c94a0769a266ec957d726"} Jul 20 18:13:49.491056 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.491035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" event={"ID":"e7e85b7071d89f6d9d1647bbf823b423","Type":"ContainerStarted","Data":"90694a4e2cde0eefb1186282a0a70da2935ca3629367082036b983a4bcfbd67b"} Jul 20 18:13:49.493388 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.493328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-75bfs" event={"ID":"32d33bd2-2458-4df8-9aca-37ec4d66a9f1","Type":"ContainerStarted","Data":"099351082a9f7099a0add64637665969ccea82853b712a107c57dc9c9eb0e53e"} Jul 20 18:13:49.518182 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.518129 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xhfl2" podStartSLOduration=3.001135798 podStartE2EDuration="23.518116291s" totalImagesPullingTime="20.516980493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:49.517894036 +0000 UTC m=+23.838052388" watchObservedRunningTime="2026-07-20 18:13:49.518116291 +0000 UTC m=+23.838274611" Jul 20 18:13:49.533552 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.533507 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-75bfs" podStartSLOduration=2.9811269510000002 podStartE2EDuration="23.533495855s" totalImagesPullingTime="20.552368904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:49.533262788 +0000 UTC m=+23.853421109" watchObservedRunningTime="2026-07-20 18:13:49.533495855 +0000 UTC m=+23.853654177" Jul 20 18:13:49.546759 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:49.546582 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-149.ec2.internal" podStartSLOduration=22.546562278 podStartE2EDuration="22.546562278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:49.545693807 +0000 UTC m=+23.865852152" watchObservedRunningTime="2026-07-20 18:13:49.546562278 +0000 UTC m=+23.866720598" Jul 20 18:13:50.267253 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.267226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:50.267419 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:50.267321 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:50.267419 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.267408 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:50.267507 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:50.267489 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:50.497872 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.497797 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:13:50.498560 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.498150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" event={"ID":"53121c2e-6d3e-4b04-9aa9-1772f259f653","Type":"ContainerStarted","Data":"b28fcc3d353c41f1d09b033daa8ea30fbec56c7a4a1b617d5564cc8a81e583be"} Jul 20 18:13:50.498560 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.498211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" event={"ID":"53121c2e-6d3e-4b04-9aa9-1772f259f653","Type":"ContainerStarted","Data":"f6bf1ec5803b308cb4cf17c352d141bb88bfbf9f955c33f250221b49f4d160c8"} Jul 20 18:13:50.499485 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.499456 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w8szj" event={"ID":"3f80181e-e10d-4cb8-8a45-dfe5c6142d82","Type":"ContainerStarted","Data":"5e06397539cb423bd71fc590dc24d74bb0afcf7cdfedf7340251e375c8373625"} Jul 20 18:13:50.500872 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.500850 2576 generic.go:356] "Generic (PLEG): container finished" podID="050ebd4d45e7f09a481ee99742944a20" containerID="f42c434cd27a3d3241d25ee1063195ac99a3137f3310f55d6b3de893948b9644" exitCode=0 Jul 20 18:13:50.500974 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.500918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" event={"ID":"050ebd4d45e7f09a481ee99742944a20","Type":"ContainerDied","Data":"f42c434cd27a3d3241d25ee1063195ac99a3137f3310f55d6b3de893948b9644"} Jul 20 18:13:50.502345 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.502319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h2htm" event={"ID":"2549c6b2-1753-461c-b823-8db9cc671d86","Type":"ContainerStarted","Data":"019c359ff2b2529c9c37134862257627fa72e4e1ec56c3b3e60e206878027a95"} Jul 20 18:13:50.503732 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.503712 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" event={"ID":"ab97338f-01d9-46e9-b46f-ed69f687cb91","Type":"ContainerStarted","Data":"6dea4e1bda5a56ed99265ff8c197bdfef7af640bcc49590026e51b0fcf1edcf5"} Jul 20 18:13:50.505068 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.505044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-97dml" event={"ID":"2a522f41-ca65-459c-824e-ece681eb3413","Type":"ContainerStarted","Data":"e9cb269624417efbb21dd6c3a6726e0dffe09d87516b432e8bf96ef420172097"} Jul 20 18:13:50.506286 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.506266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9ddl2" event={"ID":"791e7482-6d04-4043-bc16-f1d3e16814e3","Type":"ContainerStarted","Data":"95a47b69d699c7684e325a86ac96ed48728db9b0216d29aa496265e9b4095e49"} Jul 20 18:13:50.507595 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.507572 2576 generic.go:356] "Generic (PLEG): container finished" podID="09254229-a029-4b42-8634-cc3a565e811c" containerID="27a15018fa349aa91ca040d5f17e86bf29fb088608a3c269b2352e26711428a7" exitCode=0 Jul 20 18:13:50.507688 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.507670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" event={"ID":"09254229-a029-4b42-8634-cc3a565e811c","Type":"ContainerDied","Data":"27a15018fa349aa91ca040d5f17e86bf29fb088608a3c269b2352e26711428a7"} Jul 20 18:13:50.515703 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.515667 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w8szj" podStartSLOduration=3.994411603 podStartE2EDuration="24.51565642s" totalImagesPullingTime="20.521244817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:50.515344056 +0000 UTC m=+24.835502396" watchObservedRunningTime="2026-07-20 18:13:50.51565642 +0000 UTC m=+24.835814734" Jul 20 18:13:50.549137 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.549093 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h2htm" podStartSLOduration=4.065307395 podStartE2EDuration="24.549077082s" totalImagesPullingTime="20.483769687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:50.548550259 +0000 UTC m=+24.868708580" watchObservedRunningTime="2026-07-20 18:13:50.549077082 +0000 UTC m=+24.869235406" Jul 20 18:13:50.578392 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.578350 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9ddl2" podStartSLOduration=4.042494998 podStartE2EDuration="24.578338744s" totalImagesPullingTime="20.535843746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:50.577913654 +0000 UTC m=+24.898071974" watchObservedRunningTime="2026-07-20 18:13:50.578338744 +0000 UTC m=+24.898497063" Jul 20 18:13:50.590559 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:50.590524 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-97dml" podStartSLOduration=4.098539362 podStartE2EDuration="24.590511874s" totalImagesPullingTime="20.491972512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:50.590432976 +0000 UTC m=+24.910591443" watchObservedRunningTime="2026-07-20 18:13:50.590511874 +0000 UTC m=+24.910670193" Jul 20 18:13:51.267120 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:51.267092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:51.267292 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:51.267189 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:51.420263 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:51.420231 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 18:13:51.514849 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:51.514809 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" event={"ID":"050ebd4d45e7f09a481ee99742944a20","Type":"ContainerStarted","Data":"c9774e58f5a80d35440fae5abd580531406ae89c9bdcea283d792a28006b5ff8"} Jul 20 18:13:51.516940 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:51.516913 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" event={"ID":"ab97338f-01d9-46e9-b46f-ed69f687cb91","Type":"ContainerStarted","Data":"825c0b176441483b429dfb3a23cadd1b864ee5b00cb4bb69ef9e209b7daa014a"} Jul 20 18:13:51.529923 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:51.529846 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-149.ec2.internal" podStartSLOduration=24.529833768 podStartE2EDuration="24.529833768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:51.529483081 +0000 UTC m=+25.849641402" watchObservedRunningTime="2026-07-20 18:13:51.529833768 +0000 UTC m=+25.849992087" Jul 20 18:13:52.137388 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:52.137299 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T18:13:51.420255184Z","UUID":"36b0e173-1f8f-4555-ba52-991bd3536ccd","Handler":null,"Name":"","Endpoint":""} Jul 20 18:13:52.138992 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:52.138968 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 18:13:52.139106 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:52.139005 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 18:13:52.267107 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:52.267053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:52.267386 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:52.267053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:52.267386 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:52.267177 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:52.267386 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:52.267318 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:52.522594 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:52.522566 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:13:52.523068 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:52.523035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" event={"ID":"53121c2e-6d3e-4b04-9aa9-1772f259f653","Type":"ContainerStarted","Data":"a2a684df0ade8cdcc4c4c239b39e06aeae83d49d5ac0202ab9275788a159269c"} Jul 20 18:13:53.260814 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:53.260776 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:53.261362 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:53.261342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:53.266513 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:53.266492 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:53.266627 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:53.266579 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:53.527270 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:53.527179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" event={"ID":"ab97338f-01d9-46e9-b46f-ed69f687cb91","Type":"ContainerStarted","Data":"7e1f9eae58ffb959ea79c0f8bcae90aec965bc9942dfd85a469b77cc093ef50d"} Jul 20 18:13:53.527721 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:53.527382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:53.528506 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:53.528483 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w8szj" Jul 20 18:13:53.544239 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:53.544198 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-748hl" podStartSLOduration=4.639980171 podStartE2EDuration="27.544183883s" totalImagesPullingTime="22.904203712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:53.543548837 +0000 UTC m=+27.863707184" watchObservedRunningTime="2026-07-20 18:13:53.544183883 +0000 UTC m=+27.864342203" Jul 20 18:13:54.266986 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:54.266693 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:54.267831 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:54.266905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:54.269864 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:54.268240 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:54.269864 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:54.269238 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:55.266613 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:55.266578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:55.267390 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:55.266714 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:55.533664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:55.533582 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:13:55.533981 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:55.533959 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" event={"ID":"53121c2e-6d3e-4b04-9aa9-1772f259f653","Type":"ContainerStarted","Data":"9fcb712112e31fde618a2765501c79f249e0c870ee2231cc40cad8de880e88e0"} Jul 20 18:13:55.534222 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:55.534200 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:55.534397 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:55.534379 2576 scope.go:117] "RemoveContainer" containerID="ed339937d1f4f1f2f987e2b95c1e13b2ad8559186967efcc87f09b9d684f8e2c" Jul 20 18:13:55.535992 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:55.535964 2576 generic.go:356] "Generic (PLEG): container finished" podID="09254229-a029-4b42-8634-cc3a565e811c" containerID="23b5bcc0a705fd10bfb3b4f9e9e69fa2fa017ab516feb013e7dfdc578d5ff865" exitCode=0 Jul 20 18:13:55.536084 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:55.536041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" event={"ID":"09254229-a029-4b42-8634-cc3a565e811c","Type":"ContainerDied","Data":"23b5bcc0a705fd10bfb3b4f9e9e69fa2fa017ab516feb013e7dfdc578d5ff865"} Jul 20 18:13:55.550733 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:55.550715 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:56.268008 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.267978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:56.268565 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:56.268065 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:56.268565 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.268118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:56.268565 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:56.268231 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:56.543488 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.543419 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:13:56.543876 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.543850 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" event={"ID":"53121c2e-6d3e-4b04-9aa9-1772f259f653","Type":"ContainerStarted","Data":"82649c48d459d20b3dfdc19dc4a5216a90baefabed009c15cb5be469c5a73281"} Jul 20 18:13:56.544121 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.544099 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:56.544196 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.544169 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:56.551340 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.551316 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-skln6"] Jul 20 18:13:56.551463 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.551406 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:56.551521 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:56.551504 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:56.554872 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.554852 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t76r8"] Jul 20 18:13:56.554965 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.554939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:56.555055 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:56.555023 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:56.555693 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.555659 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cmnwz"] Jul 20 18:13:56.555784 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.555751 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:56.555860 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:56.555836 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:56.560868 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.560850 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:13:56.575234 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:56.575194 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" podStartSLOduration=10.020799793 podStartE2EDuration="30.575182676s" totalImagesPullingTime="20.554382883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:56.574121799 +0000 UTC m=+30.894280138" watchObservedRunningTime="2026-07-20 18:13:56.575182676 +0000 UTC m=+30.895340974" Jul 20 18:13:58.266778 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:58.266704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:58.266778 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:58.266719 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:58.267271 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:58.266712 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:58.267271 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:58.266804 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:13:58.267271 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:58.266863 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:13:58.267271 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:58.266936 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:13:58.549741 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:58.549667 2576 generic.go:356] "Generic (PLEG): container finished" podID="09254229-a029-4b42-8634-cc3a565e811c" containerID="ab26d6c1ee9c22c2370774b5ff4b723b6d4ae101689863a7ea978aa3d6ac27a1" exitCode=0 Jul 20 18:13:58.549869 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:58.549758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" event={"ID":"09254229-a029-4b42-8634-cc3a565e811c","Type":"ContainerDied","Data":"ab26d6c1ee9c22c2370774b5ff4b723b6d4ae101689863a7ea978aa3d6ac27a1"} Jul 20 18:13:59.841617 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:59.841367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:13:59.841957 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:59.841508 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:59.841957 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:59.841697 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret podName:20a22dbd-217f-4cc6-af47-37c63f7e968d nodeName:}" failed. No retries permitted until 2026-07-20 18:14:31.841679398 +0000 UTC m=+66.161837696 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret") pod "global-pull-secret-syncer-skln6" (UID: "20a22dbd-217f-4cc6-af47-37c63f7e968d") : object "kube-system"/"original-pull-secret" not registered Jul 20 18:13:59.942065 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:59.942035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:13:59.942203 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:13:59.942107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8w8\" (UniqueName: \"kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8\") pod \"network-check-target-t76r8\" (UID: \"89de84f2-65dd-436e-b1e9-42eafeb58dde\") " pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:13:59.942203 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:59.942183 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:59.942305 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:59.942205 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 18:13:59.942305 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:59.942218 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 18:13:59.942305 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:59.942227 2576 projected.go:196] Error preparing data for projected volume kube-api-access-vw8w8 for pod openshift-network-diagnostics/network-check-target-t76r8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:13:59.942305 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:59.942241 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs podName:1c37edf7-0b78-44c5-8223-de838b9908dd nodeName:}" failed. No retries permitted until 2026-07-20 18:14:31.942227458 +0000 UTC m=+66.262385766 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs") pod "network-metrics-daemon-cmnwz" (UID: "1c37edf7-0b78-44c5-8223-de838b9908dd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 18:13:59.942305 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:13:59.942267 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8 podName:89de84f2-65dd-436e-b1e9-42eafeb58dde nodeName:}" failed. No retries permitted until 2026-07-20 18:14:31.942252725 +0000 UTC m=+66.262411056 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw8w8" (UniqueName: "kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8") pod "network-check-target-t76r8" (UID: "89de84f2-65dd-436e-b1e9-42eafeb58dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 18:14:00.266886 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:00.266856 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:14:00.267058 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:00.266855 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:14:00.267058 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:00.266969 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:14:00.267058 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:00.266999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:14:00.267212 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:00.267071 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:14:00.267212 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:00.267130 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:14:00.556591 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:00.556514 2576 generic.go:356] "Generic (PLEG): container finished" podID="09254229-a029-4b42-8634-cc3a565e811c" containerID="86c3956adc04438ecb1e12ba3a92a494701d49eabfcffeff0bd26f27ef583e12" exitCode=0 Jul 20 18:14:00.556591 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:00.556565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" event={"ID":"09254229-a029-4b42-8634-cc3a565e811c","Type":"ContainerDied","Data":"86c3956adc04438ecb1e12ba3a92a494701d49eabfcffeff0bd26f27ef583e12"} Jul 20 18:14:02.267195 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:02.267159 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:14:02.267195 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:02.267190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:14:02.267195 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:02.267159 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:14:02.267734 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:02.267289 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t76r8" podUID="89de84f2-65dd-436e-b1e9-42eafeb58dde" Jul 20 18:14:02.267734 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:02.267325 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skln6" podUID="20a22dbd-217f-4cc6-af47-37c63f7e968d" Jul 20 18:14:02.267734 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:02.267452 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:14:03.036972 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.036890 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-149.ec2.internal" event="NodeReady" Jul 20 18:14:03.037204 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.037060 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 18:14:03.080508 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.080467 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6k5pv"] Jul 20 18:14:03.082474 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.082451 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.085858 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.084931 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bqnvm"] Jul 20 18:14:03.085858 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.085461 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wr2zv\"" Jul 20 18:14:03.085858 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.085708 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 18:14:03.085858 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.085767 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 18:14:03.088334 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.088313 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bqnvm" Jul 20 18:14:03.090428 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.090410 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9f5rk\"" Jul 20 18:14:03.090539 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.090484 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 18:14:03.090615 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.090594 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 18:14:03.090735 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.090720 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 18:14:03.092491 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.092472 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6k5pv"] Jul 20 18:14:03.096121 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.095831 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bqnvm"] Jul 20 18:14:03.167901 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.167865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e95e9429-310d-44da-81d5-e279fe4a7089-config-volume\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.167901 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.167904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.168121 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.167952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47mtl\" (UniqueName: \"kubernetes.io/projected/0814f23d-fa95-4083-9bc6-9a037644dd2a-kube-api-access-47mtl\") pod \"ingress-canary-bqnvm\" (UID: \"0814f23d-fa95-4083-9bc6-9a037644dd2a\") " pod="openshift-ingress-canary/ingress-canary-bqnvm" Jul 20 18:14:03.168121 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.168072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2jz4\" (UniqueName: \"kubernetes.io/projected/e95e9429-310d-44da-81d5-e279fe4a7089-kube-api-access-f2jz4\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.168213 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.168152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0814f23d-fa95-4083-9bc6-9a037644dd2a-cert\") pod \"ingress-canary-bqnvm\" (UID: \"0814f23d-fa95-4083-9bc6-9a037644dd2a\") " pod="openshift-ingress-canary/ingress-canary-bqnvm" Jul 20 18:14:03.168213 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.168197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95e9429-310d-44da-81d5-e279fe4a7089-tmp-dir\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.269147 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.269102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2jz4\" (UniqueName: \"kubernetes.io/projected/e95e9429-310d-44da-81d5-e279fe4a7089-kube-api-access-f2jz4\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.269623 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.269176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0814f23d-fa95-4083-9bc6-9a037644dd2a-cert\") pod \"ingress-canary-bqnvm\" (UID: \"0814f23d-fa95-4083-9bc6-9a037644dd2a\") " pod="openshift-ingress-canary/ingress-canary-bqnvm" Jul 20 18:14:03.269623 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.269212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95e9429-310d-44da-81d5-e279fe4a7089-tmp-dir\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.269623 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.269251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e95e9429-310d-44da-81d5-e279fe4a7089-config-volume\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.269623 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.269305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.269623 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.269373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47mtl\" (UniqueName: \"kubernetes.io/projected/0814f23d-fa95-4083-9bc6-9a037644dd2a-kube-api-access-47mtl\") pod \"ingress-canary-bqnvm\" (UID: \"0814f23d-fa95-4083-9bc6-9a037644dd2a\") " pod="openshift-ingress-canary/ingress-canary-bqnvm" Jul 20 18:14:03.269623 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:03.269541 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 18:14:03.269623 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.269572 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95e9429-310d-44da-81d5-e279fe4a7089-tmp-dir\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.269623 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:03.269601 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls podName:e95e9429-310d-44da-81d5-e279fe4a7089 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:03.769581997 +0000 UTC m=+38.089740295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls") pod "dns-default-6k5pv" (UID: "e95e9429-310d-44da-81d5-e279fe4a7089") : secret "dns-default-metrics-tls" not found Jul 20 18:14:03.270082 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.269878 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e95e9429-310d-44da-81d5-e279fe4a7089-config-volume\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.273976 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.273955 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0814f23d-fa95-4083-9bc6-9a037644dd2a-cert\") pod \"ingress-canary-bqnvm\" (UID: \"0814f23d-fa95-4083-9bc6-9a037644dd2a\") " pod="openshift-ingress-canary/ingress-canary-bqnvm" Jul 20 18:14:03.278375 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.278017 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47mtl\" (UniqueName: \"kubernetes.io/projected/0814f23d-fa95-4083-9bc6-9a037644dd2a-kube-api-access-47mtl\") pod \"ingress-canary-bqnvm\" (UID: \"0814f23d-fa95-4083-9bc6-9a037644dd2a\") " pod="openshift-ingress-canary/ingress-canary-bqnvm" Jul 20 18:14:03.278375 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.278178 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2jz4\" (UniqueName: \"kubernetes.io/projected/e95e9429-310d-44da-81d5-e279fe4a7089-kube-api-access-f2jz4\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.405522 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.405484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bqnvm" Jul 20 18:14:03.772418 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:03.772324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:03.772583 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:03.772476 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 18:14:03.772583 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:03.772563 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls podName:e95e9429-310d-44da-81d5-e279fe4a7089 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:04.772538142 +0000 UTC m=+39.092696451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls") pod "dns-default-6k5pv" (UID: "e95e9429-310d-44da-81d5-e279fe4a7089") : secret "dns-default-metrics-tls" not found Jul 20 18:14:04.267237 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.267124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:14:04.267237 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.267131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:14:04.267487 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.267270 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:14:04.271390 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.271368 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 18:14:04.272013 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.271399 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 18:14:04.272013 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.271419 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 18:14:04.272013 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.271462 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ls8qp\"" Jul 20 18:14:04.272013 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.271501 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 18:14:04.272013 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.271463 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7qbr\"" Jul 20 18:14:04.549313 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.549163 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bqnvm"] Jul 20 18:14:04.552784 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:14:04.552756 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0814f23d_fa95_4083_9bc6_9a037644dd2a.slice/crio-229d863f66c6234db9fdec4aa52bfe2a0cc5d52e2e59a7438260939ea8eeed85 WatchSource:0}: Error finding container 229d863f66c6234db9fdec4aa52bfe2a0cc5d52e2e59a7438260939ea8eeed85: Status 404 returned error can't find the container with id 229d863f66c6234db9fdec4aa52bfe2a0cc5d52e2e59a7438260939ea8eeed85 Jul 20 18:14:04.567595 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.567571 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bqnvm" event={"ID":"0814f23d-fa95-4083-9bc6-9a037644dd2a","Type":"ContainerStarted","Data":"229d863f66c6234db9fdec4aa52bfe2a0cc5d52e2e59a7438260939ea8eeed85"} Jul 20 18:14:04.570235 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.570213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" event={"ID":"09254229-a029-4b42-8634-cc3a565e811c","Type":"ContainerStarted","Data":"c915884540ce21157c675238246c2964d7eb0219ec639f9ca06e4d742769e75a"} Jul 20 18:14:04.780483 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:04.780409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:04.780594 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:04.780563 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 18:14:04.780659 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:04.780633 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls podName:e95e9429-310d-44da-81d5-e279fe4a7089 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:06.780617917 +0000 UTC m=+41.100776214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls") pod "dns-default-6k5pv" (UID: "e95e9429-310d-44da-81d5-e279fe4a7089") : secret "dns-default-metrics-tls" not found Jul 20 18:14:05.575851 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:05.575815 2576 generic.go:356] "Generic (PLEG): container finished" podID="09254229-a029-4b42-8634-cc3a565e811c" containerID="c915884540ce21157c675238246c2964d7eb0219ec639f9ca06e4d742769e75a" exitCode=0 Jul 20 18:14:05.576408 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:05.575899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" event={"ID":"09254229-a029-4b42-8634-cc3a565e811c","Type":"ContainerDied","Data":"c915884540ce21157c675238246c2964d7eb0219ec639f9ca06e4d742769e75a"} Jul 20 18:14:06.582754 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:06.582669 2576 generic.go:356] "Generic (PLEG): container finished" podID="09254229-a029-4b42-8634-cc3a565e811c" containerID="851e2e9516ad448635ea5dbfdd81f581e5f1bbb1f293d4df1992d615aa90ff37" exitCode=0 Jul 20 18:14:06.583143 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:06.582753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" event={"ID":"09254229-a029-4b42-8634-cc3a565e811c","Type":"ContainerDied","Data":"851e2e9516ad448635ea5dbfdd81f581e5f1bbb1f293d4df1992d615aa90ff37"} Jul 20 18:14:06.798355 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:06.798327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:06.798465 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:06.798454 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 18:14:06.798528 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:06.798516 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls podName:e95e9429-310d-44da-81d5-e279fe4a7089 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:10.798495761 +0000 UTC m=+45.118654072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls") pod "dns-default-6k5pv" (UID: "e95e9429-310d-44da-81d5-e279fe4a7089") : secret "dns-default-metrics-tls" not found Jul 20 18:14:07.003590 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.003557 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2"] Jul 20 18:14:07.019321 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.019299 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2"] Jul 20 18:14:07.019408 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.019383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.022069 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.022047 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 20 18:14:07.022069 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.022064 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 20 18:14:07.022219 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.022046 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 20 18:14:07.022219 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.022047 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 20 18:14:07.022455 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.022442 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 20 18:14:07.022655 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.022618 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 20 18:14:07.022767 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.022728 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 20 18:14:07.200725 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.200687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/717a8ca7-0db8-43c6-8492-11b872d54cc0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.200725 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.200723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.200964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.200761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.200964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.200798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-hub\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.200964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.200898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svqtc\" (UniqueName: \"kubernetes.io/projected/717a8ca7-0db8-43c6-8492-11b872d54cc0-kube-api-access-svqtc\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.200964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.200925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-ca\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.301740 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.301629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-ca\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.301740 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.301735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/717a8ca7-0db8-43c6-8492-11b872d54cc0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.301902 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.301759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.301902 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.301801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.301902 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.301830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-hub\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.302014 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.301908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svqtc\" (UniqueName: \"kubernetes.io/projected/717a8ca7-0db8-43c6-8492-11b872d54cc0-kube-api-access-svqtc\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.302462 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.302432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/717a8ca7-0db8-43c6-8492-11b872d54cc0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.305310 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.305280 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-ca\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.305396 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.305313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.305396 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.305340 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.305493 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.305471 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/717a8ca7-0db8-43c6-8492-11b872d54cc0-hub\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.308963 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.308943 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svqtc\" (UniqueName: \"kubernetes.io/projected/717a8ca7-0db8-43c6-8492-11b872d54cc0-kube-api-access-svqtc\") pod \"cluster-proxy-proxy-agent-684d978f77-c6gk2\" (UID: \"717a8ca7-0db8-43c6-8492-11b872d54cc0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.339931 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.339908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:14:07.473673 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.473632 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2"] Jul 20 18:14:07.476655 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:14:07.476612 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod717a8ca7_0db8_43c6_8492_11b872d54cc0.slice/crio-3f6184983aa8ecbbf98b168f71ead691fe7688ad853a0cbc4e2242f012da23c4 WatchSource:0}: Error finding container 3f6184983aa8ecbbf98b168f71ead691fe7688ad853a0cbc4e2242f012da23c4: Status 404 returned error can't find the container with id 3f6184983aa8ecbbf98b168f71ead691fe7688ad853a0cbc4e2242f012da23c4 Jul 20 18:14:07.588464 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.588396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" event={"ID":"09254229-a029-4b42-8634-cc3a565e811c","Type":"ContainerStarted","Data":"2877f006e552e3d6ea5687c9177c2fa8476aa69bc168a6e9476aa62ae05c8ed9"} Jul 20 18:14:07.589621 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.589600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" event={"ID":"717a8ca7-0db8-43c6-8492-11b872d54cc0","Type":"ContainerStarted","Data":"3f6184983aa8ecbbf98b168f71ead691fe7688ad853a0cbc4e2242f012da23c4"} Jul 20 18:14:07.590988 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.590971 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bqnvm" event={"ID":"0814f23d-fa95-4083-9bc6-9a037644dd2a","Type":"ContainerStarted","Data":"e0b73193cac327b610fe82d630419de112e1f38112ba0cd23e9917af9d76b20b"} Jul 20 18:14:07.610114 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.610073 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cb5xn" podStartSLOduration=9.959804459 podStartE2EDuration="41.610060209s" totalImagesPullingTime="31.65025575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:14:07.609676894 +0000 UTC m=+41.929835214" watchObservedRunningTime="2026-07-20 18:14:07.610060209 +0000 UTC m=+41.930218570" Jul 20 18:14:07.625743 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:07.625698 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bqnvm" podStartSLOduration=2.171603954 podStartE2EDuration="4.625686469s" totalImagesPullingTime="2.454082515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:14:07.625501794 +0000 UTC m=+41.945660115" watchObservedRunningTime="2026-07-20 18:14:07.625686469 +0000 UTC m=+41.945844786" Jul 20 18:14:10.826850 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:10.826804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:10.827257 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:10.826939 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 18:14:10.827257 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:10.827021 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls podName:e95e9429-310d-44da-81d5-e279fe4a7089 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:18.826998555 +0000 UTC m=+53.147156853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls") pod "dns-default-6k5pv" (UID: "e95e9429-310d-44da-81d5-e279fe4a7089") : secret "dns-default-metrics-tls" not found Jul 20 18:14:13.608574 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:13.608544 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" event={"ID":"717a8ca7-0db8-43c6-8492-11b872d54cc0","Type":"ContainerStarted","Data":"d5992c255986f88d3a55b99026d530376486e3d3084583c18bb19533884db27f"} Jul 20 18:14:14.612650 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:14.612601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" event={"ID":"717a8ca7-0db8-43c6-8492-11b872d54cc0","Type":"ContainerStarted","Data":"1909f8b82dab42e6673d5f9d9680705629df16301b1d3ca57c08f31dc09c848d"} Jul 20 18:14:14.612650 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:14.612657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" event={"ID":"717a8ca7-0db8-43c6-8492-11b872d54cc0","Type":"ContainerStarted","Data":"a15461d34a51cd384cafb31563c02acc9da9ee155d262faeeb013025d4cf96d2"} Jul 20 18:14:14.630629 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:14.630582 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" podStartSLOduration=2.629597122 podStartE2EDuration="8.630569184s" totalImagesPullingTime="6.000972062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:14:14.629386866 +0000 UTC m=+48.949545199" watchObservedRunningTime="2026-07-20 18:14:14.630569184 +0000 UTC m=+48.950727505" Jul 20 18:14:18.879763 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:18.879728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:18.880205 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:18.879840 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 18:14:18.880205 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:18.879892 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls podName:e95e9429-310d-44da-81d5-e279fe4a7089 nodeName:}" failed. No retries permitted until 2026-07-20 18:14:34.879878297 +0000 UTC m=+69.200036595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls") pod "dns-default-6k5pv" (UID: "e95e9429-310d-44da-81d5-e279fe4a7089") : secret "dns-default-metrics-tls" not found Jul 20 18:14:28.566308 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:28.566281 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qz2b5" Jul 20 18:14:31.869171 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:31.869133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:14:31.871833 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:31.871817 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 18:14:31.882135 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:31.882112 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20a22dbd-217f-4cc6-af47-37c63f7e968d-original-pull-secret\") pod \"global-pull-secret-syncer-skln6\" (UID: \"20a22dbd-217f-4cc6-af47-37c63f7e968d\") " pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:14:31.890123 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:31.890106 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skln6" Jul 20 18:14:31.970141 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:31.970106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8w8\" (UniqueName: \"kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8\") pod \"network-check-target-t76r8\" (UID: \"89de84f2-65dd-436e-b1e9-42eafeb58dde\") " pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:14:31.970311 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:31.970162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:14:31.972728 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:31.972707 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 18:14:31.972948 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:31.972930 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 18:14:31.981009 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:31.980981 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 18:14:31.981117 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:31.981080 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs podName:1c37edf7-0b78-44c5-8223-de838b9908dd nodeName:}" failed. No retries permitted until 2026-07-20 18:15:35.9810562 +0000 UTC m=+130.301214513 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs") pod "network-metrics-daemon-cmnwz" (UID: "1c37edf7-0b78-44c5-8223-de838b9908dd") : secret "metrics-daemon-secret" not found Jul 20 18:14:31.983437 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:31.983415 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 18:14:31.994081 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:31.994057 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw8w8\" (UniqueName: \"kubernetes.io/projected/89de84f2-65dd-436e-b1e9-42eafeb58dde-kube-api-access-vw8w8\") pod \"network-check-target-t76r8\" (UID: \"89de84f2-65dd-436e-b1e9-42eafeb58dde\") " pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:14:32.018884 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:32.018862 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-skln6"] Jul 20 18:14:32.021713 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:14:32.021693 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a22dbd_217f_4cc6_af47_37c63f7e968d.slice/crio-5d84b50c684e30d40bf418239c3def9623c7583b5f8ec9dae9071b652d183615 WatchSource:0}: Error finding container 5d84b50c684e30d40bf418239c3def9623c7583b5f8ec9dae9071b652d183615: Status 404 returned error can't find the container with id 5d84b50c684e30d40bf418239c3def9623c7583b5f8ec9dae9071b652d183615 Jul 20 18:14:32.180830 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:32.180776 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ls8qp\"" Jul 20 18:14:32.188988 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:32.188969 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:14:32.304903 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:32.304869 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t76r8"] Jul 20 18:14:32.308565 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:14:32.308540 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89de84f2_65dd_436e_b1e9_42eafeb58dde.slice/crio-735c2a918a09fb112754dc6dc8e635c23e53f642adbcca33f2b4cfe4910f44e2 WatchSource:0}: Error finding container 735c2a918a09fb112754dc6dc8e635c23e53f642adbcca33f2b4cfe4910f44e2: Status 404 returned error can't find the container with id 735c2a918a09fb112754dc6dc8e635c23e53f642adbcca33f2b4cfe4910f44e2 Jul 20 18:14:32.655212 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:32.655172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t76r8" event={"ID":"89de84f2-65dd-436e-b1e9-42eafeb58dde","Type":"ContainerStarted","Data":"735c2a918a09fb112754dc6dc8e635c23e53f642adbcca33f2b4cfe4910f44e2"} Jul 20 18:14:32.656352 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:32.656323 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-skln6" event={"ID":"20a22dbd-217f-4cc6-af47-37c63f7e968d","Type":"ContainerStarted","Data":"5d84b50c684e30d40bf418239c3def9623c7583b5f8ec9dae9071b652d183615"} Jul 20 18:14:34.891286 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:34.891249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:14:34.891749 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:34.891407 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 18:14:34.891749 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:14:34.891469 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls podName:e95e9429-310d-44da-81d5-e279fe4a7089 nodeName:}" failed. No retries permitted until 2026-07-20 18:15:06.891452042 +0000 UTC m=+101.211610341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls") pod "dns-default-6k5pv" (UID: "e95e9429-310d-44da-81d5-e279fe4a7089") : secret "dns-default-metrics-tls" not found Jul 20 18:14:37.670840 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:37.670805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t76r8" event={"ID":"89de84f2-65dd-436e-b1e9-42eafeb58dde","Type":"ContainerStarted","Data":"d28ef093897148feba4f5f00bd003fc6025b0d4ef935a448fc91fc6d6c5f45a6"} Jul 20 18:14:37.671339 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:37.670961 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:14:37.672246 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:37.672220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-skln6" event={"ID":"20a22dbd-217f-4cc6-af47-37c63f7e968d","Type":"ContainerStarted","Data":"122d0967a9b0241410cea61110ec625aec4dbd3f6fd350d84eaa7098296a1fb7"} Jul 20 18:14:37.686736 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:37.686692 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t76r8" podStartSLOduration=67.145439813 podStartE2EDuration="1m11.686679473s" totalImagesPullingTime="4.54123966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:14:37.686154286 +0000 UTC m=+72.006312631" watchObservedRunningTime="2026-07-20 18:14:37.686679473 +0000 UTC m=+72.006837784" Jul 20 18:14:37.700495 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:14:37.700455 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-skln6" podStartSLOduration=66.859491961 podStartE2EDuration="1m11.700442633s" totalImagesPullingTime="4.840950672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:14:37.69977319 +0000 UTC m=+72.019931511" watchObservedRunningTime="2026-07-20 18:14:37.700442633 +0000 UTC m=+72.020600953" Jul 20 18:15:06.891657 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:15:06.891609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:15:06.892079 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:15:06.891755 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 18:15:06.892079 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:15:06.891829 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls podName:e95e9429-310d-44da-81d5-e279fe4a7089 nodeName:}" failed. No retries permitted until 2026-07-20 18:16:10.891813196 +0000 UTC m=+165.211971494 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls") pod "dns-default-6k5pv" (UID: "e95e9429-310d-44da-81d5-e279fe4a7089") : secret "dns-default-metrics-tls" not found Jul 20 18:15:08.678367 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:15:08.678334 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t76r8" Jul 20 18:15:36.077733 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:15:36.077688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:15:36.078133 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:15:36.077817 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 18:15:36.078133 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:15:36.077880 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs podName:1c37edf7-0b78-44c5-8223-de838b9908dd nodeName:}" failed. No retries permitted until 2026-07-20 18:17:38.077865197 +0000 UTC m=+252.398023495 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs") pod "network-metrics-daemon-cmnwz" (UID: "1c37edf7-0b78-44c5-8223-de838b9908dd") : secret "metrics-daemon-secret" not found Jul 20 18:16:06.098802 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:16:06.098767 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6k5pv" podUID="e95e9429-310d-44da-81d5-e279fe4a7089" Jul 20 18:16:06.925845 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:16:06.925811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6k5pv" Jul 20 18:16:07.285665 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:16:07.285568 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:16:10.914607 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:16:10.914575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:16:10.914982 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:16:10.914706 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 18:16:10.914982 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:16:10.914758 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls podName:e95e9429-310d-44da-81d5-e279fe4a7089 nodeName:}" failed. No retries permitted until 2026-07-20 18:18:12.914744709 +0000 UTC m=+287.234903007 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls") pod "dns-default-6k5pv" (UID: "e95e9429-310d-44da-81d5-e279fe4a7089") : secret "dns-default-metrics-tls" not found Jul 20 18:16:18.266459 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:16:18.266432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:17:23.850527 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.850494 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-25lbl"] Jul 20 18:17:23.852478 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.852462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:23.855633 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.855609 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 18:17:23.856129 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.856093 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 18:17:23.856340 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.856320 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-928kt\"" Jul 20 18:17:23.856861 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.856845 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 18:17:23.856918 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.856903 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 18:17:23.869242 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.869220 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-25lbl"] Jul 20 18:17:23.977612 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.977587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e6ce038-b497-4b88-96f1-fea20a09980f-crio-socket\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:23.977762 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.977618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:23.977762 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.977658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:23.977762 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.977736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e6ce038-b497-4b88-96f1-fea20a09980f-data-volume\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:23.977872 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:23.977762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6q2c\" (UniqueName: \"kubernetes.io/projected/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-api-access-z6q2c\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.078314 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:24.078273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e6ce038-b497-4b88-96f1-fea20a09980f-crio-socket\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.078314 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:24.078320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.078460 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:24.078393 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 18:17:24.078460 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:24.078414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.078521 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:24.078469 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:24.578450299 +0000 UTC m=+238.898608621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : configmap "kube-rbac-proxy" not found Jul 20 18:17:24.078521 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:24.078394 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e6ce038-b497-4b88-96f1-fea20a09980f-crio-socket\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.078521 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:24.078501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e6ce038-b497-4b88-96f1-fea20a09980f-data-volume\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.078618 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:24.078518 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 18:17:24.078618 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:24.078535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6q2c\" (UniqueName: \"kubernetes.io/projected/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-api-access-z6q2c\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.078618 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:24.078579 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:24.578566725 +0000 UTC m=+238.898725027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : secret "insights-runtime-extractor-tls" not found Jul 20 18:17:24.078812 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:24.078796 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e6ce038-b497-4b88-96f1-fea20a09980f-data-volume\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.088232 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:24.088213 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6q2c\" (UniqueName: \"kubernetes.io/projected/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-api-access-z6q2c\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.582492 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:24.582454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.582492 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:24.582493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:24.582691 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:24.582586 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 18:17:24.582691 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:24.582598 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 18:17:24.582691 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:24.582671 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:25.582636015 +0000 UTC m=+239.902794317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : configmap "kube-rbac-proxy" not found Jul 20 18:17:24.582691 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:24.582687 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:25.582681009 +0000 UTC m=+239.902839310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : secret "insights-runtime-extractor-tls" not found Jul 20 18:17:25.590943 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:25.590909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:25.590943 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:25.590945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:25.591315 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:25.591029 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 18:17:25.591315 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:25.591058 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 18:17:25.591315 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:25.591096 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:27.591076705 +0000 UTC m=+241.911235018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : configmap "kube-rbac-proxy" not found Jul 20 18:17:25.591315 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:25.591110 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:27.591103857 +0000 UTC m=+241.911262159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : secret "insights-runtime-extractor-tls" not found Jul 20 18:17:26.838848 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:26.838822 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h2htm_2549c6b2-1753-461c-b823-8db9cc671d86/dns-node-resolver/0.log" Jul 20 18:17:27.438393 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.438368 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-97dml_2a522f41-ca65-459c-824e-ece681eb3413/node-ca/0.log" Jul 20 18:17:27.605938 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.605896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:27.605938 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.605942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:27.606133 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:27.606018 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 18:17:27.606133 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:27.606041 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 18:17:27.606133 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:27.606080 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:31.60606454 +0000 UTC m=+245.926222838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : configmap "kube-rbac-proxy" not found Jul 20 18:17:27.606133 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:27.606095 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:31.606087713 +0000 UTC m=+245.926246011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : secret "insights-runtime-extractor-tls" not found Jul 20 18:17:27.957991 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.957960 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gttjj"] Jul 20 18:17:27.960017 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.960001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:27.962385 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.962358 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 20 18:17:27.962513 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.962362 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 20 18:17:27.962513 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.962433 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 20 18:17:27.963277 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.963258 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 20 18:17:27.963393 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.963327 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pb25l\"" Jul 20 18:17:27.968733 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:27.968713 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gttjj"] Jul 20 18:17:28.009072 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.009052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8d4cdc24-d0f5-4f5c-9688-f8890a3f2261-signing-cabundle\") pod \"service-ca-58598695f7-gttjj\" (UID: \"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261\") " pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:28.009170 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.009094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8d4cdc24-d0f5-4f5c-9688-f8890a3f2261-signing-key\") pod \"service-ca-58598695f7-gttjj\" (UID: \"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261\") " pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:28.009170 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.009116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97rwt\" (UniqueName: \"kubernetes.io/projected/8d4cdc24-d0f5-4f5c-9688-f8890a3f2261-kube-api-access-97rwt\") pod \"service-ca-58598695f7-gttjj\" (UID: \"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261\") " pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:28.109898 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.109863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8d4cdc24-d0f5-4f5c-9688-f8890a3f2261-signing-cabundle\") pod \"service-ca-58598695f7-gttjj\" (UID: \"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261\") " pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:28.110038 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.109918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8d4cdc24-d0f5-4f5c-9688-f8890a3f2261-signing-key\") pod \"service-ca-58598695f7-gttjj\" (UID: \"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261\") " pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:28.110038 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.109935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97rwt\" (UniqueName: \"kubernetes.io/projected/8d4cdc24-d0f5-4f5c-9688-f8890a3f2261-kube-api-access-97rwt\") pod \"service-ca-58598695f7-gttjj\" (UID: \"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261\") " pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:28.110549 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.110524 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8d4cdc24-d0f5-4f5c-9688-f8890a3f2261-signing-cabundle\") pod \"service-ca-58598695f7-gttjj\" (UID: \"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261\") " pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:28.112206 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.112189 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8d4cdc24-d0f5-4f5c-9688-f8890a3f2261-signing-key\") pod \"service-ca-58598695f7-gttjj\" (UID: \"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261\") " pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:28.117827 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.117803 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97rwt\" (UniqueName: \"kubernetes.io/projected/8d4cdc24-d0f5-4f5c-9688-f8890a3f2261-kube-api-access-97rwt\") pod \"service-ca-58598695f7-gttjj\" (UID: \"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261\") " pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:28.268179 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.268125 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gttjj" Jul 20 18:17:28.383591 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.383563 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gttjj"] Jul 20 18:17:28.386812 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:17:28.386781 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d4cdc24_d0f5_4f5c_9688_f8890a3f2261.slice/crio-a58e62be2126b42ee76beef991dc4ded0118b4ff86e25f28d81df8f66a5ddd8d WatchSource:0}: Error finding container a58e62be2126b42ee76beef991dc4ded0118b4ff86e25f28d81df8f66a5ddd8d: Status 404 returned error can't find the container with id a58e62be2126b42ee76beef991dc4ded0118b4ff86e25f28d81df8f66a5ddd8d Jul 20 18:17:28.437897 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:28.437873 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bqnvm_0814f23d-fa95-4083-9bc6-9a037644dd2a/serve-healthcheck-canary/0.log" Jul 20 18:17:29.153879 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:29.153841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gttjj" event={"ID":"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261","Type":"ContainerStarted","Data":"a58e62be2126b42ee76beef991dc4ded0118b4ff86e25f28d81df8f66a5ddd8d"} Jul 20 18:17:31.161722 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:31.161685 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gttjj" event={"ID":"8d4cdc24-d0f5-4f5c-9688-f8890a3f2261","Type":"ContainerStarted","Data":"eeac8ed7a0e95471ff3e1f9cf8e78490513f19f6ed363a3cb64e408f89f94c83"} Jul 20 18:17:31.180178 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:31.180136 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-gttjj" podStartSLOduration=2.338176043 podStartE2EDuration="4.180120675s" totalImagesPullingTime="1.841944632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:31.17931686 +0000 UTC m=+245.499475176" watchObservedRunningTime="2026-07-20 18:17:31.180120675 +0000 UTC m=+245.500278994" Jul 20 18:17:31.637958 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:31.637920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:31.638152 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:31.638034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:31.638152 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:31.638080 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 18:17:31.638152 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:31.638109 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 18:17:31.638152 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:31.638152 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:39.63813152 +0000 UTC m=+253.958289822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : secret "insights-runtime-extractor-tls" not found Jul 20 18:17:31.638365 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:31.638171 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:39.638161941 +0000 UTC m=+253.958320245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : configmap "kube-rbac-proxy" not found Jul 20 18:17:38.079348 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:38.079307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:17:38.079787 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:38.079436 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 18:17:38.079787 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:38.079488 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs podName:1c37edf7-0b78-44c5-8223-de838b9908dd nodeName:}" failed. No retries permitted until 2026-07-20 18:19:40.079474321 +0000 UTC m=+374.399632619 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs") pod "network-metrics-daemon-cmnwz" (UID: "1c37edf7-0b78-44c5-8223-de838b9908dd") : secret "metrics-daemon-secret" not found Jul 20 18:17:39.690813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:39.690776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:39.691249 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:39.690819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:39.691249 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:39.690951 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 18:17:39.691249 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:17:39.691021 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls podName:4e6ce038-b497-4b88-96f1-fea20a09980f nodeName:}" failed. No retries permitted until 2026-07-20 18:17:55.69100288 +0000 UTC m=+270.011161178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25lbl" (UID: "4e6ce038-b497-4b88-96f1-fea20a09980f") : secret "insights-runtime-extractor-tls" not found Jul 20 18:17:39.691406 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:39.691264 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e6ce038-b497-4b88-96f1-fea20a09980f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:51.300613 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.300523 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cb4f7cc99-nfbss"] Jul 20 18:17:51.302488 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.302466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.305658 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.305624 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 18:17:51.306617 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.306597 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 18:17:51.306693 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.306613 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pzczt\"" Jul 20 18:17:51.306740 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.306718 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 18:17:51.311601 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.311581 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 18:17:51.317213 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.317193 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb4f7cc99-nfbss"] Jul 20 18:17:51.373726 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.373699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03680bf7-dc2a-4668-86a7-9dead0431124-registry-certificates\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.373854 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.373733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03680bf7-dc2a-4668-86a7-9dead0431124-registry-tls\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.373854 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.373760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03680bf7-dc2a-4668-86a7-9dead0431124-image-registry-private-configuration\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.373948 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.373859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwbq7\" (UniqueName: \"kubernetes.io/projected/03680bf7-dc2a-4668-86a7-9dead0431124-kube-api-access-lwbq7\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.373948 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.373887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03680bf7-dc2a-4668-86a7-9dead0431124-bound-sa-token\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.373948 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.373928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03680bf7-dc2a-4668-86a7-9dead0431124-ca-trust-extracted\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.373948 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.373944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03680bf7-dc2a-4668-86a7-9dead0431124-installation-pull-secrets\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.374070 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.373999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03680bf7-dc2a-4668-86a7-9dead0431124-trusted-ca\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.474844 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.474808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03680bf7-dc2a-4668-86a7-9dead0431124-trusted-ca\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.475004 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.474855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03680bf7-dc2a-4668-86a7-9dead0431124-registry-certificates\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.475004 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.474873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03680bf7-dc2a-4668-86a7-9dead0431124-registry-tls\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.475004 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.474898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03680bf7-dc2a-4668-86a7-9dead0431124-image-registry-private-configuration\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.475004 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.474948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwbq7\" (UniqueName: \"kubernetes.io/projected/03680bf7-dc2a-4668-86a7-9dead0431124-kube-api-access-lwbq7\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.475004 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.474977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03680bf7-dc2a-4668-86a7-9dead0431124-bound-sa-token\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.475289 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.475025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03680bf7-dc2a-4668-86a7-9dead0431124-ca-trust-extracted\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.475289 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.475040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03680bf7-dc2a-4668-86a7-9dead0431124-installation-pull-secrets\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.475786 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.475703 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03680bf7-dc2a-4668-86a7-9dead0431124-ca-trust-extracted\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.475786 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.475769 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03680bf7-dc2a-4668-86a7-9dead0431124-registry-certificates\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.475966 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.475883 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03680bf7-dc2a-4668-86a7-9dead0431124-trusted-ca\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.477440 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.477413 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03680bf7-dc2a-4668-86a7-9dead0431124-installation-pull-secrets\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.477872 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.477852 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03680bf7-dc2a-4668-86a7-9dead0431124-registry-tls\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.477872 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.477867 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03680bf7-dc2a-4668-86a7-9dead0431124-image-registry-private-configuration\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.486526 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.486505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwbq7\" (UniqueName: \"kubernetes.io/projected/03680bf7-dc2a-4668-86a7-9dead0431124-kube-api-access-lwbq7\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.487275 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.487257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03680bf7-dc2a-4668-86a7-9dead0431124-bound-sa-token\") pod \"image-registry-5cb4f7cc99-nfbss\" (UID: \"03680bf7-dc2a-4668-86a7-9dead0431124\") " pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.610790 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.610763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:51.743737 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:51.743707 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb4f7cc99-nfbss"] Jul 20 18:17:51.746489 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:17:51.746457 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03680bf7_dc2a_4668_86a7_9dead0431124.slice/crio-c19f328df859768371a5f779858ef8e94eaa5c24f7fc97c15fc99b585d05192f WatchSource:0}: Error finding container c19f328df859768371a5f779858ef8e94eaa5c24f7fc97c15fc99b585d05192f: Status 404 returned error can't find the container with id c19f328df859768371a5f779858ef8e94eaa5c24f7fc97c15fc99b585d05192f Jul 20 18:17:52.221451 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:52.221416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" event={"ID":"03680bf7-dc2a-4668-86a7-9dead0431124","Type":"ContainerStarted","Data":"44da87b9f28dbf8a0a83d561b2ba1dccc729a6c5999968c2214798db45e84dc0"} Jul 20 18:17:52.221606 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:52.221471 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" event={"ID":"03680bf7-dc2a-4668-86a7-9dead0431124","Type":"ContainerStarted","Data":"c19f328df859768371a5f779858ef8e94eaa5c24f7fc97c15fc99b585d05192f"} Jul 20 18:17:52.221606 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:52.221544 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:17:52.242818 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:52.242772 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" podStartSLOduration=1.242756394 podStartE2EDuration="1.242756394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:17:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:17:52.241669729 +0000 UTC m=+266.561828043" watchObservedRunningTime="2026-07-20 18:17:52.242756394 +0000 UTC m=+266.562914713" Jul 20 18:17:55.706320 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:55.706292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:55.708467 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:55.708443 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e6ce038-b497-4b88-96f1-fea20a09980f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25lbl\" (UID: \"4e6ce038-b497-4b88-96f1-fea20a09980f\") " pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:55.965055 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:55.964982 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-928kt\"" Jul 20 18:17:55.972655 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:55.972621 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-25lbl" Jul 20 18:17:56.112728 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:56.112700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-25lbl"] Jul 20 18:17:56.115483 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:17:56.115454 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6ce038_b497_4b88_96f1_fea20a09980f.slice/crio-468ac19991d30773feb8ab398607d65d1cbd5673d86645c54d469081cd674e64 WatchSource:0}: Error finding container 468ac19991d30773feb8ab398607d65d1cbd5673d86645c54d469081cd674e64: Status 404 returned error can't find the container with id 468ac19991d30773feb8ab398607d65d1cbd5673d86645c54d469081cd674e64 Jul 20 18:17:56.234686 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:17:56.234618 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25lbl" event={"ID":"4e6ce038-b497-4b88-96f1-fea20a09980f","Type":"ContainerStarted","Data":"468ac19991d30773feb8ab398607d65d1cbd5673d86645c54d469081cd674e64"} Jul 20 18:18:01.252968 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:01.252936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25lbl" event={"ID":"4e6ce038-b497-4b88-96f1-fea20a09980f","Type":"ContainerStarted","Data":"e9ffcfe13694c3fb1870d64c550821c6ed0098f20dd9827ac1199c656e0011ed"} Jul 20 18:18:06.273091 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.273054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25lbl" event={"ID":"4e6ce038-b497-4b88-96f1-fea20a09980f","Type":"ContainerStarted","Data":"53b6438c60938e24cdeddea4782ca014fec9aef42864088227fb78c0ec1d984c"} Jul 20 18:18:06.376425 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.376399 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn"] Jul 20 18:18:06.379584 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.379565 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.384059 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.384036 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 20 18:18:06.384181 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.384039 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 18:18:06.384314 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.384261 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 18:18:06.384314 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.384270 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qfcmv\"" Jul 20 18:18:06.384490 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.384350 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 20 18:18:06.384490 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.384402 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 18:18:06.398394 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.398371 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn"] Jul 20 18:18:06.410808 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.410784 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wcr5j"] Jul 20 18:18:06.413850 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.413834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.416832 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.416811 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 18:18:06.416832 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.416827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5lp4n\"" Jul 20 18:18:06.417422 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.417406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 18:18:06.417635 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.417502 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 18:18:06.490961 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.490937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ea8933a-21da-4900-afed-0344bbec3d27-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.491107 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.490968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ea8933a-21da-4900-afed-0344bbec3d27-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.491107 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.490990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ea8933a-21da-4900-afed-0344bbec3d27-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.491180 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.491114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gvx4\" (UniqueName: \"kubernetes.io/projected/0ea8933a-21da-4900-afed-0344bbec3d27-kube-api-access-9gvx4\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.592388 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a318926c-317c-449d-8697-4258387b6430-node-exporter-accelerators-collector-config\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.592496 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a318926c-317c-449d-8697-4258387b6430-node-exporter-wtmp\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.592496 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a318926c-317c-449d-8697-4258387b6430-root\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.592496 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a318926c-317c-449d-8697-4258387b6430-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.592496 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gvx4\" (UniqueName: \"kubernetes.io/projected/0ea8933a-21da-4900-afed-0344bbec3d27-kube-api-access-9gvx4\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.592686 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a318926c-317c-449d-8697-4258387b6430-node-exporter-tls\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.592686 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ea8933a-21da-4900-afed-0344bbec3d27-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.592686 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ea8933a-21da-4900-afed-0344bbec3d27-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.592807 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ea8933a-21da-4900-afed-0344bbec3d27-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.592807 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a318926c-317c-449d-8697-4258387b6430-node-exporter-textfile\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.592903 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a318926c-317c-449d-8697-4258387b6430-metrics-client-ca\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.592903 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4ftk\" (UniqueName: \"kubernetes.io/projected/a318926c-317c-449d-8697-4258387b6430-kube-api-access-s4ftk\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.592903 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.592873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a318926c-317c-449d-8697-4258387b6430-sys\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.593319 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.593295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ea8933a-21da-4900-afed-0344bbec3d27-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.594924 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.594904 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ea8933a-21da-4900-afed-0344bbec3d27-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.595208 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.595191 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ea8933a-21da-4900-afed-0344bbec3d27-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.605146 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.605123 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gvx4\" (UniqueName: \"kubernetes.io/projected/0ea8933a-21da-4900-afed-0344bbec3d27-kube-api-access-9gvx4\") pod \"openshift-state-metrics-79f6958cdf-vggsn\" (UID: \"0ea8933a-21da-4900-afed-0344bbec3d27\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.688809 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.688787 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" Jul 20 18:18:06.694169 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a318926c-317c-449d-8697-4258387b6430-node-exporter-tls\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694269 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a318926c-317c-449d-8697-4258387b6430-node-exporter-textfile\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694269 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a318926c-317c-449d-8697-4258387b6430-metrics-client-ca\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694375 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4ftk\" (UniqueName: \"kubernetes.io/projected/a318926c-317c-449d-8697-4258387b6430-kube-api-access-s4ftk\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694375 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a318926c-317c-449d-8697-4258387b6430-sys\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694375 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a318926c-317c-449d-8697-4258387b6430-node-exporter-accelerators-collector-config\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694528 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a318926c-317c-449d-8697-4258387b6430-node-exporter-wtmp\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694528 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a318926c-317c-449d-8697-4258387b6430-root\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694528 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a318926c-317c-449d-8697-4258387b6430-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694694 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694589 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a318926c-317c-449d-8697-4258387b6430-sys\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694694 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694598 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a318926c-317c-449d-8697-4258387b6430-node-exporter-textfile\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.694798 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.694763 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a318926c-317c-449d-8697-4258387b6430-node-exporter-wtmp\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.695372 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.695082 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a318926c-317c-449d-8697-4258387b6430-metrics-client-ca\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.695372 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.695217 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a318926c-317c-449d-8697-4258387b6430-node-exporter-accelerators-collector-config\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.695372 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.695283 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a318926c-317c-449d-8697-4258387b6430-root\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.697145 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.697098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a318926c-317c-449d-8697-4258387b6430-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.698067 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.698044 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a318926c-317c-449d-8697-4258387b6430-node-exporter-tls\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.712002 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.711970 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4ftk\" (UniqueName: \"kubernetes.io/projected/a318926c-317c-449d-8697-4258387b6430-kube-api-access-s4ftk\") pod \"node-exporter-wcr5j\" (UID: \"a318926c-317c-449d-8697-4258387b6430\") " pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.722338 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.722320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wcr5j" Jul 20 18:18:06.734594 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:18:06.734573 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda318926c_317c_449d_8697_4258387b6430.slice/crio-625830903d685dff87095830426fae2f429114587e4217952a46b2a8fcdb1cf0 WatchSource:0}: Error finding container 625830903d685dff87095830426fae2f429114587e4217952a46b2a8fcdb1cf0: Status 404 returned error can't find the container with id 625830903d685dff87095830426fae2f429114587e4217952a46b2a8fcdb1cf0 Jul 20 18:18:06.825576 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:06.825477 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn"] Jul 20 18:18:06.829895 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:18:06.829871 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea8933a_21da_4900_afed_0344bbec3d27.slice/crio-fb17a4c1c41a7b02e2da87792f44c4a7373cd64cd0f55ce009415d07a9d77ed0 WatchSource:0}: Error finding container fb17a4c1c41a7b02e2da87792f44c4a7373cd64cd0f55ce009415d07a9d77ed0: Status 404 returned error can't find the container with id fb17a4c1c41a7b02e2da87792f44c4a7373cd64cd0f55ce009415d07a9d77ed0 Jul 20 18:18:07.279006 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:07.278914 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" event={"ID":"0ea8933a-21da-4900-afed-0344bbec3d27","Type":"ContainerStarted","Data":"ef825c80387a6edf409a6f09112895b52db84b2a7997105849e60717c41fc387"} Jul 20 18:18:07.279451 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:07.279009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" event={"ID":"0ea8933a-21da-4900-afed-0344bbec3d27","Type":"ContainerStarted","Data":"1ebbd10af3e9ec50c72f84c3c90e34441d062e712a1159570d20e7121afca81e"} Jul 20 18:18:07.279451 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:07.279067 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" event={"ID":"0ea8933a-21da-4900-afed-0344bbec3d27","Type":"ContainerStarted","Data":"fb17a4c1c41a7b02e2da87792f44c4a7373cd64cd0f55ce009415d07a9d77ed0"} Jul 20 18:18:07.280221 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:07.280195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wcr5j" event={"ID":"a318926c-317c-449d-8697-4258387b6430","Type":"ContainerStarted","Data":"625830903d685dff87095830426fae2f429114587e4217952a46b2a8fcdb1cf0"} Jul 20 18:18:09.290134 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:09.290073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" event={"ID":"0ea8933a-21da-4900-afed-0344bbec3d27","Type":"ContainerStarted","Data":"8518ca2ca350d57bab2b0573e0cfd5f1da07bccc2cd38a13d1a8ceb9c8677969"} Jul 20 18:18:09.314326 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:09.314244 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vggsn" podStartSLOduration=2.016323675 podStartE2EDuration="3.314223183s" totalImagesPullingTime="1.297899508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:09.312222555 +0000 UTC m=+283.632380877" watchObservedRunningTime="2026-07-20 18:18:09.314223183 +0000 UTC m=+283.634381504" Jul 20 18:18:09.926542 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:18:09.926492 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6k5pv" podUID="e95e9429-310d-44da-81d5-e279fe4a7089" Jul 20 18:18:10.295899 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.295834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6k5pv" Jul 20 18:18:10.780383 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.780357 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b799b8b6f-tz2gx"] Jul 20 18:18:10.783122 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.783107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:10.786751 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.786727 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-76h66\"" Jul 20 18:18:10.786849 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.786821 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-aj2c183f8rbgt\"" Jul 20 18:18:10.786849 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.786825 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 20 18:18:10.786936 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.786841 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 18:18:10.786988 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.786940 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 20 18:18:10.787095 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.787078 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 20 18:18:10.792009 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.791987 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b799b8b6f-tz2gx"] Jul 20 18:18:10.925923 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.925905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v7jv\" (UniqueName: \"kubernetes.io/projected/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-kube-api-access-5v7jv\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:10.926021 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.925947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-client-ca-bundle\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:10.926021 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.925968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-secret-metrics-server-tls\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:10.926021 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.925992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-secret-metrics-server-client-certs\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:10.926128 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.926041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-metrics-server-audit-profiles\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:10.926128 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.926080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:10.926128 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:10.926095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-audit-log\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.026451 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.026423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-secret-metrics-server-client-certs\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.026543 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.026457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-metrics-server-audit-profiles\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.026543 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.026491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.026543 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.026506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-audit-log\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.026714 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.026608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v7jv\" (UniqueName: \"kubernetes.io/projected/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-kube-api-access-5v7jv\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.026714 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.026679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-client-ca-bundle\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.026813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.026714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-secret-metrics-server-tls\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.026955 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.026936 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-audit-log\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.027233 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.027214 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.027494 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.027474 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-metrics-server-audit-profiles\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.029098 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.029081 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-secret-metrics-server-tls\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.029153 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.029113 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-secret-metrics-server-client-certs\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.029153 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.029132 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-client-ca-bundle\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.034964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.034937 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v7jv\" (UniqueName: \"kubernetes.io/projected/924ef3ca-7c93-4f82-b2ca-047d8e49d9d2-kube-api-access-5v7jv\") pod \"metrics-server-7b799b8b6f-tz2gx\" (UID: \"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2\") " pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.091138 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.091111 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:11.215383 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.215308 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b799b8b6f-tz2gx"] Jul 20 18:18:11.220888 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:18:11.220861 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924ef3ca_7c93_4f82_b2ca_047d8e49d9d2.slice/crio-667a89f1e5ddbbfe5abd36427dafdf107cfcc8f3e64ea26abd698fdcee29a39c WatchSource:0}: Error finding container 667a89f1e5ddbbfe5abd36427dafdf107cfcc8f3e64ea26abd698fdcee29a39c: Status 404 returned error can't find the container with id 667a89f1e5ddbbfe5abd36427dafdf107cfcc8f3e64ea26abd698fdcee29a39c Jul 20 18:18:11.299937 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.299910 2576 generic.go:356] "Generic (PLEG): container finished" podID="a318926c-317c-449d-8697-4258387b6430" containerID="ccbf41ca5dbf4b6e7e431272aed0160a5ae6f8fe67e2b26fe6c08866dd3684ed" exitCode=0 Jul 20 18:18:11.300286 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.299981 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wcr5j" event={"ID":"a318926c-317c-449d-8697-4258387b6430","Type":"ContainerDied","Data":"ccbf41ca5dbf4b6e7e431272aed0160a5ae6f8fe67e2b26fe6c08866dd3684ed"} Jul 20 18:18:11.301178 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.301157 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" event={"ID":"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2","Type":"ContainerStarted","Data":"667a89f1e5ddbbfe5abd36427dafdf107cfcc8f3e64ea26abd698fdcee29a39c"} Jul 20 18:18:11.303238 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.303212 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25lbl" event={"ID":"4e6ce038-b497-4b88-96f1-fea20a09980f","Type":"ContainerStarted","Data":"3f55b826442b5c9c0ff3b36a5c0bf0a1ecbcf98ce95db04c77ed7584817f89cc"} Jul 20 18:18:11.342722 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.342682 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-25lbl" podStartSLOduration=33.98852023 podStartE2EDuration="48.342667355s" totalImagesPullingTime="14.354147125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:17:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:11.341652583 +0000 UTC m=+285.661810924" watchObservedRunningTime="2026-07-20 18:18:11.342667355 +0000 UTC m=+285.662825671" Jul 20 18:18:11.615477 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.615444 2576 patch_prober.go:28] interesting pod/image-registry-5cb4f7cc99-nfbss container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 18:18:11.615630 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:11.615498 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" podUID="03680bf7-dc2a-4668-86a7-9dead0431124" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 18:18:12.308018 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:12.307980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wcr5j" event={"ID":"a318926c-317c-449d-8697-4258387b6430","Type":"ContainerStarted","Data":"782effa90e38d86132b42f9403c25757b16d15ae750a41ad8f9afda9cba1856d"} Jul 20 18:18:12.308400 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:12.308044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wcr5j" event={"ID":"a318926c-317c-449d-8697-4258387b6430","Type":"ContainerStarted","Data":"2ad2e913de0682db21228ba70b72e6d9b4e0e7bde5a5967756f1d3f5216a695b"} Jul 20 18:18:12.342123 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:12.342065 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wcr5j" podStartSLOduration=2.438381164 podStartE2EDuration="6.342045253s" totalImagesPullingTime="3.840189648s" totalInitContainerRuntime="63.474441ms" isStatefulPod=true podCreationTimestamp="2026-07-20 18:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:12.339859421 +0000 UTC m=+286.660017761" watchObservedRunningTime="2026-07-20 18:18:12.342045253 +0000 UTC m=+286.662203575" Jul 20 18:18:12.942588 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:12.942553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:18:12.945168 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:12.945142 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95e9429-310d-44da-81d5-e279fe4a7089-metrics-tls\") pod \"dns-default-6k5pv\" (UID: \"e95e9429-310d-44da-81d5-e279fe4a7089\") " pod="openshift-dns/dns-default-6k5pv" Jul 20 18:18:12.999531 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:12.999500 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wr2zv\"" Jul 20 18:18:13.007691 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:13.007672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6k5pv" Jul 20 18:18:13.149057 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:13.149027 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6k5pv"] Jul 20 18:18:13.230166 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:13.230097 2576 patch_prober.go:28] interesting pod/image-registry-5cb4f7cc99-nfbss container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 18:18:13.230166 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:13.230151 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" podUID="03680bf7-dc2a-4668-86a7-9dead0431124" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 18:18:13.312728 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:13.312691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" event={"ID":"924ef3ca-7c93-4f82-b2ca-047d8e49d9d2","Type":"ContainerStarted","Data":"1b703b362b4c8d202dae01f341e2d952d2d175feabed6776192a9368cfd0a171"} Jul 20 18:18:13.313809 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:13.313785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6k5pv" event={"ID":"e95e9429-310d-44da-81d5-e279fe4a7089","Type":"ContainerStarted","Data":"3d01d5bd1e4d4fc59d2eddb934ebbfcd384d54a1d4c86b0975fbcf8422f807f4"} Jul 20 18:18:13.333226 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:13.333186 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" podStartSLOduration=1.530490436 podStartE2EDuration="3.3331731s" totalImagesPullingTime="1.802682664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:13.33253688 +0000 UTC m=+287.652695226" watchObservedRunningTime="2026-07-20 18:18:13.3331731 +0000 UTC m=+287.653331419" Jul 20 18:18:16.326486 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.326449 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6k5pv" event={"ID":"e95e9429-310d-44da-81d5-e279fe4a7089","Type":"ContainerStarted","Data":"58101a15ba353586f3a221ed9e47f1e687951b3b02753b7d67fc956571d8abfe"} Jul 20 18:18:16.326911 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.326499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6k5pv" event={"ID":"e95e9429-310d-44da-81d5-e279fe4a7089","Type":"ContainerStarted","Data":"e2b92dfeccb7c60a6e0b730b1fb8a3bdda5018d2c699bdbe7e7e989eafcf917f"} Jul 20 18:18:16.326911 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.326592 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6k5pv" Jul 20 18:18:16.345032 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.344925 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6k5pv" podStartSLOduration=251.259174496 podStartE2EDuration="4m13.344908967s" totalImagesPullingTime="2.085734471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:16.344446422 +0000 UTC m=+290.664604760" watchObservedRunningTime="2026-07-20 18:18:16.344908967 +0000 UTC m=+290.665067287" Jul 20 18:18:16.448834 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.448807 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dbfd8cb5c-rkpl5"] Jul 20 18:18:16.451899 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.451884 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.454442 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.454420 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 18:18:16.454553 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.454451 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 18:18:16.454694 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.454680 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 18:18:16.454826 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.454808 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 18:18:16.454891 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.454864 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-99mxx\"" Jul 20 18:18:16.454948 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.454892 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 18:18:16.454948 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.454893 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 18:18:16.455543 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.455527 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 18:18:16.460167 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.460150 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 18:18:16.468029 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.467999 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dbfd8cb5c-rkpl5"] Jul 20 18:18:16.493364 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.493343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmv57\" (UniqueName: \"kubernetes.io/projected/79c89690-e95a-479b-8080-b135962e5c93-kube-api-access-xmv57\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.493480 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.493374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-oauth-config\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.493480 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.493391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-serving-cert\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.493480 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.493424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-trusted-ca-bundle\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.493634 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.493540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-oauth-serving-cert\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.493634 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.493578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-console-config\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.493634 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.493604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-service-ca\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.594370 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.594348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-oauth-config\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.594481 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.594376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-serving-cert\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.594481 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.594408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-trusted-ca-bundle\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.594481 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.594443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-oauth-serving-cert\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.594481 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.594475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-console-config\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.594701 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.594506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-service-ca\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.594779 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.594750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmv57\" (UniqueName: \"kubernetes.io/projected/79c89690-e95a-479b-8080-b135962e5c93-kube-api-access-xmv57\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.595270 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.595245 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-service-ca\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.595270 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.595257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-oauth-serving-cert\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.595416 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.595268 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-console-config\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.595416 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.595388 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-trusted-ca-bundle\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.596578 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.596558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-serving-cert\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.596756 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.596737 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-oauth-config\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.607918 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.607899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmv57\" (UniqueName: \"kubernetes.io/projected/79c89690-e95a-479b-8080-b135962e5c93-kube-api-access-xmv57\") pod \"console-5dbfd8cb5c-rkpl5\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.761704 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.761676 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:16.885693 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:16.885612 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dbfd8cb5c-rkpl5"] Jul 20 18:18:16.888407 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:18:16.888379 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c89690_e95a_479b_8080_b135962e5c93.slice/crio-49b62e69a7509914d35d84c5122f8012250c7c99c36a01a295d018d86e381ea5 WatchSource:0}: Error finding container 49b62e69a7509914d35d84c5122f8012250c7c99c36a01a295d018d86e381ea5: Status 404 returned error can't find the container with id 49b62e69a7509914d35d84c5122f8012250c7c99c36a01a295d018d86e381ea5 Jul 20 18:18:17.331144 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:17.331066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbfd8cb5c-rkpl5" event={"ID":"79c89690-e95a-479b-8080-b135962e5c93","Type":"ContainerStarted","Data":"49b62e69a7509914d35d84c5122f8012250c7c99c36a01a295d018d86e381ea5"} Jul 20 18:18:20.343374 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:20.343339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbfd8cb5c-rkpl5" event={"ID":"79c89690-e95a-479b-8080-b135962e5c93","Type":"ContainerStarted","Data":"c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830"} Jul 20 18:18:20.365933 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:20.365891 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dbfd8cb5c-rkpl5" podStartSLOduration=1.56427465 podStartE2EDuration="4.365877681s" totalImagesPullingTime="2.801603031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:18:20.36428878 +0000 UTC m=+294.684447122" watchObservedRunningTime="2026-07-20 18:18:20.365877681 +0000 UTC m=+294.686036001" Jul 20 18:18:21.267716 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:18:21.267670 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cmnwz" podUID="1c37edf7-0b78-44c5-8223-de838b9908dd" Jul 20 18:18:21.615123 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:21.615096 2576 patch_prober.go:28] interesting pod/image-registry-5cb4f7cc99-nfbss container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 18:18:21.615469 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:21.615153 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" podUID="03680bf7-dc2a-4668-86a7-9dead0431124" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 18:18:23.228859 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:23.228822 2576 patch_prober.go:28] interesting pod/image-registry-5cb4f7cc99-nfbss container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 18:18:23.229234 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:23.228876 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" podUID="03680bf7-dc2a-4668-86a7-9dead0431124" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 18:18:26.085658 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:26.085605 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:18:26.085658 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:26.085610 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:18:26.093338 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:26.093316 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 18:18:26.333134 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:26.333011 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6k5pv" Jul 20 18:18:26.761798 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:26.761764 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:26.761976 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:26.761870 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:26.767480 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:26.767456 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:27.341208 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:27.341170 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" podUID="717a8ca7-0db8-43c6-8492-11b872d54cc0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 20 18:18:27.368250 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:27.368223 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:18:31.092064 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:31.092029 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:31.092402 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:31.092090 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:31.615664 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:31.615616 2576 patch_prober.go:28] interesting pod/image-registry-5cb4f7cc99-nfbss container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 18:18:31.615847 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:31.615699 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" podUID="03680bf7-dc2a-4668-86a7-9dead0431124" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 18:18:31.615847 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:31.615747 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:18:31.616259 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:31.616215 2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"44da87b9f28dbf8a0a83d561b2ba1dccc729a6c5999968c2214798db45e84dc0"} pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" containerMessage="Container registry failed liveness probe, will be restarted" Jul 20 18:18:31.619827 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:31.619802 2576 patch_prober.go:28] interesting pod/image-registry-5cb4f7cc99-nfbss container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 20 18:18:31.619925 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:31.619855 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" podUID="03680bf7-dc2a-4668-86a7-9dead0431124" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 18:18:36.268609 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:36.268577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:18:37.341084 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:37.341042 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" podUID="717a8ca7-0db8-43c6-8492-11b872d54cc0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 20 18:18:41.620677 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:41.620631 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:18:47.340945 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:47.340907 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" podUID="717a8ca7-0db8-43c6-8492-11b872d54cc0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 20 18:18:47.341325 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:47.340989 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" Jul 20 18:18:47.341423 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:47.341406 2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"1909f8b82dab42e6673d5f9d9680705629df16301b1d3ca57c08f31dc09c848d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 20 18:18:47.341460 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:47.341441 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" podUID="717a8ca7-0db8-43c6-8492-11b872d54cc0" containerName="service-proxy" containerID="cri-o://1909f8b82dab42e6673d5f9d9680705629df16301b1d3ca57c08f31dc09c848d" gracePeriod=30 Jul 20 18:18:48.432729 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:48.432694 2576 generic.go:356] "Generic (PLEG): container finished" podID="717a8ca7-0db8-43c6-8492-11b872d54cc0" containerID="1909f8b82dab42e6673d5f9d9680705629df16301b1d3ca57c08f31dc09c848d" exitCode=2 Jul 20 18:18:48.433128 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:48.432775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" event={"ID":"717a8ca7-0db8-43c6-8492-11b872d54cc0","Type":"ContainerDied","Data":"1909f8b82dab42e6673d5f9d9680705629df16301b1d3ca57c08f31dc09c848d"} Jul 20 18:18:48.433128 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:48.432817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-684d978f77-c6gk2" event={"ID":"717a8ca7-0db8-43c6-8492-11b872d54cc0","Type":"ContainerStarted","Data":"86a50255944e92efa449970eb6fb5500d387e5473241b74555cd9868491b998a"} Jul 20 18:18:51.096606 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:51.096577 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:51.100417 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:51.100391 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b799b8b6f-tz2gx" Jul 20 18:18:56.635478 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:56.635442 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" podUID="03680bf7-dc2a-4668-86a7-9dead0431124" containerName="registry" containerID="cri-o://44da87b9f28dbf8a0a83d561b2ba1dccc729a6c5999968c2214798db45e84dc0" gracePeriod=30 Jul 20 18:18:58.467951 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:58.467919 2576 generic.go:356] "Generic (PLEG): container finished" podID="03680bf7-dc2a-4668-86a7-9dead0431124" containerID="44da87b9f28dbf8a0a83d561b2ba1dccc729a6c5999968c2214798db45e84dc0" exitCode=0 Jul 20 18:18:58.468366 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:58.468007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" event={"ID":"03680bf7-dc2a-4668-86a7-9dead0431124","Type":"ContainerDied","Data":"44da87b9f28dbf8a0a83d561b2ba1dccc729a6c5999968c2214798db45e84dc0"} Jul 20 18:18:58.468366 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:58.468072 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" event={"ID":"03680bf7-dc2a-4668-86a7-9dead0431124","Type":"ContainerStarted","Data":"6043585e761037616f3fc5ba4d218fcf0097e2a8e2b84853f556fec88b27aa78"} Jul 20 18:18:58.468366 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:18:58.468104 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:19:19.480094 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:19.480059 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cb4f7cc99-nfbss" Jul 20 18:19:40.086952 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:40.086914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:19:40.089197 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:40.089178 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c37edf7-0b78-44c5-8223-de838b9908dd-metrics-certs\") pod \"network-metrics-daemon-cmnwz\" (UID: \"1c37edf7-0b78-44c5-8223-de838b9908dd\") " pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:19:40.171556 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:40.171535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7qbr\"" Jul 20 18:19:40.179918 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:40.179897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cmnwz" Jul 20 18:19:40.302334 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:40.302284 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cmnwz"] Jul 20 18:19:40.304545 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:19:40.304521 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c37edf7_0b78_44c5_8223_de838b9908dd.slice/crio-f38940a7ee88446d07cc83c8694f11fe460ab1c90cef4baabe29b370afdb889a WatchSource:0}: Error finding container f38940a7ee88446d07cc83c8694f11fe460ab1c90cef4baabe29b370afdb889a: Status 404 returned error can't find the container with id f38940a7ee88446d07cc83c8694f11fe460ab1c90cef4baabe29b370afdb889a Jul 20 18:19:40.306425 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:40.306398 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 18:19:40.615263 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:40.615231 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cmnwz" event={"ID":"1c37edf7-0b78-44c5-8223-de838b9908dd","Type":"ContainerStarted","Data":"f38940a7ee88446d07cc83c8694f11fe460ab1c90cef4baabe29b370afdb889a"} Jul 20 18:19:41.620220 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:41.620183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cmnwz" event={"ID":"1c37edf7-0b78-44c5-8223-de838b9908dd","Type":"ContainerStarted","Data":"16a997b83299f23f9c968fde6fd99d4175510bce53132ce0abb00f389301843d"} Jul 20 18:19:41.620708 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:41.620244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cmnwz" event={"ID":"1c37edf7-0b78-44c5-8223-de838b9908dd","Type":"ContainerStarted","Data":"b99df488dbd0d03ff89bc784f2aca85bb5b67b25fe484c5fcedc68f4e46718c8"} Jul 20 18:19:41.636723 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:41.636675 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cmnwz" podStartSLOduration=374.76909756 podStartE2EDuration="6m15.636636126s" totalImagesPullingTime="867.538566ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:19:41.635169056 +0000 UTC m=+375.955327388" watchObservedRunningTime="2026-07-20 18:19:41.636636126 +0000 UTC m=+375.956794446" Jul 20 18:19:47.808045 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:19:47.808012 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dbfd8cb5c-rkpl5"] Jul 20 18:20:12.832305 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:12.832240 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dbfd8cb5c-rkpl5" podUID="79c89690-e95a-479b-8080-b135962e5c93" containerName="console" containerID="cri-o://c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830" gracePeriod=15 Jul 20 18:20:13.069509 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.069487 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:20:13.216414 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.216377 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-serving-cert\") pod \"79c89690-e95a-479b-8080-b135962e5c93\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " Jul 20 18:20:13.216544 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.216437 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-oauth-config\") pod \"79c89690-e95a-479b-8080-b135962e5c93\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " Jul 20 18:20:13.216597 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.216548 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-oauth-serving-cert\") pod \"79c89690-e95a-479b-8080-b135962e5c93\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " Jul 20 18:20:13.216597 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.216580 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-trusted-ca-bundle\") pod \"79c89690-e95a-479b-8080-b135962e5c93\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " Jul 20 18:20:13.216731 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.216623 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmv57\" (UniqueName: \"kubernetes.io/projected/79c89690-e95a-479b-8080-b135962e5c93-kube-api-access-xmv57\") pod \"79c89690-e95a-479b-8080-b135962e5c93\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " Jul 20 18:20:13.216731 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.216691 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-console-config\") pod \"79c89690-e95a-479b-8080-b135962e5c93\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " Jul 20 18:20:13.216731 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.216728 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-service-ca\") pod \"79c89690-e95a-479b-8080-b135962e5c93\" (UID: \"79c89690-e95a-479b-8080-b135962e5c93\") " Jul 20 18:20:13.217006 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.216950 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79c89690-e95a-479b-8080-b135962e5c93" (UID: "79c89690-e95a-479b-8080-b135962e5c93"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:20:13.217130 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.217072 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "79c89690-e95a-479b-8080-b135962e5c93" (UID: "79c89690-e95a-479b-8080-b135962e5c93"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:20:13.217190 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.217122 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-console-config" (OuterVolumeSpecName: "console-config") pod "79c89690-e95a-479b-8080-b135962e5c93" (UID: "79c89690-e95a-479b-8080-b135962e5c93"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:20:13.217242 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.217194 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-service-ca" (OuterVolumeSpecName: "service-ca") pod "79c89690-e95a-479b-8080-b135962e5c93" (UID: "79c89690-e95a-479b-8080-b135962e5c93"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:20:13.218769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.218743 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79c89690-e95a-479b-8080-b135962e5c93" (UID: "79c89690-e95a-479b-8080-b135962e5c93"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 18:20:13.218769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.218760 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c89690-e95a-479b-8080-b135962e5c93-kube-api-access-xmv57" (OuterVolumeSpecName: "kube-api-access-xmv57") pod "79c89690-e95a-479b-8080-b135962e5c93" (UID: "79c89690-e95a-479b-8080-b135962e5c93"). InnerVolumeSpecName "kube-api-access-xmv57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:20:13.218903 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.218766 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79c89690-e95a-479b-8080-b135962e5c93" (UID: "79c89690-e95a-479b-8080-b135962e5c93"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 18:20:13.318175 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.318150 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-oauth-serving-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:20:13.318175 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.318173 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-trusted-ca-bundle\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:20:13.318316 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.318187 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmv57\" (UniqueName: \"kubernetes.io/projected/79c89690-e95a-479b-8080-b135962e5c93-kube-api-access-xmv57\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:20:13.318316 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.318200 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-console-config\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:20:13.318316 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.318211 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79c89690-e95a-479b-8080-b135962e5c93-service-ca\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:20:13.318316 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.318222 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-serving-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:20:13.318316 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.318234 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79c89690-e95a-479b-8080-b135962e5c93-console-oauth-config\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:20:13.732390 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.732355 2576 generic.go:356] "Generic (PLEG): container finished" podID="79c89690-e95a-479b-8080-b135962e5c93" containerID="c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830" exitCode=0 Jul 20 18:20:13.732534 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.732405 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbfd8cb5c-rkpl5" event={"ID":"79c89690-e95a-479b-8080-b135962e5c93","Type":"ContainerDied","Data":"c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830"} Jul 20 18:20:13.732534 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.732411 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbfd8cb5c-rkpl5" Jul 20 18:20:13.732534 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.732469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbfd8cb5c-rkpl5" event={"ID":"79c89690-e95a-479b-8080-b135962e5c93","Type":"ContainerDied","Data":"49b62e69a7509914d35d84c5122f8012250c7c99c36a01a295d018d86e381ea5"} Jul 20 18:20:13.732534 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.732490 2576 scope.go:117] "RemoveContainer" containerID="c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830" Jul 20 18:20:13.740694 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.740674 2576 scope.go:117] "RemoveContainer" containerID="c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830" Jul 20 18:20:13.740971 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:20:13.740950 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830\": container with ID starting with c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830 not found: ID does not exist" containerID="c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830" Jul 20 18:20:13.741020 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.740980 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830"} err="failed to get container status \"c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830\": rpc error: code = NotFound desc = could not find container \"c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830\": container with ID starting with c7a1aedaba607546ead50808cb45e2ab949e262582c6043631b66b143cfdc830 not found: ID does not exist" Jul 20 18:20:13.752720 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.752695 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dbfd8cb5c-rkpl5"] Jul 20 18:20:13.758307 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:13.758285 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dbfd8cb5c-rkpl5"] Jul 20 18:20:14.273272 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:14.273233 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c89690-e95a-479b-8080-b135962e5c93" path="/var/lib/kubelet/pods/79c89690-e95a-479b-8080-b135962e5c93/volumes" Jul 20 18:20:43.541984 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.541941 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7654c94b6d-j78jc"] Jul 20 18:20:43.542398 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.542193 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c89690-e95a-479b-8080-b135962e5c93" containerName="console" Jul 20 18:20:43.542398 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.542207 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c89690-e95a-479b-8080-b135962e5c93" containerName="console" Jul 20 18:20:43.542398 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.542253 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c89690-e95a-479b-8080-b135962e5c93" containerName="console" Jul 20 18:20:43.546053 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.546037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.548542 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.548486 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 18:20:43.548797 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.548779 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 18:20:43.548797 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.548791 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 18:20:43.549222 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.549205 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 18:20:43.549681 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.549665 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 18:20:43.549743 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.549689 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 18:20:43.549925 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.549912 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 18:20:43.550002 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.549943 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-99mxx\"" Jul 20 18:20:43.556086 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.556063 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7654c94b6d-j78jc"] Jul 20 18:20:43.556403 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.556384 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 18:20:43.716365 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.716337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-oauth-serving-cert\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.716504 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.716368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-config\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.716504 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.716394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2htdf\" (UniqueName: \"kubernetes.io/projected/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-kube-api-access-2htdf\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.716504 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.716473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-serving-cert\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.716504 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.716492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-oauth-config\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.716674 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.716518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-trusted-ca-bundle\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.716674 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.716538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-service-ca\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.817863 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.817802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-service-ca\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.817863 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.817834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-oauth-serving-cert\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.817863 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.817855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-config\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.818036 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.817881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2htdf\" (UniqueName: \"kubernetes.io/projected/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-kube-api-access-2htdf\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.818036 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.817935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-serving-cert\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.818036 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.817959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-oauth-config\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.818036 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.817984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-trusted-ca-bundle\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.818685 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.818660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-config\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.818794 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.818712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-oauth-serving-cert\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.818858 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.818790 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-service-ca\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.818858 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.818797 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-trusted-ca-bundle\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.820434 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.820413 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-oauth-config\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.820513 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.820488 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-serving-cert\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.826085 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.826063 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2htdf\" (UniqueName: \"kubernetes.io/projected/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-kube-api-access-2htdf\") pod \"console-7654c94b6d-j78jc\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.854942 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.854924 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:43.978817 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:43.978786 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7654c94b6d-j78jc"] Jul 20 18:20:43.981788 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:20:43.981758 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226ee6ca_ebe8_42f9_9c49_9a4ce11cd7ea.slice/crio-f9c8f50b9f94c1a38aa69ed78aad2eba0cd10f1b82edc0d8332d56de5de5983c WatchSource:0}: Error finding container f9c8f50b9f94c1a38aa69ed78aad2eba0cd10f1b82edc0d8332d56de5de5983c: Status 404 returned error can't find the container with id f9c8f50b9f94c1a38aa69ed78aad2eba0cd10f1b82edc0d8332d56de5de5983c Jul 20 18:20:44.841402 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:44.841365 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7654c94b6d-j78jc" event={"ID":"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea","Type":"ContainerStarted","Data":"e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197"} Jul 20 18:20:44.841820 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:44.841411 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7654c94b6d-j78jc" event={"ID":"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea","Type":"ContainerStarted","Data":"f9c8f50b9f94c1a38aa69ed78aad2eba0cd10f1b82edc0d8332d56de5de5983c"} Jul 20 18:20:44.857410 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:44.857360 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7654c94b6d-j78jc" podStartSLOduration=1.857345517 podStartE2EDuration="1.857345517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:20:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:20:44.856631077 +0000 UTC m=+439.176789397" watchObservedRunningTime="2026-07-20 18:20:44.857345517 +0000 UTC m=+439.177503836" Jul 20 18:20:53.856086 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:53.855990 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:53.856086 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:53.856048 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:53.860534 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:53.860510 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:20:53.877902 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:20:53.877884 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:22:27.940465 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:27.940426 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5"] Jul 20 18:22:27.943414 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:27.943395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" Jul 20 18:22:27.945952 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:27.945923 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zfzxh\"" Jul 20 18:22:27.946084 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:27.945959 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 18:22:27.946898 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:27.946881 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 18:22:27.953769 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:27.953744 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5"] Jul 20 18:22:28.034186 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:28.034151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvdq6\" (UniqueName: \"kubernetes.io/projected/ce258e24-9aa5-4302-924a-8229eb5c1adb-kube-api-access-tvdq6\") pod \"cert-manager-cainjector-559cdd8c87-mfrk5\" (UID: \"ce258e24-9aa5-4302-924a-8229eb5c1adb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" Jul 20 18:22:28.034186 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:28.034188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce258e24-9aa5-4302-924a-8229eb5c1adb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mfrk5\" (UID: \"ce258e24-9aa5-4302-924a-8229eb5c1adb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" Jul 20 18:22:28.134675 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:28.134629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvdq6\" (UniqueName: \"kubernetes.io/projected/ce258e24-9aa5-4302-924a-8229eb5c1adb-kube-api-access-tvdq6\") pod \"cert-manager-cainjector-559cdd8c87-mfrk5\" (UID: \"ce258e24-9aa5-4302-924a-8229eb5c1adb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" Jul 20 18:22:28.134813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:28.134683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce258e24-9aa5-4302-924a-8229eb5c1adb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mfrk5\" (UID: \"ce258e24-9aa5-4302-924a-8229eb5c1adb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" Jul 20 18:22:28.144591 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:28.144571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce258e24-9aa5-4302-924a-8229eb5c1adb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mfrk5\" (UID: \"ce258e24-9aa5-4302-924a-8229eb5c1adb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" Jul 20 18:22:28.144750 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:28.144733 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvdq6\" (UniqueName: \"kubernetes.io/projected/ce258e24-9aa5-4302-924a-8229eb5c1adb-kube-api-access-tvdq6\") pod \"cert-manager-cainjector-559cdd8c87-mfrk5\" (UID: \"ce258e24-9aa5-4302-924a-8229eb5c1adb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" Jul 20 18:22:28.253348 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:28.253282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" Jul 20 18:22:28.375813 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:28.375783 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5"] Jul 20 18:22:28.378766 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:22:28.378741 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce258e24_9aa5_4302_924a_8229eb5c1adb.slice/crio-c8253d742a0dfafc60375ccdb685677f70176179a4336b731b8a791fcdbe7a82 WatchSource:0}: Error finding container c8253d742a0dfafc60375ccdb685677f70176179a4336b731b8a791fcdbe7a82: Status 404 returned error can't find the container with id c8253d742a0dfafc60375ccdb685677f70176179a4336b731b8a791fcdbe7a82 Jul 20 18:22:29.204363 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:29.204301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" event={"ID":"ce258e24-9aa5-4302-924a-8229eb5c1adb","Type":"ContainerStarted","Data":"c8253d742a0dfafc60375ccdb685677f70176179a4336b731b8a791fcdbe7a82"} Jul 20 18:22:32.216995 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:32.216951 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" event={"ID":"ce258e24-9aa5-4302-924a-8229eb5c1adb","Type":"ContainerStarted","Data":"658d332a253c655951b1d2e22e0e40d9acdf20f22538d88f89d06d837fd25957"} Jul 20 18:22:32.232535 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:32.232479 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mfrk5" podStartSLOduration=2.241642885 podStartE2EDuration="5.232459055s" totalImagesPullingTime="2.99081617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:22:32.231907221 +0000 UTC m=+546.552065540" watchObservedRunningTime="2026-07-20 18:22:32.232459055 +0000 UTC m=+546.552617380" Jul 20 18:22:57.099880 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.099842 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f"] Jul 20 18:22:57.103555 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.103530 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.108043 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.108021 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 18:22:57.108154 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.108095 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 20 18:22:57.108154 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.108117 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 20 18:22:57.108154 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.108122 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vh9n9\"" Jul 20 18:22:57.108318 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.108161 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 18:22:57.108318 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.108172 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 20 18:22:57.127732 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.127710 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f"] Jul 20 18:22:57.133713 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.133694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c1b4db2-f103-4b5b-ba92-9d021271eab6-cert\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.133807 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.133744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5c1b4db2-f103-4b5b-ba92-9d021271eab6-manager-config\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.133860 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.133799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-568nc\" (UniqueName: \"kubernetes.io/projected/5c1b4db2-f103-4b5b-ba92-9d021271eab6-kube-api-access-568nc\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.133860 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.133836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c1b4db2-f103-4b5b-ba92-9d021271eab6-metrics-cert\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.234967 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.234946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5c1b4db2-f103-4b5b-ba92-9d021271eab6-manager-config\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.235079 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.234976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-568nc\" (UniqueName: \"kubernetes.io/projected/5c1b4db2-f103-4b5b-ba92-9d021271eab6-kube-api-access-568nc\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.235079 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.234995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c1b4db2-f103-4b5b-ba92-9d021271eab6-metrics-cert\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.235079 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.235027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c1b4db2-f103-4b5b-ba92-9d021271eab6-cert\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.235522 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.235501 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5c1b4db2-f103-4b5b-ba92-9d021271eab6-manager-config\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.237405 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.237386 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c1b4db2-f103-4b5b-ba92-9d021271eab6-metrics-cert\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.237576 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.237555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c1b4db2-f103-4b5b-ba92-9d021271eab6-cert\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.251728 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.251706 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-568nc\" (UniqueName: \"kubernetes.io/projected/5c1b4db2-f103-4b5b-ba92-9d021271eab6-kube-api-access-568nc\") pod \"lws-controller-manager-bdf467c7d-qpk2f\" (UID: \"5c1b4db2-f103-4b5b-ba92-9d021271eab6\") " pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.412296 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.412231 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:22:57.537128 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:57.537093 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f"] Jul 20 18:22:57.540557 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:22:57.540528 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1b4db2_f103_4b5b_ba92_9d021271eab6.slice/crio-5958537f1738dedbd1e4725f19d6be2b1ef302c6feaa4169267123d55410e03a WatchSource:0}: Error finding container 5958537f1738dedbd1e4725f19d6be2b1ef302c6feaa4169267123d55410e03a: Status 404 returned error can't find the container with id 5958537f1738dedbd1e4725f19d6be2b1ef302c6feaa4169267123d55410e03a Jul 20 18:22:58.303049 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.302996 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" event={"ID":"5c1b4db2-f103-4b5b-ba92-9d021271eab6","Type":"ContainerStarted","Data":"5958537f1738dedbd1e4725f19d6be2b1ef302c6feaa4169267123d55410e03a"} Jul 20 18:22:58.499816 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.499780 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr"] Jul 20 18:22:58.502150 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.502125 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.504427 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.504400 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 18:22:58.504946 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.504922 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 18:22:58.505069 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.504938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 18:22:58.505132 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.505035 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 18:22:58.505337 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.505315 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gwrk8\"" Jul 20 18:22:58.534934 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.534913 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr"] Jul 20 18:22:58.545584 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.545561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gptmh\" (UniqueName: \"kubernetes.io/projected/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-kube-api-access-gptmh\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.545715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.545624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-tmp\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.545715 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.545666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.545812 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.545736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-manifests\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.545855 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.545828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.646479 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.646443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.646697 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.646500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gptmh\" (UniqueName: \"kubernetes.io/projected/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-kube-api-access-gptmh\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.646697 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.646540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-tmp\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.646697 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.646568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.646697 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.646611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-manifests\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.647093 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.647060 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-manifests\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.650079 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.650052 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.650195 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.650117 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-tmp\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.650824 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.650800 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.660422 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.660401 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gptmh\" (UniqueName: \"kubernetes.io/projected/3d7b7280-3b75-4a78-9ebe-f096ac9a90c5-kube-api-access-gptmh\") pod \"opendatahub-operator-controller-manager-9fdd66b9b-b87gr\" (UID: \"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5\") " pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.815299 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.815267 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:22:58.962874 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:58.962852 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr"] Jul 20 18:22:58.965017 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:22:58.964991 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7b7280_3b75_4a78_9ebe_f096ac9a90c5.slice/crio-3eb9ac258061621a7bd74931052f13fb19185c098bc94fc573d24942324372e0 WatchSource:0}: Error finding container 3eb9ac258061621a7bd74931052f13fb19185c098bc94fc573d24942324372e0: Status 404 returned error can't find the container with id 3eb9ac258061621a7bd74931052f13fb19185c098bc94fc573d24942324372e0 Jul 20 18:22:59.308292 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:22:59.308210 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" event={"ID":"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5","Type":"ContainerStarted","Data":"3eb9ac258061621a7bd74931052f13fb19185c098bc94fc573d24942324372e0"} Jul 20 18:23:01.318850 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:01.318799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" event={"ID":"5c1b4db2-f103-4b5b-ba92-9d021271eab6","Type":"ContainerStarted","Data":"d0c76a0f612584af34894fd3ba22fca3802f50b147d000eda8492c866ff546a1"} Jul 20 18:23:01.319295 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:01.318889 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:23:01.353322 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:01.353271 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" podStartSLOduration=1.5657599439999998 podStartE2EDuration="4.353255163s" totalImagesPullingTime="2.787495219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:01.351630345 +0000 UTC m=+575.671788684" watchObservedRunningTime="2026-07-20 18:23:01.353255163 +0000 UTC m=+575.673413484" Jul 20 18:23:03.326871 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:03.326833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" event={"ID":"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5","Type":"ContainerStarted","Data":"46ddb50dbcfcaa163d97209ffcc235055be45ae9f2b72a62fe1ec75de53f0be1"} Jul 20 18:23:04.331471 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:04.331381 2576 generic.go:356] "Generic (PLEG): container finished" podID="3d7b7280-3b75-4a78-9ebe-f096ac9a90c5" containerID="46ddb50dbcfcaa163d97209ffcc235055be45ae9f2b72a62fe1ec75de53f0be1" exitCode=0 Jul 20 18:23:04.331875 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:04.331472 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" event={"ID":"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5","Type":"ContainerDied","Data":"46ddb50dbcfcaa163d97209ffcc235055be45ae9f2b72a62fe1ec75de53f0be1"} Jul 20 18:23:05.336610 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:05.336576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" event={"ID":"3d7b7280-3b75-4a78-9ebe-f096ac9a90c5","Type":"ContainerStarted","Data":"7dc8928602f4d7d247c8fb2956d9b931211dd8bb7d24ad4ec1f322cc99ae475f"} Jul 20 18:23:05.337094 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:05.336673 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:23:05.358608 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:05.358566 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" podStartSLOduration=2.108260862 podStartE2EDuration="7.358552981s" totalImagesPullingTime="4.163165096s" totalInitContainerRuntime="1.087127023s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:22:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:05.357356498 +0000 UTC m=+579.677514817" watchObservedRunningTime="2026-07-20 18:23:05.358552981 +0000 UTC m=+579.678711300" Jul 20 18:23:12.324799 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:12.324770 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-bdf467c7d-qpk2f" Jul 20 18:23:16.342439 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:16.342412 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9fdd66b9b-b87gr" Jul 20 18:23:26.108690 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:26.108663 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:23:26.109759 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:26.109734 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:23:27.108165 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.108132 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv"] Jul 20 18:23:27.110078 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.110061 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.112432 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.112411 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vzrwp\"" Jul 20 18:23:27.112558 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.112510 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 18:23:27.112698 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.112681 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 18:23:27.112785 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.112724 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 18:23:27.123574 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.123553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv"] Jul 20 18:23:27.246541 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.246506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.246702 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.246547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.246702 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.246594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4qxr\" (UniqueName: \"kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-kube-api-access-c4qxr\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.246702 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.246663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.246702 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.246693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d1a9ed4-5500-401a-8026-74359b0f024e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.246911 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.246719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.246911 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.246746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.246911 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.246783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.246911 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.246801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348018 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.347992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348126 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348126 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348126 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348126 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4qxr\" (UniqueName: \"kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-kube-api-access-c4qxr\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d1a9ed4-5500-401a-8026-74359b0f024e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348543 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348517 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348666 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348578 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348666 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.348782 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.348716 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.349049 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.349028 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d1a9ed4-5500-401a-8026-74359b0f024e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.350747 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.350720 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.350921 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.350906 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.361878 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.361830 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4qxr\" (UniqueName: \"kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-kube-api-access-c4qxr\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.361996 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.361976 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.420411 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.420387 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:27.559792 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.559763 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv"] Jul 20 18:23:27.562537 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:23:27.562507 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1a9ed4_5500_401a_8026_74359b0f024e.slice/crio-5bcd1f3a5750c48b429ecef94e4eb79e67b2e0da1445a08e8723f34b4c1776e8 WatchSource:0}: Error finding container 5bcd1f3a5750c48b429ecef94e4eb79e67b2e0da1445a08e8723f34b4c1776e8: Status 404 returned error can't find the container with id 5bcd1f3a5750c48b429ecef94e4eb79e67b2e0da1445a08e8723f34b4c1776e8 Jul 20 18:23:27.676767 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.676710 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4"] Jul 20 18:23:27.679150 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.679135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.682366 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.682348 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c5z5w\"" Jul 20 18:23:27.682451 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.682374 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 20 18:23:27.682739 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.682719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 20 18:23:27.682812 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.682724 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 20 18:23:27.693855 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.693837 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4"] Jul 20 18:23:27.750513 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.750486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.750626 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.750528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.750626 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.750597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw7dq\" (UniqueName: \"kubernetes.io/projected/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-kube-api-access-gw7dq\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.750777 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.750664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.750777 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.750698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.750777 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.750729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.750891 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.750775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.851117 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.851088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.851264 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.851119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.851264 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.851141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.851264 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.851166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.851264 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.851195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.851264 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.851220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.851264 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.851240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw7dq\" (UniqueName: \"kubernetes.io/projected/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-kube-api-access-gw7dq\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.851922 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.851895 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.853374 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.853352 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.853527 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.853507 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.853622 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.853597 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.853891 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.853874 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.864569 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.864553 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.866730 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.866713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw7dq\" (UniqueName: \"kubernetes.io/projected/8d65cdcd-3d40-4b24-a44a-d1dba4a8a917-kube-api-access-gw7dq\") pod \"istiod-openshift-gateway-94bb8fbfd-8b2r4\" (UID: \"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:27.988900 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:27.988836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:28.120055 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:28.120021 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4"] Jul 20 18:23:28.125857 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:23:28.125829 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d65cdcd_3d40_4b24_a44a_d1dba4a8a917.slice/crio-203cb112bc989be352b8dd3b6c1e0be0b2c789d1621306e69b1a8fecf247bc61 WatchSource:0}: Error finding container 203cb112bc989be352b8dd3b6c1e0be0b2c789d1621306e69b1a8fecf247bc61: Status 404 returned error can't find the container with id 203cb112bc989be352b8dd3b6c1e0be0b2c789d1621306e69b1a8fecf247bc61 Jul 20 18:23:28.418274 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:28.418219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" event={"ID":"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917","Type":"ContainerStarted","Data":"203cb112bc989be352b8dd3b6c1e0be0b2c789d1621306e69b1a8fecf247bc61"} Jul 20 18:23:28.419523 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:28.419496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" event={"ID":"8d1a9ed4-5500-401a-8026-74359b0f024e","Type":"ContainerStarted","Data":"5bcd1f3a5750c48b429ecef94e4eb79e67b2e0da1445a08e8723f34b4c1776e8"} Jul 20 18:23:31.744310 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:31.744266 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:23:31.744554 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:31.744358 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:23:32.439937 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:32.439901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" event={"ID":"8d65cdcd-3d40-4b24-a44a-d1dba4a8a917","Type":"ContainerStarted","Data":"02c2e76a51641aadfeccc0f27279d0d4078eaa092a9654e83b4d3edcc881f847"} Jul 20 18:23:32.440205 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:32.440078 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:32.441839 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:32.441810 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-8b2r4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 18:23:32.441951 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:32.441867 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" podUID="8d65cdcd-3d40-4b24-a44a-d1dba4a8a917" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 18:23:32.469564 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:32.469514 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" podStartSLOduration=1.853680415 podStartE2EDuration="5.469496987s" totalImagesPullingTime="3.615816572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:32.467802105 +0000 UTC m=+606.787960426" watchObservedRunningTime="2026-07-20 18:23:32.469496987 +0000 UTC m=+606.789655307" Jul 20 18:23:32.859318 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:32.859284 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv"] Jul 20 18:23:33.444033 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:33.444006 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8b2r4" Jul 20 18:23:43.339780 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:43.339740 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:23:43.340099 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:43.339816 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:23:43.340099 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:43.339844 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:23:43.484564 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:43.484531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" event={"ID":"8d1a9ed4-5500-401a-8026-74359b0f024e","Type":"ContainerStarted","Data":"133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1"} Jul 20 18:23:43.484749 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:43.484609 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" podUID="8d1a9ed4-5500-401a-8026-74359b0f024e" containerName="istio-proxy" containerID="cri-o://133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1" gracePeriod=30 Jul 20 18:23:43.506372 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:43.506320 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" podStartSLOduration=0.731545657 podStartE2EDuration="16.506302699s" totalImagesPullingTime="15.774757042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:23:43.504486738 +0000 UTC m=+617.824645061" watchObservedRunningTime="2026-07-20 18:23:43.506302699 +0000 UTC m=+617.826461021" Jul 20 18:23:48.748493 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.748439 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:48.924596 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924562 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-certs\") pod \"8d1a9ed4-5500-401a-8026-74359b0f024e\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " Jul 20 18:23:48.924596 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924600 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-credential-socket\") pod \"8d1a9ed4-5500-401a-8026-74359b0f024e\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " Jul 20 18:23:48.924852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924625 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-token\") pod \"8d1a9ed4-5500-401a-8026-74359b0f024e\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " Jul 20 18:23:48.924852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924665 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-podinfo\") pod \"8d1a9ed4-5500-401a-8026-74359b0f024e\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " Jul 20 18:23:48.924852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924702 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-socket\") pod \"8d1a9ed4-5500-401a-8026-74359b0f024e\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " Jul 20 18:23:48.924852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924727 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d1a9ed4-5500-401a-8026-74359b0f024e-istiod-ca-cert\") pod \"8d1a9ed4-5500-401a-8026-74359b0f024e\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " Jul 20 18:23:48.924852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924763 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-data\") pod \"8d1a9ed4-5500-401a-8026-74359b0f024e\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " Jul 20 18:23:48.924852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924800 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4qxr\" (UniqueName: \"kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-kube-api-access-c4qxr\") pod \"8d1a9ed4-5500-401a-8026-74359b0f024e\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " Jul 20 18:23:48.924852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924848 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-envoy\") pod \"8d1a9ed4-5500-401a-8026-74359b0f024e\" (UID: \"8d1a9ed4-5500-401a-8026-74359b0f024e\") " Jul 20 18:23:48.925182 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924875 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d1a9ed4-5500-401a-8026-74359b0f024e" (UID: "8d1a9ed4-5500-401a-8026-74359b0f024e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:23:48.925182 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.924995 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d1a9ed4-5500-401a-8026-74359b0f024e" (UID: "8d1a9ed4-5500-401a-8026-74359b0f024e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:23:48.925182 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.925119 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-certs\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:23:48.925182 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.925139 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-credential-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:23:48.925390 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.925175 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d1a9ed4-5500-401a-8026-74359b0f024e" (UID: "8d1a9ed4-5500-401a-8026-74359b0f024e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:23:48.925390 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.925218 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1a9ed4-5500-401a-8026-74359b0f024e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d1a9ed4-5500-401a-8026-74359b0f024e" (UID: "8d1a9ed4-5500-401a-8026-74359b0f024e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:23:48.925390 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.925253 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d1a9ed4-5500-401a-8026-74359b0f024e" (UID: "8d1a9ed4-5500-401a-8026-74359b0f024e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:23:48.926992 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.926965 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d1a9ed4-5500-401a-8026-74359b0f024e" (UID: "8d1a9ed4-5500-401a-8026-74359b0f024e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:23:48.927097 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.927014 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d1a9ed4-5500-401a-8026-74359b0f024e" (UID: "8d1a9ed4-5500-401a-8026-74359b0f024e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:23:48.927245 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.927226 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d1a9ed4-5500-401a-8026-74359b0f024e" (UID: "8d1a9ed4-5500-401a-8026-74359b0f024e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 18:23:48.927284 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:48.927261 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-kube-api-access-c4qxr" (OuterVolumeSpecName: "kube-api-access-c4qxr") pod "8d1a9ed4-5500-401a-8026-74359b0f024e" (UID: "8d1a9ed4-5500-401a-8026-74359b0f024e"). InnerVolumeSpecName "kube-api-access-c4qxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:23:49.026328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.026257 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d1a9ed4-5500-401a-8026-74359b0f024e-istiod-ca-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:23:49.026328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.026285 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-data\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:23:49.026328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.026294 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4qxr\" (UniqueName: \"kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-kube-api-access-c4qxr\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:23:49.026328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.026304 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-envoy\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:23:49.026328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.026312 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-token\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:23:49.026328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.026319 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d1a9ed4-5500-401a-8026-74359b0f024e-istio-podinfo\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:23:49.026328 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.026327 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d1a9ed4-5500-401a-8026-74359b0f024e-workload-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:23:49.508465 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.508429 2576 generic.go:356] "Generic (PLEG): container finished" podID="8d1a9ed4-5500-401a-8026-74359b0f024e" containerID="133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1" exitCode=0 Jul 20 18:23:49.508629 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.508467 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" Jul 20 18:23:49.508629 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.508491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" event={"ID":"8d1a9ed4-5500-401a-8026-74359b0f024e","Type":"ContainerDied","Data":"133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1"} Jul 20 18:23:49.508629 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.508540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv" event={"ID":"8d1a9ed4-5500-401a-8026-74359b0f024e","Type":"ContainerDied","Data":"5bcd1f3a5750c48b429ecef94e4eb79e67b2e0da1445a08e8723f34b4c1776e8"} Jul 20 18:23:49.508629 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.508569 2576 scope.go:117] "RemoveContainer" containerID="133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1" Jul 20 18:23:49.517866 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.517851 2576 scope.go:117] "RemoveContainer" containerID="133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1" Jul 20 18:23:49.518092 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:23:49.518078 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1\": container with ID starting with 133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1 not found: ID does not exist" containerID="133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1" Jul 20 18:23:49.518129 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.518099 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1"} err="failed to get container status \"133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1\": rpc error: code = NotFound desc = could not find container \"133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1\": container with ID starting with 133b640cf1caa6203c934f8be21158a67af508f0e9ab3d48862255313a74a0c1 not found: ID does not exist" Jul 20 18:23:49.529688 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.529668 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv"] Jul 20 18:23:49.536283 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:49.536261 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-fl4mv"] Jul 20 18:23:50.272222 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:23:50.272183 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d1a9ed4-5500-401a-8026-74359b0f024e" path="/var/lib/kubelet/pods/8d1a9ed4-5500-401a-8026-74359b0f024e/volumes" Jul 20 18:25:17.389034 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:17.388999 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7654c94b6d-j78jc"] Jul 20 18:25:42.408712 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.408629 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7654c94b6d-j78jc" podUID="226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" containerName="console" containerID="cri-o://e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197" gracePeriod=15 Jul 20 18:25:42.651849 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.651826 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:25:42.772945 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.772859 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-serving-cert\") pod \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " Jul 20 18:25:42.772945 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.772929 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-service-ca\") pod \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " Jul 20 18:25:42.773136 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.772975 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-trusted-ca-bundle\") pod \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " Jul 20 18:25:42.773136 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.773006 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-config\") pod \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " Jul 20 18:25:42.773136 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.773037 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-oauth-serving-cert\") pod \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " Jul 20 18:25:42.773136 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.773072 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2htdf\" (UniqueName: \"kubernetes.io/projected/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-kube-api-access-2htdf\") pod \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " Jul 20 18:25:42.773136 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.773123 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-oauth-config\") pod \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\" (UID: \"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea\") " Jul 20 18:25:42.773369 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.773349 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" (UID: "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:25:42.773457 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.773426 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" (UID: "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:25:42.773523 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.773443 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" (UID: "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:25:42.773523 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.773458 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-config" (OuterVolumeSpecName: "console-config") pod "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" (UID: "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:25:42.775003 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.774973 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" (UID: "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 18:25:42.775287 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.775103 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-kube-api-access-2htdf" (OuterVolumeSpecName: "kube-api-access-2htdf") pod "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" (UID: "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea"). InnerVolumeSpecName "kube-api-access-2htdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:25:42.775347 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.775314 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" (UID: "226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 18:25:42.874259 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.874225 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-serving-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:25:42.874259 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.874258 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-service-ca\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:25:42.874259 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.874268 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-trusted-ca-bundle\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:25:42.874432 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.874277 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-config\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:25:42.874432 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.874287 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-oauth-serving-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:25:42.874432 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.874295 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2htdf\" (UniqueName: \"kubernetes.io/projected/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-kube-api-access-2htdf\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:25:42.874432 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.874305 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea-console-oauth-config\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:25:42.959965 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.959937 2576 generic.go:356] "Generic (PLEG): container finished" podID="226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" containerID="e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197" exitCode=0 Jul 20 18:25:42.960081 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.959983 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7654c94b6d-j78jc" Jul 20 18:25:42.960081 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.960031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7654c94b6d-j78jc" event={"ID":"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea","Type":"ContainerDied","Data":"e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197"} Jul 20 18:25:42.960205 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.960089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7654c94b6d-j78jc" event={"ID":"226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea","Type":"ContainerDied","Data":"f9c8f50b9f94c1a38aa69ed78aad2eba0cd10f1b82edc0d8332d56de5de5983c"} Jul 20 18:25:42.960205 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.960118 2576 scope.go:117] "RemoveContainer" containerID="e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197" Jul 20 18:25:42.970556 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.970534 2576 scope.go:117] "RemoveContainer" containerID="e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197" Jul 20 18:25:42.970840 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:25:42.970822 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197\": container with ID starting with e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197 not found: ID does not exist" containerID="e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197" Jul 20 18:25:42.970902 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.970848 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197"} err="failed to get container status \"e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197\": rpc error: code = NotFound desc = could not find container \"e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197\": container with ID starting with e10bc0d185cac85c42d362507a423463e357a5e77923fa1f8c100dce675ba197 not found: ID does not exist" Jul 20 18:25:42.992283 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.992254 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7654c94b6d-j78jc"] Jul 20 18:25:42.995158 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:42.995135 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7654c94b6d-j78jc"] Jul 20 18:25:44.271309 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:44.271278 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" path="/var/lib/kubelet/pods/226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea/volumes" Jul 20 18:25:54.041281 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.041245 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5"] Jul 20 18:25:54.041745 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.041495 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" containerName="console" Jul 20 18:25:54.041745 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.041507 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" containerName="console" Jul 20 18:25:54.041745 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.041529 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1a9ed4-5500-401a-8026-74359b0f024e" containerName="istio-proxy" Jul 20 18:25:54.041745 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.041535 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1a9ed4-5500-401a-8026-74359b0f024e" containerName="istio-proxy" Jul 20 18:25:54.041745 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.041575 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="226ee6ca-ebe8-42f9-9c49-9a4ce11cd7ea" containerName="console" Jul 20 18:25:54.041745 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.041581 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d1a9ed4-5500-401a-8026-74359b0f024e" containerName="istio-proxy" Jul 20 18:25:54.044260 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.044243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.049044 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.049019 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lklrd\"" Jul 20 18:25:54.064264 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.064245 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5"] Jul 20 18:25:54.161580 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.161554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgq72\" (UniqueName: \"kubernetes.io/projected/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-kube-api-access-dgq72\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.161723 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.161591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.161723 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.161612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.161723 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.161633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.161723 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.161709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.161854 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.161758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.161854 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.161814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.161854 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.161849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.161950 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.161878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263035 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgq72\" (UniqueName: \"kubernetes.io/projected/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-kube-api-access-dgq72\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263167 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263167 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263063 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263167 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263287 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263287 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263389 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263389 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263389 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263527 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263448 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263527 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263497 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263658 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263617 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.263838 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.263817 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.264062 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.264040 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.265616 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.265596 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.265771 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.265752 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.271420 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.271398 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.272170 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.272147 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgq72\" (UniqueName: \"kubernetes.io/projected/4f810006-09fa-4f3f-88d5-0ee7cfe8d68f-kube-api-access-dgq72\") pod \"maas-default-gateway-openshift-default-56654dcf7-49kt5\" (UID: \"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.353843 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.353816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:54.485233 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.485206 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5"] Jul 20 18:25:54.487318 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:25:54.487291 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f810006_09fa_4f3f_88d5_0ee7cfe8d68f.slice/crio-5021577ce8e08e3a84083dc3de4c4082722d1e3d10419e4ac823665976b8365b WatchSource:0}: Error finding container 5021577ce8e08e3a84083dc3de4c4082722d1e3d10419e4ac823665976b8365b: Status 404 returned error can't find the container with id 5021577ce8e08e3a84083dc3de4c4082722d1e3d10419e4ac823665976b8365b Jul 20 18:25:54.489964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.489925 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:25:54.490054 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.489999 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:25:54.490054 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:54.490031 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:25:55.015554 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:55.015514 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" event={"ID":"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f","Type":"ContainerStarted","Data":"1d1aa304918247c5958d6a8eab38bb0cda1aff87b7844d8b239f6dc65badf808"} Jul 20 18:25:55.015724 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:55.015608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" event={"ID":"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f","Type":"ContainerStarted","Data":"5021577ce8e08e3a84083dc3de4c4082722d1e3d10419e4ac823665976b8365b"} Jul 20 18:25:55.043451 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:55.043404 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" podStartSLOduration=1.043390748 podStartE2EDuration="1.043390748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:25:55.040814594 +0000 UTC m=+749.360972915" watchObservedRunningTime="2026-07-20 18:25:55.043390748 +0000 UTC m=+749.363549068" Jul 20 18:25:55.354153 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:55.354118 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:55.359132 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:55.359106 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:56.019973 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:56.019945 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:25:56.020844 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:25:56.020824 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:27:13.923320 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:13.923237 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jb52w"] Jul 20 18:27:13.926489 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:13.926471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" Jul 20 18:27:13.933100 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:13.933080 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 20 18:27:13.933100 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:13.933091 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k8wjx\"" Jul 20 18:27:13.945732 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:13.945710 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jb52w"] Jul 20 18:27:14.090584 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:14.090553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fe407c8-8201-4e43-9efe-1c4fc2602ec2-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jb52w\" (UID: \"6fe407c8-8201-4e43-9efe-1c4fc2602ec2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" Jul 20 18:27:14.090764 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:14.090625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vlv8\" (UniqueName: \"kubernetes.io/projected/6fe407c8-8201-4e43-9efe-1c4fc2602ec2-kube-api-access-6vlv8\") pod \"payload-pre-processing-7677b774bb-jb52w\" (UID: \"6fe407c8-8201-4e43-9efe-1c4fc2602ec2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" Jul 20 18:27:14.191572 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:14.191492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fe407c8-8201-4e43-9efe-1c4fc2602ec2-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jb52w\" (UID: \"6fe407c8-8201-4e43-9efe-1c4fc2602ec2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" Jul 20 18:27:14.191780 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:14.191688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vlv8\" (UniqueName: \"kubernetes.io/projected/6fe407c8-8201-4e43-9efe-1c4fc2602ec2-kube-api-access-6vlv8\") pod \"payload-pre-processing-7677b774bb-jb52w\" (UID: \"6fe407c8-8201-4e43-9efe-1c4fc2602ec2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" Jul 20 18:27:14.192326 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:14.192305 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fe407c8-8201-4e43-9efe-1c4fc2602ec2-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jb52w\" (UID: \"6fe407c8-8201-4e43-9efe-1c4fc2602ec2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" Jul 20 18:27:14.270145 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:14.270118 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vlv8\" (UniqueName: \"kubernetes.io/projected/6fe407c8-8201-4e43-9efe-1c4fc2602ec2-kube-api-access-6vlv8\") pod \"payload-pre-processing-7677b774bb-jb52w\" (UID: \"6fe407c8-8201-4e43-9efe-1c4fc2602ec2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" Jul 20 18:27:14.536656 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:14.536556 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" Jul 20 18:27:14.726336 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:14.726306 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jb52w"] Jul 20 18:27:14.728618 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:27:14.728588 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe407c8_8201_4e43_9efe_1c4fc2602ec2.slice/crio-e915ce799fa70c820ccc6b6d1e4660376782371c53c7a4b91b2fa34c264e5211 WatchSource:0}: Error finding container e915ce799fa70c820ccc6b6d1e4660376782371c53c7a4b91b2fa34c264e5211: Status 404 returned error can't find the container with id e915ce799fa70c820ccc6b6d1e4660376782371c53c7a4b91b2fa34c264e5211 Jul 20 18:27:14.730463 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:14.730446 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 18:27:15.333067 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:15.333029 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" event={"ID":"6fe407c8-8201-4e43-9efe-1c4fc2602ec2","Type":"ContainerStarted","Data":"e915ce799fa70c820ccc6b6d1e4660376782371c53c7a4b91b2fa34c264e5211"} Jul 20 18:27:17.346576 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:17.346535 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" event={"ID":"6fe407c8-8201-4e43-9efe-1c4fc2602ec2","Type":"ContainerStarted","Data":"714f7f58a02f3af7994d78cd0d4ea3863adfc5ad7246f97358985348b161b41c"} Jul 20 18:27:17.348064 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:17.348042 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" Jul 20 18:27:17.390292 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:17.390245 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" podStartSLOduration=2.63985923 podStartE2EDuration="4.390230518s" totalImagesPullingTime="1.750371288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:27:17.389819569 +0000 UTC m=+831.709977884" watchObservedRunningTime="2026-07-20 18:27:17.390230518 +0000 UTC m=+831.710388837" Jul 20 18:27:21.366136 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:21.366106 2576 generic.go:356] "Generic (PLEG): container finished" podID="4f810006-09fa-4f3f-88d5-0ee7cfe8d68f" containerID="1d1aa304918247c5958d6a8eab38bb0cda1aff87b7844d8b239f6dc65badf808" exitCode=0 Jul 20 18:27:21.366677 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:21.366165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" event={"ID":"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f","Type":"ContainerDied","Data":"1d1aa304918247c5958d6a8eab38bb0cda1aff87b7844d8b239f6dc65badf808"} Jul 20 18:27:21.366754 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:21.366675 2576 scope.go:117] "RemoveContainer" containerID="1d1aa304918247c5958d6a8eab38bb0cda1aff87b7844d8b239f6dc65badf808" Jul 20 18:27:21.367598 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:21.367572 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:27:21.367673 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:21.367652 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:27:21.367716 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:21.367687 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:27:22.373185 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:22.373147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" event={"ID":"4f810006-09fa-4f3f-88d5-0ee7cfe8d68f","Type":"ContainerStarted","Data":"391ee5513ab17a7d5e7af1c9a6f303613b662ce60917ae22060474620e339291"} Jul 20 18:27:23.355067 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:23.355034 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:27:23.355440 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:23.355416 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-49kt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 20 18:27:23.355612 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:23.355589 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" podUID="4f810006-09fa-4f3f-88d5-0ee7cfe8d68f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 20 18:27:24.355007 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:24.354967 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-49kt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 20 18:27:24.355483 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:24.355032 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" podUID="4f810006-09fa-4f3f-88d5-0ee7cfe8d68f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 20 18:27:25.355013 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:25.354979 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-49kt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 20 18:27:25.355566 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:25.355533 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" podUID="4f810006-09fa-4f3f-88d5-0ee7cfe8d68f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 20 18:27:26.020786 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:26.020761 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:27:26.358237 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:26.358207 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:27:26.390961 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:26.390936 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-49kt5" Jul 20 18:27:29.358690 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:27:29.358655 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-jb52w" Jul 20 18:28:04.776955 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.776925 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk"] Jul 20 18:28:04.780197 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.780173 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.782945 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.782919 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 20 18:28:04.783754 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.783732 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 20 18:28:04.783903 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.783866 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 20 18:28:04.783980 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.783946 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-79fz4\"" Jul 20 18:28:04.794400 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.794339 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk"] Jul 20 18:28:04.896195 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.896160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.896195 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.896199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9plx\" (UniqueName: \"kubernetes.io/projected/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-kube-api-access-p9plx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.896400 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.896219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.896400 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.896257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.896400 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.896281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.896400 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.896302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.997000 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.996955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.997000 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.997005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.997228 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.997052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.997228 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.997069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9plx\" (UniqueName: \"kubernetes.io/projected/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-kube-api-access-p9plx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.997228 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.997089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.997228 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.997120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.997414 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.997367 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.997468 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.997429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.997516 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.997499 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.999365 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.999339 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:04.999665 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:04.999616 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:05.005796 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:05.005775 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9plx\" (UniqueName: \"kubernetes.io/projected/0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a-kube-api-access-p9plx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bj8bk\" (UID: \"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:05.091493 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:05.091389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:05.224323 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:05.224297 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk"] Jul 20 18:28:05.226735 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:28:05.226701 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0efe2778_3f4d_4d17_9a19_2fd2ff8fdb5a.slice/crio-3a2372d33d2d724146607f12537bdc5970b6f20021b18039954723d007347e87 WatchSource:0}: Error finding container 3a2372d33d2d724146607f12537bdc5970b6f20021b18039954723d007347e87: Status 404 returned error can't find the container with id 3a2372d33d2d724146607f12537bdc5970b6f20021b18039954723d007347e87 Jul 20 18:28:05.546827 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:05.546750 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" event={"ID":"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a","Type":"ContainerStarted","Data":"3a2372d33d2d724146607f12537bdc5970b6f20021b18039954723d007347e87"} Jul 20 18:28:06.551779 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:06.551745 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" event={"ID":"0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a","Type":"ContainerStarted","Data":"b38001cbfc2e4af2afbd0378ecddccb8fb7b9916a0e52278d3f822f4230d2542"} Jul 20 18:28:06.571007 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:06.570907 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" podStartSLOduration=1.490552089 podStartE2EDuration="2.570891907s" totalImagesPullingTime="1.080339818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:28:06.569731363 +0000 UTC m=+880.889889684" watchObservedRunningTime="2026-07-20 18:28:06.570891907 +0000 UTC m=+880.891050227" Jul 20 18:28:15.091557 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:15.091517 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:15.092058 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:15.091584 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:15.104367 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:15.104342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:15.600968 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:15.600930 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bj8bk" Jul 20 18:28:17.313867 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.313831 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p"] Jul 20 18:28:17.317208 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.317191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.321068 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.321047 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 20 18:28:17.348240 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.348214 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p"] Jul 20 18:28:17.407837 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.407808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.407964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.407874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e837609-9407-49a3-934d-ba67bfb5092f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.408087 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.408069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.408173 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.408098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.408173 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.408116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cxbh\" (UniqueName: \"kubernetes.io/projected/6e837609-9407-49a3-934d-ba67bfb5092f-kube-api-access-7cxbh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.408173 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.408155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.509026 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.508994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.509026 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.509030 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cxbh\" (UniqueName: \"kubernetes.io/projected/6e837609-9407-49a3-934d-ba67bfb5092f-kube-api-access-7cxbh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.509273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.509050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.509273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.509121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.509273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.509158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e837609-9407-49a3-934d-ba67bfb5092f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.509273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.509208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.509525 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.509508 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.509582 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.509559 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.509631 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.509571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.511354 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.511331 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e837609-9407-49a3-934d-ba67bfb5092f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.511766 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.511743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e837609-9407-49a3-934d-ba67bfb5092f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.517365 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.517346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cxbh\" (UniqueName: \"kubernetes.io/projected/6e837609-9407-49a3-934d-ba67bfb5092f-kube-api-access-7cxbh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6z29p\" (UID: \"6e837609-9407-49a3-934d-ba67bfb5092f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.646738 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.646632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:17.780054 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:17.780030 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p"] Jul 20 18:28:17.781738 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:28:17.781705 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e837609_9407_49a3_934d_ba67bfb5092f.slice/crio-42570267d5c95776eee5607d2878a1a5fc95529a0a31e8727d323e9c7b91e6b0 WatchSource:0}: Error finding container 42570267d5c95776eee5607d2878a1a5fc95529a0a31e8727d323e9c7b91e6b0: Status 404 returned error can't find the container with id 42570267d5c95776eee5607d2878a1a5fc95529a0a31e8727d323e9c7b91e6b0 Jul 20 18:28:18.603928 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:18.603893 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" event={"ID":"6e837609-9407-49a3-934d-ba67bfb5092f","Type":"ContainerStarted","Data":"ab98fbfe838b6c88197d98bed94e2fd11012863638857186e6b7ff3b50ecff61"} Jul 20 18:28:18.604299 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:18.603945 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" event={"ID":"6e837609-9407-49a3-934d-ba67bfb5092f","Type":"ContainerStarted","Data":"42570267d5c95776eee5607d2878a1a5fc95529a0a31e8727d323e9c7b91e6b0"} Jul 20 18:28:26.132773 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:26.132746 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:28:26.133631 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:26.133613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:28:27.647494 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:27.647462 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:27.647926 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:27.647508 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:27.659866 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:27.659845 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:27.680285 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:27.680244 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" podStartSLOduration=10.489263963 podStartE2EDuration="10.680230881s" totalImagesPullingTime="190.966918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:28:18.679086521 +0000 UTC m=+892.999244844" watchObservedRunningTime="2026-07-20 18:28:27.680230881 +0000 UTC m=+902.000389200" Jul 20 18:28:28.654295 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:28.654265 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6z29p" Jul 20 18:28:30.122439 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.122405 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m"] Jul 20 18:28:30.125490 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.125475 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.128043 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.128020 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 20 18:28:30.137605 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.137585 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m"] Jul 20 18:28:30.209908 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.209880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.209908 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.209911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.210048 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.209987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpd48\" (UniqueName: \"kubernetes.io/projected/d970eadf-8b3a-400f-af67-d72f3d346f55-kube-api-access-dpd48\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.210048 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.210015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.210048 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.210035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d970eadf-8b3a-400f-af67-d72f3d346f55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.210154 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.210077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.311024 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.310990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpd48\" (UniqueName: \"kubernetes.io/projected/d970eadf-8b3a-400f-af67-d72f3d346f55-kube-api-access-dpd48\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.311024 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.311026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.311251 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.311045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d970eadf-8b3a-400f-af67-d72f3d346f55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.311251 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.311076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.311251 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.311100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.311251 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.311115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.311518 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.311489 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.311596 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.311517 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.311596 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.311537 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.313331 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.313310 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d970eadf-8b3a-400f-af67-d72f3d346f55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.313453 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.313436 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d970eadf-8b3a-400f-af67-d72f3d346f55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.320791 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.320769 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpd48\" (UniqueName: \"kubernetes.io/projected/d970eadf-8b3a-400f-af67-d72f3d346f55-kube-api-access-dpd48\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m\" (UID: \"d970eadf-8b3a-400f-af67-d72f3d346f55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.435739 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.435685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:30.574577 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.574554 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m"] Jul 20 18:28:30.576767 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:28:30.576746 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd970eadf_8b3a_400f_af67_d72f3d346f55.slice/crio-ee1fbf5721351791c63c9192fae4c28d5d1db5040b95615591ede9749b914d85 WatchSource:0}: Error finding container ee1fbf5721351791c63c9192fae4c28d5d1db5040b95615591ede9749b914d85: Status 404 returned error can't find the container with id ee1fbf5721351791c63c9192fae4c28d5d1db5040b95615591ede9749b914d85 Jul 20 18:28:30.652027 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:30.651996 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" event={"ID":"d970eadf-8b3a-400f-af67-d72f3d346f55","Type":"ContainerStarted","Data":"ee1fbf5721351791c63c9192fae4c28d5d1db5040b95615591ede9749b914d85"} Jul 20 18:28:31.658096 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:31.658063 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" event={"ID":"d970eadf-8b3a-400f-af67-d72f3d346f55","Type":"ContainerStarted","Data":"1a32c00328be408278342f569531020d3ee1e328f491ad350448ca279a3b7208"} Jul 20 18:28:31.698337 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:31.698287 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" podStartSLOduration=1.396712957 podStartE2EDuration="1.698271423s" totalImagesPullingTime="301.558466ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:28:31.694857783 +0000 UTC m=+906.015016103" watchObservedRunningTime="2026-07-20 18:28:31.698271423 +0000 UTC m=+906.018429742" Jul 20 18:28:40.436574 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:40.436535 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:40.437091 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:40.436618 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:40.449107 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:40.449087 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:28:40.704687 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:28:40.704604 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m" Jul 20 18:33:26.155531 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:33:26.155490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:33:26.157321 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:33:26.157299 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:38:26.183016 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:38:26.182984 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:38:26.183547 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:38:26.183443 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:43:26.208327 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:43:26.208295 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:43:26.210105 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:43:26.210081 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:46:37.640036 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.640001 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh"] Jul 20 18:46:37.643309 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.643292 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.649298 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.649274 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4cc2704b-gw-openshift-default-dockercfg-cwtjz\"" Jul 20 18:46:37.657883 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.657859 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh"] Jul 20 18:46:37.658166 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.658146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-certs\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.658275 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.658181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-podinfo\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.658275 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.658210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istiod-ca-cert\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.658275 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.658242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-credential-socket\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.658448 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.658329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smdwg\" (UniqueName: \"kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-kube-api-access-smdwg\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.658448 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.658363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-token\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.658448 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.658399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-socket\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.658448 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.658429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-data\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.658580 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.658460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-envoy\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759363 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-envoy\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759363 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-certs\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759603 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-podinfo\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759603 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istiod-ca-cert\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759603 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-credential-socket\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759603 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smdwg\" (UniqueName: \"kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-kube-api-access-smdwg\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759603 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-token\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759603 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-socket\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759936 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-data\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759936 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759815 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-certs\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.759936 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759893 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-credential-socket\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.760078 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.759945 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-data\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.760194 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.760163 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-socket\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.760488 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.760469 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istiod-ca-cert\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.761763 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.761742 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-envoy\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.762213 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.762192 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-podinfo\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.770091 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.770069 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-token\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.770931 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.770912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smdwg\" (UniqueName: \"kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-kube-api-access-smdwg\") pod \"e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:37.953606 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:37.953548 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:38.089537 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:38.089304 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh"] Jul 20 18:46:38.091702 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:46:38.091668 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4a7253_3d6a_47b9_b55b_b090c79c49ba.slice/crio-47dbc60a471490c67c0cf5a90968d52156b78b702650e1ba18dbf04f2e3dc34c WatchSource:0}: Error finding container 47dbc60a471490c67c0cf5a90968d52156b78b702650e1ba18dbf04f2e3dc34c: Status 404 returned error can't find the container with id 47dbc60a471490c67c0cf5a90968d52156b78b702650e1ba18dbf04f2e3dc34c Jul 20 18:46:38.093712 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:38.093680 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:46:38.093801 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:38.093746 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:46:38.093801 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:38.093776 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:46:38.163963 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:38.163940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" event={"ID":"8e4a7253-3d6a-47b9-b55b-b090c79c49ba","Type":"ContainerStarted","Data":"d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5"} Jul 20 18:46:38.164057 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:38.163987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" event={"ID":"8e4a7253-3d6a-47b9-b55b-b090c79c49ba","Type":"ContainerStarted","Data":"47dbc60a471490c67c0cf5a90968d52156b78b702650e1ba18dbf04f2e3dc34c"} Jul 20 18:46:38.184174 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:38.183978 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" podStartSLOduration=1.18395968 podStartE2EDuration="1.18395968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:46:38.183720131 +0000 UTC m=+1992.503878492" watchObservedRunningTime="2026-07-20 18:46:38.18395968 +0000 UTC m=+1992.504118004" Jul 20 18:46:38.954366 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:38.954331 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:39.958849 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:39.958820 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:40.173151 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:40.173115 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:40.174106 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:40.174086 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:54.231908 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:54.231818 2576 generic.go:356] "Generic (PLEG): container finished" podID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerID="d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5" exitCode=0 Jul 20 18:46:54.231908 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:54.231872 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" event={"ID":"8e4a7253-3d6a-47b9-b55b-b090c79c49ba","Type":"ContainerDied","Data":"d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5"} Jul 20 18:46:54.232316 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:54.232212 2576 scope.go:117] "RemoveContainer" containerID="d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5" Jul 20 18:46:54.233171 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:54.233143 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:46:54.233228 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:54.233211 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:46:54.233263 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:54.233240 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:46:55.173753 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:55.173725 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:55.240605 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:55.240567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" event={"ID":"8e4a7253-3d6a-47b9-b55b-b090c79c49ba","Type":"ContainerStarted","Data":"145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5"} Jul 20 18:46:55.955408 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:55.954961 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:55.955408 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:55.955081 2576 patch_prober.go:28] interesting pod/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 18:46:55.955408 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:55.955137 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 18:46:56.954539 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:56.954501 2576 patch_prober.go:28] interesting pod/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 18:46:56.955149 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:56.955115 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 18:46:57.954752 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:57.954707 2576 patch_prober.go:28] interesting pod/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 18:46:57.955235 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:57.954774 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 18:46:58.954476 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:58.954425 2576 patch_prober.go:28] interesting pod/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 20 18:46:58.954705 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:58.954498 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 20 18:46:59.957906 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:59.957874 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:59.958307 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:59.958156 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:46:59.958995 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:46:59.958978 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:47:19.962633 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:19.962597 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh"] Jul 20 18:47:19.963057 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:19.962868 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" containerID="cri-o://145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5" gracePeriod=30 Jul 20 18:47:25.206573 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.206548 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:47:25.252125 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252060 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-podinfo\") pod \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " Jul 20 18:47:25.252125 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252119 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-credential-socket\") pod \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " Jul 20 18:47:25.252305 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252145 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-token\") pod \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " Jul 20 18:47:25.252305 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252187 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smdwg\" (UniqueName: \"kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-kube-api-access-smdwg\") pod \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " Jul 20 18:47:25.252305 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252218 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-socket\") pod \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " Jul 20 18:47:25.252305 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252264 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-data\") pod \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " Jul 20 18:47:25.254273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252304 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-certs\") pod \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " Jul 20 18:47:25.254273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252619 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e4a7253-3d6a-47b9-b55b-b090c79c49ba" (UID: "8e4a7253-3d6a-47b9-b55b-b090c79c49ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:47:25.254273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252633 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-envoy\") pod \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " Jul 20 18:47:25.254273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252723 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istiod-ca-cert\") pod \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\" (UID: \"8e4a7253-3d6a-47b9-b55b-b090c79c49ba\") " Jul 20 18:47:25.254273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.252955 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e4a7253-3d6a-47b9-b55b-b090c79c49ba" (UID: "8e4a7253-3d6a-47b9-b55b-b090c79c49ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:47:25.254273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.253009 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-credential-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:47:25.254273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.253312 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e4a7253-3d6a-47b9-b55b-b090c79c49ba" (UID: "8e4a7253-3d6a-47b9-b55b-b090c79c49ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:47:25.254273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.253373 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e4a7253-3d6a-47b9-b55b-b090c79c49ba" (UID: "8e4a7253-3d6a-47b9-b55b-b090c79c49ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:47:25.254273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.253459 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e4a7253-3d6a-47b9-b55b-b090c79c49ba" (UID: "8e4a7253-3d6a-47b9-b55b-b090c79c49ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:47:25.255221 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.255186 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e4a7253-3d6a-47b9-b55b-b090c79c49ba" (UID: "8e4a7253-3d6a-47b9-b55b-b090c79c49ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 18:47:25.255821 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.255777 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-kube-api-access-smdwg" (OuterVolumeSpecName: "kube-api-access-smdwg") pod "8e4a7253-3d6a-47b9-b55b-b090c79c49ba" (UID: "8e4a7253-3d6a-47b9-b55b-b090c79c49ba"). InnerVolumeSpecName "kube-api-access-smdwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:47:25.255821 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.255777 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e4a7253-3d6a-47b9-b55b-b090c79c49ba" (UID: "8e4a7253-3d6a-47b9-b55b-b090c79c49ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:47:25.256669 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.256615 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e4a7253-3d6a-47b9-b55b-b090c79c49ba" (UID: "8e4a7253-3d6a-47b9-b55b-b090c79c49ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:47:25.354142 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.354116 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-certs\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:47:25.354142 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.354141 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-envoy\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:47:25.354307 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.354150 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istiod-ca-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:47:25.354307 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.354158 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-podinfo\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:47:25.354307 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.354165 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-token\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:47:25.354307 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.354174 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smdwg\" (UniqueName: \"kubernetes.io/projected/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-kube-api-access-smdwg\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:47:25.354307 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.354183 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-workload-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:47:25.354307 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.354191 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e4a7253-3d6a-47b9-b55b-b090c79c49ba-istio-data\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:47:25.368521 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.368484 2576 generic.go:356] "Generic (PLEG): container finished" podID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerID="145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5" exitCode=0 Jul 20 18:47:25.368795 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.368597 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" Jul 20 18:47:25.368795 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.368618 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" event={"ID":"8e4a7253-3d6a-47b9-b55b-b090c79c49ba","Type":"ContainerDied","Data":"145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5"} Jul 20 18:47:25.368795 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.368693 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh" event={"ID":"8e4a7253-3d6a-47b9-b55b-b090c79c49ba","Type":"ContainerDied","Data":"47dbc60a471490c67c0cf5a90968d52156b78b702650e1ba18dbf04f2e3dc34c"} Jul 20 18:47:25.368795 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.368724 2576 scope.go:117] "RemoveContainer" containerID="145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5" Jul 20 18:47:25.377964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.377848 2576 scope.go:117] "RemoveContainer" containerID="d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5" Jul 20 18:47:25.385487 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.385470 2576 scope.go:117] "RemoveContainer" containerID="145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5" Jul 20 18:47:25.385761 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:47:25.385743 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5\": container with ID starting with 145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5 not found: ID does not exist" containerID="145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5" Jul 20 18:47:25.385819 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.385769 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5"} err="failed to get container status \"145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5\": rpc error: code = NotFound desc = could not find container \"145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5\": container with ID starting with 145ec9ee4299cb3752617e6781cced86f0ba4d85ed1c0094b72adc550c2532b5 not found: ID does not exist" Jul 20 18:47:25.385819 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.385785 2576 scope.go:117] "RemoveContainer" containerID="d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5" Jul 20 18:47:25.386024 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:47:25.386007 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5\": container with ID starting with d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5 not found: ID does not exist" containerID="d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5" Jul 20 18:47:25.386063 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.386029 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5"} err="failed to get container status \"d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5\": rpc error: code = NotFound desc = could not find container \"d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5\": container with ID starting with d95f57559b7ef7db1f25b8c5b8b376dc5218af5ac043eda5222b719f726327a5 not found: ID does not exist" Jul 20 18:47:25.391937 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.391917 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh"] Jul 20 18:47:25.399312 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:25.399293 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4cc2704b-gw-openshift-default-5c845f4855-zs7xh"] Jul 20 18:47:26.272329 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:47:26.272301 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" path="/var/lib/kubelet/pods/8e4a7253-3d6a-47b9-b55b-b090c79c49ba/volumes" Jul 20 18:48:06.291200 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.291125 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767"] Jul 20 18:48:06.291668 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.291522 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" Jul 20 18:48:06.291668 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.291536 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" Jul 20 18:48:06.291668 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.291560 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" Jul 20 18:48:06.291668 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.291569 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" Jul 20 18:48:06.291668 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.291664 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" Jul 20 18:48:06.291849 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.291677 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e4a7253-3d6a-47b9-b55b-b090c79c49ba" containerName="istio-proxy" Jul 20 18:48:06.294411 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.294392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.297677 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.297631 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-264f7364-openshift-default-dockercfg-z9l7c\"" Jul 20 18:48:06.320288 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.320258 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767"] Jul 20 18:48:06.412543 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.412515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6k7t\" (UniqueName: \"kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-kube-api-access-g6k7t\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.412737 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.412565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-socket\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.412737 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.412590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-credential-socket\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.412737 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.412611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-certs\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.412851 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.412735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-envoy\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.412851 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.412774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-data\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.412851 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.412829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-token\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.412964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.412857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-podinfo\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.412964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.412885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istiod-ca-cert\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513249 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-envoy\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513369 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-data\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513369 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-token\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513447 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-podinfo\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513500 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istiod-ca-cert\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513553 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6k7t\" (UniqueName: \"kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-kube-api-access-g6k7t\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513600 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-socket\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513675 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-credential-socket\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513734 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513687 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-data\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513792 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-certs\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.513943 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.513920 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-socket\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.514082 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.514057 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-certs\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.514202 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.514134 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-credential-socket\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.514202 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.514157 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istiod-ca-cert\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.515636 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.515618 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-envoy\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.516244 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.516227 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-podinfo\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.523074 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.523051 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-token\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.523418 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.523400 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6k7t\" (UniqueName: \"kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-kube-api-access-g6k7t\") pod \"e2e-derive-264f7364-openshift-default-7487d88fcf-h9767\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.604154 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.604131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:06.746005 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.745979 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767"] Jul 20 18:48:06.748426 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:48:06.748402 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff1ac06_26e9_4b7f_8fa1_305fb1764e52.slice/crio-b9668e4ac56419daa8090adaa78872a7d883cf1fe737e10cb624def84270a0d9 WatchSource:0}: Error finding container b9668e4ac56419daa8090adaa78872a7d883cf1fe737e10cb624def84270a0d9: Status 404 returned error can't find the container with id b9668e4ac56419daa8090adaa78872a7d883cf1fe737e10cb624def84270a0d9 Jul 20 18:48:06.750508 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.750469 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:48:06.750585 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.750536 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:48:06.750585 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:06.750564 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:48:07.543412 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:07.543379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" event={"ID":"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52","Type":"ContainerStarted","Data":"509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07"} Jul 20 18:48:07.543783 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:07.543440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" event={"ID":"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52","Type":"ContainerStarted","Data":"b9668e4ac56419daa8090adaa78872a7d883cf1fe737e10cb624def84270a0d9"} Jul 20 18:48:07.565278 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:07.565224 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" podStartSLOduration=1.565206459 podStartE2EDuration="1.565206459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:48:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:48:07.564479652 +0000 UTC m=+2081.884637972" watchObservedRunningTime="2026-07-20 18:48:07.565206459 +0000 UTC m=+2081.885364780" Jul 20 18:48:07.605091 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:07.605062 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:07.609624 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:07.609603 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:08.547467 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:08.547433 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:08.548483 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:08.548462 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:21.603054 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:21.603017 2576 generic.go:356] "Generic (PLEG): container finished" podID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerID="509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07" exitCode=0 Jul 20 18:48:21.603544 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:21.603098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" event={"ID":"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52","Type":"ContainerDied","Data":"509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07"} Jul 20 18:48:21.603628 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:21.603611 2576 scope.go:117] "RemoveContainer" containerID="509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07" Jul 20 18:48:21.604621 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:21.604596 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:48:21.604731 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:21.604672 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:48:21.604731 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:21.604703 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:48:22.608878 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:22.608844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" event={"ID":"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52","Type":"ContainerStarted","Data":"122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b"} Jul 20 18:48:23.547841 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:23.547797 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:23.604609 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:23.604573 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:23.605830 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:23.605804 2576 patch_prober.go:28] interesting pod/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 20 18:48:23.605930 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:23.605864 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 20 18:48:24.605383 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:24.605345 2576 patch_prober.go:28] interesting pod/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 20 18:48:24.605821 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:24.605404 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 20 18:48:25.605292 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:25.605249 2576 patch_prober.go:28] interesting pod/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 20 18:48:25.605509 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:25.605316 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 20 18:48:26.231476 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:26.231443 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:48:26.235953 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:26.235931 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:48:26.608459 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:26.608429 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:26.609504 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:26.609484 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:49.077699 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:49.077633 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767"] Jul 20 18:48:49.078176 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:49.077886 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerName="istio-proxy" containerID="cri-o://122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b" gracePeriod=30 Jul 20 18:48:54.340679 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.340590 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:54.441760 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.441722 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-credential-socket\") pod \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " Jul 20 18:48:54.441760 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.441762 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-envoy\") pod \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " Jul 20 18:48:54.441993 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.441820 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-data\") pod \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " Jul 20 18:48:54.441993 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.441847 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-podinfo\") pod \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " Jul 20 18:48:54.441993 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.441886 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-socket\") pod \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " Jul 20 18:48:54.441993 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.441962 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6k7t\" (UniqueName: \"kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-kube-api-access-g6k7t\") pod \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " Jul 20 18:48:54.441993 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.441986 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istiod-ca-cert\") pod \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " Jul 20 18:48:54.442236 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.442015 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-certs\") pod \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " Jul 20 18:48:54.442236 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.442038 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-token\") pod \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\" (UID: \"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52\") " Jul 20 18:48:54.442236 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.442053 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" (UID: "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:48:54.442382 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.442301 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" (UID: "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:48:54.442382 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.442311 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-credential-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:48:54.442382 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.442316 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" (UID: "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:48:54.442492 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.442397 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" (UID: "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:48:54.442980 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.442954 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" (UID: "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:48:54.444283 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.444247 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" (UID: "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 18:48:54.444384 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.444279 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" (UID: "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:48:54.444731 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.444696 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-kube-api-access-g6k7t" (OuterVolumeSpecName: "kube-api-access-g6k7t") pod "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" (UID: "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52"). InnerVolumeSpecName "kube-api-access-g6k7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:48:54.444731 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.444711 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" (UID: "8ff1ac06-26e9-4b7f-8fa1-305fb1764e52"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:48:54.543551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.543509 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:48:54.543551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.543544 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6k7t\" (UniqueName: \"kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-kube-api-access-g6k7t\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:48:54.543551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.543557 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istiod-ca-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:48:54.543825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.543568 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-workload-certs\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:48:54.543825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.543578 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-token\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:48:54.543825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.543586 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-envoy\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:48:54.543825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.543617 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-data\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:48:54.543825 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.543626 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52-istio-podinfo\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:48:54.749167 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.749134 2576 generic.go:356] "Generic (PLEG): container finished" podID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerID="122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b" exitCode=0 Jul 20 18:48:54.749343 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.749184 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" Jul 20 18:48:54.749343 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.749217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" event={"ID":"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52","Type":"ContainerDied","Data":"122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b"} Jul 20 18:48:54.749343 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.749273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767" event={"ID":"8ff1ac06-26e9-4b7f-8fa1-305fb1764e52","Type":"ContainerDied","Data":"b9668e4ac56419daa8090adaa78872a7d883cf1fe737e10cb624def84270a0d9"} Jul 20 18:48:54.749343 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.749297 2576 scope.go:117] "RemoveContainer" containerID="122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b" Jul 20 18:48:54.758479 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.758460 2576 scope.go:117] "RemoveContainer" containerID="509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07" Jul 20 18:48:54.767004 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.766982 2576 scope.go:117] "RemoveContainer" containerID="122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b" Jul 20 18:48:54.767290 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:48:54.767273 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b\": container with ID starting with 122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b not found: ID does not exist" containerID="122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b" Jul 20 18:48:54.767327 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.767298 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b"} err="failed to get container status \"122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b\": rpc error: code = NotFound desc = could not find container \"122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b\": container with ID starting with 122dbf02a159563d56dd967961632d1a67b7fefd38fca1e6548df8d7af7bfd7b not found: ID does not exist" Jul 20 18:48:54.767327 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.767316 2576 scope.go:117] "RemoveContainer" containerID="509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07" Jul 20 18:48:54.767556 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:48:54.767536 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07\": container with ID starting with 509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07 not found: ID does not exist" containerID="509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07" Jul 20 18:48:54.767596 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.767563 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07"} err="failed to get container status \"509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07\": rpc error: code = NotFound desc = could not find container \"509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07\": container with ID starting with 509e09be54eb9e2a6770b4137c9d8006a81b9c3c381d6d42ec9c05b7912fae07 not found: ID does not exist" Jul 20 18:48:54.778573 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.778540 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767"] Jul 20 18:48:54.782764 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:54.782733 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-264f7364-openshift-default-7487d88fcf-h9767"] Jul 20 18:48:56.271965 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:48:56.271934 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" path="/var/lib/kubelet/pods/8ff1ac06-26e9-4b7f-8fa1-305fb1764e52/volumes" Jul 20 18:51:28.378420 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.378387 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6"] Jul 20 18:51:28.378946 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.378710 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerName="istio-proxy" Jul 20 18:51:28.378946 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.378721 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerName="istio-proxy" Jul 20 18:51:28.378946 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.378734 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerName="istio-proxy" Jul 20 18:51:28.378946 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.378739 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerName="istio-proxy" Jul 20 18:51:28.378946 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.378796 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerName="istio-proxy" Jul 20 18:51:28.381557 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.381539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.384291 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.384264 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d9481028-openshift-default-dockercfg-zkfdm\"" Jul 20 18:51:28.395442 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.395418 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6"] Jul 20 18:51:28.435105 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.435072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-credential-socket\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.435254 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.435112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-envoy\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.435254 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.435135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-istio-token\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.435254 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.435229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-socket\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.435358 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.435284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-certs\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.435358 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.435307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-data\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.435423 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.435376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35387bf3-8625-4c93-9326-448d89b4f74b-istio-podinfo\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.435423 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.435405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7hhg\" (UniqueName: \"kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-kube-api-access-b7hhg\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.435484 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.435457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35387bf3-8625-4c93-9326-448d89b4f74b-istiod-ca-cert\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536029 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.535996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-certs\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536231 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-data\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536231 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35387bf3-8625-4c93-9326-448d89b4f74b-istio-podinfo\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536231 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7hhg\" (UniqueName: \"kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-kube-api-access-b7hhg\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536231 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35387bf3-8625-4c93-9326-448d89b4f74b-istiod-ca-cert\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536231 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-credential-socket\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536604 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-envoy\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536604 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-istio-token\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536604 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-socket\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536604 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536486 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-certs\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536604 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536506 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-data\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.536945 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.536897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-credential-socket\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.537024 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.537003 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-socket\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.537213 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.537196 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35387bf3-8625-4c93-9326-448d89b4f74b-istiod-ca-cert\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.538552 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.538530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-envoy\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.538693 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.538674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35387bf3-8625-4c93-9326-448d89b4f74b-istio-podinfo\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.556196 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.556164 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-istio-token\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.556340 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.556322 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7hhg\" (UniqueName: \"kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-kube-api-access-b7hhg\") pod \"e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.694543 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.694447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:28.840651 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.840612 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6"] Jul 20 18:51:28.842573 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:51:28.842549 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35387bf3_8625_4c93_9326_448d89b4f74b.slice/crio-f80f4a3b1456083c381c33ba2640c6598414247aba92fef63459a19ef97e7958 WatchSource:0}: Error finding container f80f4a3b1456083c381c33ba2640c6598414247aba92fef63459a19ef97e7958: Status 404 returned error can't find the container with id f80f4a3b1456083c381c33ba2640c6598414247aba92fef63459a19ef97e7958 Jul 20 18:51:28.844530 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.844497 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:51:28.844615 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.844565 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:51:28.844615 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:28.844597 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:51:29.402009 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:29.401977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" event={"ID":"35387bf3-8625-4c93-9326-448d89b4f74b","Type":"ContainerStarted","Data":"56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6"} Jul 20 18:51:29.402388 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:29.402027 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" event={"ID":"35387bf3-8625-4c93-9326-448d89b4f74b","Type":"ContainerStarted","Data":"f80f4a3b1456083c381c33ba2640c6598414247aba92fef63459a19ef97e7958"} Jul 20 18:51:29.438226 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:29.438179 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" podStartSLOduration=1.438163353 podStartE2EDuration="1.438163353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:51:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:51:29.436596936 +0000 UTC m=+2283.756755255" watchObservedRunningTime="2026-07-20 18:51:29.438163353 +0000 UTC m=+2283.758321674" Jul 20 18:51:29.694815 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:29.694718 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:29.699768 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:29.699740 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:30.406704 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:30.406661 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:30.407562 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:30.407545 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:45.407871 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:45.407828 2576 patch_prober.go:28] interesting pod/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 20 18:51:45.408283 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:45.407890 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 20 18:51:45.481694 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:45.481585 2576 generic.go:356] "Generic (PLEG): container finished" podID="35387bf3-8625-4c93-9326-448d89b4f74b" containerID="56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6" exitCode=0 Jul 20 18:51:45.481694 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:45.481665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" event={"ID":"35387bf3-8625-4c93-9326-448d89b4f74b","Type":"ContainerDied","Data":"56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6"} Jul 20 18:51:45.482106 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:45.482088 2576 scope.go:117] "RemoveContainer" containerID="56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6" Jul 20 18:51:45.483145 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:45.483116 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:51:45.483219 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:45.483203 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:51:45.483286 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:45.483272 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:51:46.488133 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:46.488096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" event={"ID":"35387bf3-8625-4c93-9326-448d89b4f74b","Type":"ContainerStarted","Data":"6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f"} Jul 20 18:51:46.694910 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:46.694868 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:46.695143 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:46.695119 2576 patch_prober.go:28] interesting pod/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 20 18:51:46.695226 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:46.695177 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 20 18:51:47.695844 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:47.695804 2576 patch_prober.go:28] interesting pod/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 20 18:51:47.696260 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:47.695876 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 20 18:51:48.695494 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:48.695455 2576 patch_prober.go:28] interesting pod/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 20 18:51:48.695709 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:48.695511 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 20 18:51:49.695567 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:49.695526 2576 patch_prober.go:28] interesting pod/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 20 18:51:49.696010 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:49.695582 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 20 18:51:50.694923 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:50.694878 2576 patch_prober.go:28] interesting pod/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 20 18:51:50.695112 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:50.694934 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 20 18:51:51.699297 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:51.699263 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:51.699820 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:51.699662 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:51:51.700369 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:51:51.700350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:53:26.260540 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:26.260513 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:53:26.272691 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:26.272670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:53:30.079057 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:30.079024 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6"] Jul 20 18:53:30.079431 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:30.079260 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" containerID="cri-o://6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f" gracePeriod=30 Jul 20 18:53:35.327508 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.327480 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:53:35.444602 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.444575 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-istio-token\") pod \"35387bf3-8625-4c93-9326-448d89b4f74b\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " Jul 20 18:53:35.444743 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.444608 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-socket\") pod \"35387bf3-8625-4c93-9326-448d89b4f74b\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " Jul 20 18:53:35.444743 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.444665 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-data\") pod \"35387bf3-8625-4c93-9326-448d89b4f74b\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " Jul 20 18:53:35.444743 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.444695 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-certs\") pod \"35387bf3-8625-4c93-9326-448d89b4f74b\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " Jul 20 18:53:35.444743 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.444738 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-envoy\") pod \"35387bf3-8625-4c93-9326-448d89b4f74b\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " Jul 20 18:53:35.444926 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.444765 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-credential-socket\") pod \"35387bf3-8625-4c93-9326-448d89b4f74b\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " Jul 20 18:53:35.444926 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.444810 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35387bf3-8625-4c93-9326-448d89b4f74b-istio-podinfo\") pod \"35387bf3-8625-4c93-9326-448d89b4f74b\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " Jul 20 18:53:35.444926 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.444844 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7hhg\" (UniqueName: \"kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-kube-api-access-b7hhg\") pod \"35387bf3-8625-4c93-9326-448d89b4f74b\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " Jul 20 18:53:35.444926 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.444871 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35387bf3-8625-4c93-9326-448d89b4f74b-istiod-ca-cert\") pod \"35387bf3-8625-4c93-9326-448d89b4f74b\" (UID: \"35387bf3-8625-4c93-9326-448d89b4f74b\") " Jul 20 18:53:35.444926 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.444875 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "35387bf3-8625-4c93-9326-448d89b4f74b" (UID: "35387bf3-8625-4c93-9326-448d89b4f74b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:53:35.445161 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.445056 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "35387bf3-8625-4c93-9326-448d89b4f74b" (UID: "35387bf3-8625-4c93-9326-448d89b4f74b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:53:35.445161 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.445077 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "35387bf3-8625-4c93-9326-448d89b4f74b" (UID: "35387bf3-8625-4c93-9326-448d89b4f74b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:53:35.445258 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.445219 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:53:35.445258 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.445236 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-workload-certs\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:53:35.445258 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.445250 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-credential-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:53:35.445411 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.445343 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35387bf3-8625-4c93-9326-448d89b4f74b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "35387bf3-8625-4c93-9326-448d89b4f74b" (UID: "35387bf3-8625-4c93-9326-448d89b4f74b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:53:35.445716 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.445695 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-data" (OuterVolumeSpecName: "istio-data") pod "35387bf3-8625-4c93-9326-448d89b4f74b" (UID: "35387bf3-8625-4c93-9326-448d89b4f74b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:53:35.446857 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.446832 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-istio-token" (OuterVolumeSpecName: "istio-token") pod "35387bf3-8625-4c93-9326-448d89b4f74b" (UID: "35387bf3-8625-4c93-9326-448d89b4f74b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:53:35.447055 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.447037 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35387bf3-8625-4c93-9326-448d89b4f74b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "35387bf3-8625-4c93-9326-448d89b4f74b" (UID: "35387bf3-8625-4c93-9326-448d89b4f74b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 18:53:35.447321 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.447296 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-kube-api-access-b7hhg" (OuterVolumeSpecName: "kube-api-access-b7hhg") pod "35387bf3-8625-4c93-9326-448d89b4f74b" (UID: "35387bf3-8625-4c93-9326-448d89b4f74b"). InnerVolumeSpecName "kube-api-access-b7hhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:53:35.447417 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.447337 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "35387bf3-8625-4c93-9326-448d89b4f74b" (UID: "35387bf3-8625-4c93-9326-448d89b4f74b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:53:35.545617 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.545593 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-istio-token\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:53:35.545617 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.545615 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-data\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:53:35.545780 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.545623 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35387bf3-8625-4c93-9326-448d89b4f74b-istio-envoy\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:53:35.545780 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.545633 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35387bf3-8625-4c93-9326-448d89b4f74b-istio-podinfo\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:53:35.545780 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.545665 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7hhg\" (UniqueName: \"kubernetes.io/projected/35387bf3-8625-4c93-9326-448d89b4f74b-kube-api-access-b7hhg\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:53:35.545780 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.545675 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35387bf3-8625-4c93-9326-448d89b4f74b-istiod-ca-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:53:35.962171 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.962139 2576 generic.go:356] "Generic (PLEG): container finished" podID="35387bf3-8625-4c93-9326-448d89b4f74b" containerID="6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f" exitCode=0 Jul 20 18:53:35.962354 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.962186 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" Jul 20 18:53:35.962354 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.962215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" event={"ID":"35387bf3-8625-4c93-9326-448d89b4f74b","Type":"ContainerDied","Data":"6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f"} Jul 20 18:53:35.962354 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.962257 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6" event={"ID":"35387bf3-8625-4c93-9326-448d89b4f74b","Type":"ContainerDied","Data":"f80f4a3b1456083c381c33ba2640c6598414247aba92fef63459a19ef97e7958"} Jul 20 18:53:35.962354 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.962278 2576 scope.go:117] "RemoveContainer" containerID="6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f" Jul 20 18:53:35.971622 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.971602 2576 scope.go:117] "RemoveContainer" containerID="56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6" Jul 20 18:53:35.979578 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.979558 2576 scope.go:117] "RemoveContainer" containerID="6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f" Jul 20 18:53:35.979844 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:53:35.979818 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f\": container with ID starting with 6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f not found: ID does not exist" containerID="6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f" Jul 20 18:53:35.979925 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.979849 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f"} err="failed to get container status \"6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f\": rpc error: code = NotFound desc = could not find container \"6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f\": container with ID starting with 6695e31e874420717b3e915719466ce811cdf431bea90b285be1783e683ce96f not found: ID does not exist" Jul 20 18:53:35.979925 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.979868 2576 scope.go:117] "RemoveContainer" containerID="56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6" Jul 20 18:53:35.980117 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:53:35.980102 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6\": container with ID starting with 56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6 not found: ID does not exist" containerID="56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6" Jul 20 18:53:35.980159 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.980121 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6"} err="failed to get container status \"56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6\": rpc error: code = NotFound desc = could not find container \"56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6\": container with ID starting with 56f8960c5ef985eda4d97f33b5768908689919b0faea495256ab948041c236f6 not found: ID does not exist" Jul 20 18:53:35.986378 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.986351 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6"] Jul 20 18:53:35.994409 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:35.994384 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d9481028-openshift-default-6bf696dff-bvqd6"] Jul 20 18:53:36.272857 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:53:36.272774 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" path="/var/lib/kubelet/pods/35387bf3-8625-4c93-9326-448d89b4f74b/volumes" Jul 20 18:54:26.004469 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.004437 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb"] Jul 20 18:54:26.004963 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.004919 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" Jul 20 18:54:26.004963 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.004936 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" Jul 20 18:54:26.005043 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.005033 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ff1ac06-26e9-4b7f-8fa1-305fb1764e52" containerName="istio-proxy" Jul 20 18:54:26.005076 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.005049 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" Jul 20 18:54:26.005076 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.005059 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" Jul 20 18:54:26.008005 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.007987 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.011540 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.011499 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c017f1-openshift-default-dockercfg-pfqzc\"" Jul 20 18:54:26.022972 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.022953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-certs\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.023077 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.022985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-data\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.023077 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.023006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-podinfo\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.023077 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.023044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-token\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.023246 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.023116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-credential-socket\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.023246 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.023157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-socket\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.023246 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.023185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-envoy\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.023246 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.023217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istiod-ca-cert\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.023370 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.023278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqhxk\" (UniqueName: \"kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-kube-api-access-tqhxk\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.032992 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.032968 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb"] Jul 20 18:54:26.124201 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istiod-ca-cert\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124309 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqhxk\" (UniqueName: \"kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-kube-api-access-tqhxk\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124309 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-certs\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124309 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-data\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124309 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-podinfo\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124309 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-token\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124618 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-credential-socket\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124618 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-socket\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124618 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-envoy\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124809 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124676 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-certs\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124809 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124766 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-data\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124809 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124796 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-credential-socket\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.124970 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124947 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-socket\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.125006 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.124948 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istiod-ca-cert\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.127077 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.127052 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-podinfo\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.127162 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.127087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-envoy\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.132429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.132409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-token\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.132857 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.132837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqhxk\" (UniqueName: \"kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-kube-api-access-tqhxk\") pod \"e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.322849 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.322822 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c017f1-openshift-default-dockercfg-pfqzc\"" Jul 20 18:54:26.331023 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.331002 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:26.462949 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.462921 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb"] Jul 20 18:54:26.465318 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:54:26.465281 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94eee6a4_0c2a_4b40_8c16_75d9eecbb26b.slice/crio-b10e582ed07fced96a69f402de626c44c1e4b9de9768835980c2bae0afbd5d8b WatchSource:0}: Error finding container b10e582ed07fced96a69f402de626c44c1e4b9de9768835980c2bae0afbd5d8b: Status 404 returned error can't find the container with id b10e582ed07fced96a69f402de626c44c1e4b9de9768835980c2bae0afbd5d8b Jul 20 18:54:26.467386 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.467352 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:54:26.467472 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.467415 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:54:26.467472 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:26.467448 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:54:27.176300 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:27.176256 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" event={"ID":"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b","Type":"ContainerStarted","Data":"ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597"} Jul 20 18:54:27.176754 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:27.176313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" event={"ID":"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b","Type":"ContainerStarted","Data":"b10e582ed07fced96a69f402de626c44c1e4b9de9768835980c2bae0afbd5d8b"} Jul 20 18:54:27.196735 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:27.196687 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" podStartSLOduration=2.196667883 podStartE2EDuration="2.196667883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:54:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:54:27.195916864 +0000 UTC m=+2461.516075185" watchObservedRunningTime="2026-07-20 18:54:27.196667883 +0000 UTC m=+2461.516826200" Jul 20 18:54:27.331371 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:27.331336 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:27.335759 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:27.335736 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:28.180653 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:28.180608 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:28.181494 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:28.181476 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:42.246305 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:42.246231 2576 generic.go:356] "Generic (PLEG): container finished" podID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerID="ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597" exitCode=0 Jul 20 18:54:42.246720 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:42.246303 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" event={"ID":"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b","Type":"ContainerDied","Data":"ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597"} Jul 20 18:54:42.246720 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:42.246715 2576 scope.go:117] "RemoveContainer" containerID="ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597" Jul 20 18:54:42.247682 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:42.247653 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:54:42.247754 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:42.247717 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:54:42.247794 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:42.247754 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:54:43.181203 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:43.181170 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:43.253670 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:43.253014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" event={"ID":"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b","Type":"ContainerStarted","Data":"e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158"} Jul 20 18:54:43.331892 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:43.331863 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:43.332757 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:43.332731 2576 patch_prober.go:28] interesting pod/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 18:54:43.332863 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:43.332781 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 18:54:44.332006 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:44.331966 2576 patch_prober.go:28] interesting pod/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 18:54:44.332429 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:44.332044 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 18:54:45.332341 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:45.332307 2576 patch_prober.go:28] interesting pod/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 18:54:45.332739 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:45.332370 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 18:54:46.331475 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:46.331442 2576 patch_prober.go:28] interesting pod/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 18:54:46.331681 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:46.331493 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 18:54:47.331764 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:47.331727 2576 patch_prober.go:28] interesting pod/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 20 18:54:47.332200 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:47.331784 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 20 18:54:48.336043 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:48.336013 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:48.336494 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:48.336274 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:54:48.337061 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:54:48.337044 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:56:35.200970 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:35.200935 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb"] Jul 20 18:56:35.201489 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:35.201156 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" containerID="cri-o://e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158" gracePeriod=30 Jul 20 18:56:40.452092 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.452066 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:56:40.530517 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.530439 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-podinfo\") pod \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " Jul 20 18:56:40.530517 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.530476 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-data\") pod \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " Jul 20 18:56:40.530749 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.530522 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-socket\") pod \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " Jul 20 18:56:40.530749 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.530636 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istiod-ca-cert\") pod \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " Jul 20 18:56:40.530749 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.530705 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-token\") pod \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " Jul 20 18:56:40.530749 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.530732 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-envoy\") pod \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " Jul 20 18:56:40.530957 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.530751 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqhxk\" (UniqueName: \"kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-kube-api-access-tqhxk\") pod \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " Jul 20 18:56:40.530957 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.530784 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" (UID: "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:56:40.530957 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.530801 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-certs\") pod \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " Jul 20 18:56:40.530957 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.530854 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-credential-socket\") pod \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\" (UID: \"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b\") " Jul 20 18:56:40.531150 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.531020 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" (UID: "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:56:40.531279 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.531252 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:56:40.531279 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.531277 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istiod-ca-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:56:40.531435 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.531256 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" (UID: "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:56:40.531435 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.531281 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" (UID: "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:56:40.531548 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.531467 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-data" (OuterVolumeSpecName: "istio-data") pod "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" (UID: "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:56:40.532906 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.532875 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-token" (OuterVolumeSpecName: "istio-token") pod "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" (UID: "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:56:40.533017 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.532965 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" (UID: "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:56:40.533155 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.533138 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" (UID: "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 18:56:40.533202 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.533167 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-kube-api-access-tqhxk" (OuterVolumeSpecName: "kube-api-access-tqhxk") pod "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" (UID: "94eee6a4-0c2a-4b40-8c16-75d9eecbb26b"). InnerVolumeSpecName "kube-api-access-tqhxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:56:40.631970 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.631918 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-podinfo\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:56:40.631970 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.631963 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-data\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:56:40.631970 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.631972 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-token\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:56:40.631970 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.631980 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-istio-envoy\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:56:40.631970 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.631989 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqhxk\" (UniqueName: \"kubernetes.io/projected/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-kube-api-access-tqhxk\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:56:40.632272 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.631999 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-workload-certs\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:56:40.632272 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.632008 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b-credential-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:56:40.741523 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.741495 2576 generic.go:356] "Generic (PLEG): container finished" podID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerID="e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158" exitCode=0 Jul 20 18:56:40.741789 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.741554 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" Jul 20 18:56:40.741789 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.741556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" event={"ID":"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b","Type":"ContainerDied","Data":"e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158"} Jul 20 18:56:40.741789 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.741689 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb" event={"ID":"94eee6a4-0c2a-4b40-8c16-75d9eecbb26b","Type":"ContainerDied","Data":"b10e582ed07fced96a69f402de626c44c1e4b9de9768835980c2bae0afbd5d8b"} Jul 20 18:56:40.741789 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.741713 2576 scope.go:117] "RemoveContainer" containerID="e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158" Jul 20 18:56:40.750867 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.750850 2576 scope.go:117] "RemoveContainer" containerID="ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597" Jul 20 18:56:40.758043 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.758026 2576 scope.go:117] "RemoveContainer" containerID="e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158" Jul 20 18:56:40.758284 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:56:40.758263 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158\": container with ID starting with e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158 not found: ID does not exist" containerID="e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158" Jul 20 18:56:40.758329 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.758293 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158"} err="failed to get container status \"e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158\": rpc error: code = NotFound desc = could not find container \"e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158\": container with ID starting with e2c9b081d66315ccab8504f2cb97b21fac57862f4bc3636361fede7cf0f09158 not found: ID does not exist" Jul 20 18:56:40.758329 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.758311 2576 scope.go:117] "RemoveContainer" containerID="ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597" Jul 20 18:56:40.758525 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:56:40.758510 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597\": container with ID starting with ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597 not found: ID does not exist" containerID="ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597" Jul 20 18:56:40.758565 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.758528 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597"} err="failed to get container status \"ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597\": rpc error: code = NotFound desc = could not find container \"ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597\": container with ID starting with ffe0e1ca8d46634553625f6e0b7373ca970b05e7c0b8bfc9e42f5a6ce244a597 not found: ID does not exist" Jul 20 18:56:40.763550 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.763528 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb"] Jul 20 18:56:40.767670 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:40.767635 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c017f1-openshift-default-795cf4c7-zq7cb"] Jul 20 18:56:42.272076 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:42.272045 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" path="/var/lib/kubelet/pods/94eee6a4-0c2a-4b40-8c16-75d9eecbb26b/volumes" Jul 20 18:56:57.942373 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.942293 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5"] Jul 20 18:56:57.942757 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.942741 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" Jul 20 18:56:57.942804 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.942760 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="35387bf3-8625-4c93-9326-448d89b4f74b" containerName="istio-proxy" Jul 20 18:56:57.942804 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.942775 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" Jul 20 18:56:57.942804 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.942784 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" Jul 20 18:56:57.942893 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.942811 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" Jul 20 18:56:57.942893 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.942820 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" Jul 20 18:56:57.942956 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.942902 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" Jul 20 18:56:57.942956 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.942915 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="94eee6a4-0c2a-4b40-8c16-75d9eecbb26b" containerName="istio-proxy" Jul 20 18:56:57.947481 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.947460 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:57.950511 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.950479 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-9eed89-openshift-default-dockercfg-64s4c\"" Jul 20 18:56:57.957001 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.956972 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5"] Jul 20 18:56:57.979831 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.979807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-credential-socket\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:57.979965 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.979838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-data\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:57.979965 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.979856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-token\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:57.979965 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.979875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-podinfo\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:57.979965 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.979913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-envoy\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:57.979965 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.979930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqk47\" (UniqueName: \"kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-kube-api-access-lqk47\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:57.979965 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.979947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-certs\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:57.980158 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.980027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istiod-ca-cert\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:57.980158 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:57.980053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-socket\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081284 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-credential-socket\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081284 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-data\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-token\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-podinfo\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-envoy\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqk47\" (UniqueName: \"kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-kube-api-access-lqk47\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-certs\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081551 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istiod-ca-cert\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081884 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-socket\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081884 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-data\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081995 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081940 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-certs\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.081995 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.081974 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-socket\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.082073 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.082037 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-credential-socket\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.082467 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.082445 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istiod-ca-cert\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.083719 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.083694 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-envoy\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.083850 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.083827 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-podinfo\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.089622 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.089600 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-token\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.089816 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.089796 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqk47\" (UniqueName: \"kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-kube-api-access-lqk47\") pod \"e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.259027 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.258950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:58.391461 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.391429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5"] Jul 20 18:56:58.394633 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:56:58.394608 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a69e77c_4ba9_4589_aa12_60ba01697fd0.slice/crio-b4b48d049ec7b2be8d1c1b1a146bf92eb5f1064c6d0e4a0464ec27a32527063f WatchSource:0}: Error finding container b4b48d049ec7b2be8d1c1b1a146bf92eb5f1064c6d0e4a0464ec27a32527063f: Status 404 returned error can't find the container with id b4b48d049ec7b2be8d1c1b1a146bf92eb5f1064c6d0e4a0464ec27a32527063f Jul 20 18:56:58.396795 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.396762 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:56:58.396903 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.396827 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:56:58.396903 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.396855 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:56:58.819515 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.819470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" event={"ID":"7a69e77c-4ba9-4589-aa12-60ba01697fd0","Type":"ContainerStarted","Data":"ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3"} Jul 20 18:56:58.819729 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.819574 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" event={"ID":"7a69e77c-4ba9-4589-aa12-60ba01697fd0","Type":"ContainerStarted","Data":"b4b48d049ec7b2be8d1c1b1a146bf92eb5f1064c6d0e4a0464ec27a32527063f"} Jul 20 18:56:58.843517 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:58.843462 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" podStartSLOduration=1.843448993 podStartE2EDuration="1.843448993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:56:58.843066988 +0000 UTC m=+2613.163225332" watchObservedRunningTime="2026-07-20 18:56:58.843448993 +0000 UTC m=+2613.163607372" Jul 20 18:56:59.259327 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:59.259292 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:59.263990 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:59.263964 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:59.824568 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:59.824535 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:56:59.825503 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:56:59.825482 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:57:15.866847 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:15.866806 2576 patch_prober.go:28] interesting pod/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 18:57:15.867278 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:15.866875 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 18:57:16.897386 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:16.897354 2576 generic.go:356] "Generic (PLEG): container finished" podID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerID="ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3" exitCode=0 Jul 20 18:57:16.897848 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:16.897427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" event={"ID":"7a69e77c-4ba9-4589-aa12-60ba01697fd0","Type":"ContainerDied","Data":"ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3"} Jul 20 18:57:16.897848 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:16.897777 2576 scope.go:117] "RemoveContainer" containerID="ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3" Jul 20 18:57:16.898702 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:16.898677 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:57:16.898777 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:16.898742 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:57:16.898777 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:16.898773 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:57:17.903689 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:17.903649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" event={"ID":"7a69e77c-4ba9-4589-aa12-60ba01697fd0","Type":"ContainerStarted","Data":"384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed"} Jul 20 18:57:18.259184 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:18.259097 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:57:18.259333 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:18.259280 2576 patch_prober.go:28] interesting pod/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 20 18:57:18.259378 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:18.259328 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 20 18:57:19.259987 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:19.259942 2576 patch_prober.go:28] interesting pod/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 20 18:57:19.260516 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:19.260016 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 20 18:57:20.260191 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:20.260148 2576 patch_prober.go:28] interesting pod/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 20 18:57:20.260808 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:20.260771 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 20 18:57:21.260089 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:21.260049 2576 patch_prober.go:28] interesting pod/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 20 18:57:21.260376 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:21.260344 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 20 18:57:22.260324 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:22.260280 2576 patch_prober.go:28] interesting pod/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 20 18:57:22.260530 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:22.260346 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 20 18:57:23.262964 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:23.262933 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:57:23.263335 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:23.263186 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:57:23.263897 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:23.263880 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:57:48.254399 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:48.254360 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5"] Jul 20 18:57:48.255329 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:48.254585 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" containerID="cri-o://384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed" gracePeriod=30 Jul 20 18:57:53.264633 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.264592 2576 patch_prober.go:28] interesting pod/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": read tcp 10.134.0.2:47262->10.134.0.30:15021: read: connection reset by peer" start-of-body= Jul 20 18:57:53.265028 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.264680 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": read tcp 10.134.0.2:47262->10.134.0.30:15021: read: connection reset by peer" Jul 20 18:57:53.502122 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.502095 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:57:53.570490 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570388 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-envoy\") pod \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " Jul 20 18:57:53.570490 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570426 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-socket\") pod \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " Jul 20 18:57:53.570490 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570451 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-podinfo\") pod \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " Jul 20 18:57:53.570490 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570474 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-certs\") pod \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " Jul 20 18:57:53.570852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570510 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-credential-socket\") pod \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " Jul 20 18:57:53.570852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570537 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-data\") pod \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " Jul 20 18:57:53.570852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570563 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istiod-ca-cert\") pod \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " Jul 20 18:57:53.570852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570605 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqk47\" (UniqueName: \"kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-kube-api-access-lqk47\") pod \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " Jul 20 18:57:53.570852 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570698 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-token\") pod \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\" (UID: \"7a69e77c-4ba9-4589-aa12-60ba01697fd0\") " Jul 20 18:57:53.571088 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570860 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a69e77c-4ba9-4589-aa12-60ba01697fd0" (UID: "7a69e77c-4ba9-4589-aa12-60ba01697fd0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:57:53.571088 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570916 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a69e77c-4ba9-4589-aa12-60ba01697fd0" (UID: "7a69e77c-4ba9-4589-aa12-60ba01697fd0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:57:53.571088 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.570973 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:57:53.571243 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.571125 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a69e77c-4ba9-4589-aa12-60ba01697fd0" (UID: "7a69e77c-4ba9-4589-aa12-60ba01697fd0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:57:53.571353 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.571311 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a69e77c-4ba9-4589-aa12-60ba01697fd0" (UID: "7a69e77c-4ba9-4589-aa12-60ba01697fd0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 18:57:53.571779 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.571757 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a69e77c-4ba9-4589-aa12-60ba01697fd0" (UID: "7a69e77c-4ba9-4589-aa12-60ba01697fd0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:57:53.572942 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.572913 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a69e77c-4ba9-4589-aa12-60ba01697fd0" (UID: "7a69e77c-4ba9-4589-aa12-60ba01697fd0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 18:57:53.573109 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.573093 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-kube-api-access-lqk47" (OuterVolumeSpecName: "kube-api-access-lqk47") pod "7a69e77c-4ba9-4589-aa12-60ba01697fd0" (UID: "7a69e77c-4ba9-4589-aa12-60ba01697fd0"). InnerVolumeSpecName "kube-api-access-lqk47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:57:53.573167 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.573145 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a69e77c-4ba9-4589-aa12-60ba01697fd0" (UID: "7a69e77c-4ba9-4589-aa12-60ba01697fd0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 18:57:53.573332 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.573318 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a69e77c-4ba9-4589-aa12-60ba01697fd0" (UID: "7a69e77c-4ba9-4589-aa12-60ba01697fd0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 18:57:53.672119 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.672061 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-workload-certs\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:57:53.672119 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.672109 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-credential-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:57:53.672119 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.672123 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-data\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:57:53.672119 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.672135 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istiod-ca-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:57:53.672406 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.672148 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqk47\" (UniqueName: \"kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-kube-api-access-lqk47\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:57:53.672406 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.672161 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-token\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:57:53.672406 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.672173 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-envoy\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:57:53.672406 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:53.672184 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a69e77c-4ba9-4589-aa12-60ba01697fd0-istio-podinfo\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 18:57:54.061787 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.061752 2576 generic.go:356] "Generic (PLEG): container finished" podID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerID="384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed" exitCode=0 Jul 20 18:57:54.061951 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.061800 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" Jul 20 18:57:54.061951 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.061832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" event={"ID":"7a69e77c-4ba9-4589-aa12-60ba01697fd0","Type":"ContainerDied","Data":"384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed"} Jul 20 18:57:54.061951 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.061881 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5" event={"ID":"7a69e77c-4ba9-4589-aa12-60ba01697fd0","Type":"ContainerDied","Data":"b4b48d049ec7b2be8d1c1b1a146bf92eb5f1064c6d0e4a0464ec27a32527063f"} Jul 20 18:57:54.061951 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.061910 2576 scope.go:117] "RemoveContainer" containerID="384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed" Jul 20 18:57:54.070777 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.070760 2576 scope.go:117] "RemoveContainer" containerID="ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3" Jul 20 18:57:54.079270 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.079249 2576 scope.go:117] "RemoveContainer" containerID="384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed" Jul 20 18:57:54.079634 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:57:54.079616 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed\": container with ID starting with 384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed not found: ID does not exist" containerID="384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed" Jul 20 18:57:54.079731 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.079659 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed"} err="failed to get container status \"384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed\": rpc error: code = NotFound desc = could not find container \"384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed\": container with ID starting with 384927187ef6a7e02979a3d5a34aad5dedce21cdbf558637be412a9da65ba2ed not found: ID does not exist" Jul 20 18:57:54.079731 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.079676 2576 scope.go:117] "RemoveContainer" containerID="ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3" Jul 20 18:57:54.079882 ip-10-0-142-149 kubenswrapper[2576]: E0720 18:57:54.079866 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3\": container with ID starting with ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3 not found: ID does not exist" containerID="ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3" Jul 20 18:57:54.080208 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.079883 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3"} err="failed to get container status \"ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3\": rpc error: code = NotFound desc = could not find container \"ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3\": container with ID starting with ce0ce8f30da83a2391946ecf6f2a4a466b4475cfb051f5370093bede9cbecdb3 not found: ID does not exist" Jul 20 18:57:54.088048 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.088024 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5"] Jul 20 18:57:54.089376 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.089354 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-9eed89-openshift-default-5495576d9f-hscz5"] Jul 20 18:57:54.272612 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:57:54.272585 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" path="/var/lib/kubelet/pods/7a69e77c-4ba9-4589-aa12-60ba01697fd0/volumes" Jul 20 18:58:15.879049 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.879005 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2"] Jul 20 18:58:15.879405 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.879325 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" Jul 20 18:58:15.879405 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.879336 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" Jul 20 18:58:15.879482 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.879419 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" Jul 20 18:58:15.879482 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.879428 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" Jul 20 18:58:15.886982 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.886958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:15.889779 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.889754 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-b7bb94-openshift-default-dockercfg-zgzx9\"" Jul 20 18:58:15.895430 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.895410 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2"] Jul 20 18:58:15.940904 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.940884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-token\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:15.941012 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.940918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-socket\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:15.941012 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.940939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-envoy\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:15.941012 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.940969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcmm2\" (UniqueName: \"kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-kube-api-access-tcmm2\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:15.941012 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.940998 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-certs\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:15.941161 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.941015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-podinfo\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:15.941161 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.941049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-credential-socket\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:15.941161 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.941081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4388fc8d-c371-450c-8e32-dd59f1afb868-istiod-ca-cert\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:15.941250 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:15.941145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-data\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.041782 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.041747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-envoy\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.041962 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.041803 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcmm2\" (UniqueName: \"kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-kube-api-access-tcmm2\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.041962 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.041840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-certs\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.041962 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.041866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-podinfo\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.041962 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.041905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-credential-socket\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.041962 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.041940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4388fc8d-c371-450c-8e32-dd59f1afb868-istiod-ca-cert\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.042248 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.041973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-data\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.042248 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.042022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-token\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.042248 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.042066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-socket\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.042409 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.042251 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-certs\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.042409 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.042304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-credential-socket\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.042409 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.042377 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-socket\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.042736 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.042711 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-data\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.042935 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.042912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4388fc8d-c371-450c-8e32-dd59f1afb868-istiod-ca-cert\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.044230 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.044206 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-envoy\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.044403 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.044377 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-podinfo\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.049307 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.049286 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-token\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.050483 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.050456 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcmm2\" (UniqueName: \"kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-kube-api-access-tcmm2\") pod \"e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.198661 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.198565 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:16.330254 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.330229 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2"] Jul 20 18:58:16.332323 ip-10-0-142-149 kubenswrapper[2576]: W0720 18:58:16.332300 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4388fc8d_c371_450c_8e32_dd59f1afb868.slice/crio-3a78d823e535416fa4e189804099be388589c2fa1bcb8f13214243232837205a WatchSource:0}: Error finding container 3a78d823e535416fa4e189804099be388589c2fa1bcb8f13214243232837205a: Status 404 returned error can't find the container with id 3a78d823e535416fa4e189804099be388589c2fa1bcb8f13214243232837205a Jul 20 18:58:16.334293 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.334253 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:58:16.334350 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.334327 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:58:16.334398 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:16.334362 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:58:17.162960 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:17.162920 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" event={"ID":"4388fc8d-c371-450c-8e32-dd59f1afb868","Type":"ContainerStarted","Data":"d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b"} Jul 20 18:58:17.163323 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:17.162985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" event={"ID":"4388fc8d-c371-450c-8e32-dd59f1afb868","Type":"ContainerStarted","Data":"3a78d823e535416fa4e189804099be388589c2fa1bcb8f13214243232837205a"} Jul 20 18:58:17.185759 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:17.185714 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" podStartSLOduration=2.185699284 podStartE2EDuration="2.185699284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:58:17.184708915 +0000 UTC m=+2691.504867245" watchObservedRunningTime="2026-07-20 18:58:17.185699284 +0000 UTC m=+2691.505857603" Jul 20 18:58:17.198824 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:17.198800 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:17.203184 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:17.203163 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:18.167938 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:18.167904 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:18.168726 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:18.168706 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:26.285652 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:26.285612 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:58:26.297524 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:26.297503 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 18:58:33.169695 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:33.169666 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 20 18:58:33.170106 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:33.169742 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" podUID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 20 18:58:33.239877 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:33.239849 2576 generic.go:356] "Generic (PLEG): container finished" podID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerID="d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b" exitCode=0 Jul 20 18:58:33.239971 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:33.239899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" event={"ID":"4388fc8d-c371-450c-8e32-dd59f1afb868","Type":"ContainerDied","Data":"d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b"} Jul 20 18:58:33.240273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:33.240259 2576 scope.go:117] "RemoveContainer" containerID="d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b" Jul 20 18:58:33.241185 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:33.241152 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:58:33.241239 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:33.241222 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:58:33.241277 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:33.241253 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 18:58:34.247516 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:34.247467 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" event={"ID":"4388fc8d-c371-450c-8e32-dd59f1afb868","Type":"ContainerStarted","Data":"d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2"} Jul 20 18:58:35.199160 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:35.199121 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:35.199447 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:35.199426 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 20 18:58:35.199498 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:35.199473 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" podUID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 20 18:58:36.199244 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:36.199209 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 20 18:58:36.199627 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:36.199269 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" podUID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 20 18:58:37.199273 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:37.199234 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 20 18:58:37.199678 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:37.199291 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" podUID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 20 18:58:38.203301 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:38.203270 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:38.203688 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:38.203530 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 18:58:38.204120 ip-10-0-142-149 kubenswrapper[2576]: I0720 18:58:38.204101 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 19:00:00.139044 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:00.138959 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m"] Jul 20 19:00:00.139475 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:00.139280 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" Jul 20 19:00:00.139475 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:00.139290 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a69e77c-4ba9-4589-aa12-60ba01697fd0" containerName="istio-proxy" Jul 20 19:00:00.142140 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:00.142123 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m" Jul 20 19:00:00.144312 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:00.144288 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w8qkh\"" Jul 20 19:00:00.151361 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:00.151335 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m"] Jul 20 19:00:00.153967 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:00.153938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m" Jul 20 19:00:00.297347 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:00.297318 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m"] Jul 20 19:00:00.300243 ip-10-0-142-149 kubenswrapper[2576]: W0720 19:00:00.300216 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f96e773_46c5_4266_8a0e_ce7269f3639f.slice/crio-832905cfd15fd93250037eb71ef82905b1351daf10535cd5bee938e2e0931ec8 WatchSource:0}: Error finding container 832905cfd15fd93250037eb71ef82905b1351daf10535cd5bee938e2e0931ec8: Status 404 returned error can't find the container with id 832905cfd15fd93250037eb71ef82905b1351daf10535cd5bee938e2e0931ec8 Jul 20 19:00:00.302320 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:00.302299 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 19:00:00.637957 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:00.637914 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m" event={"ID":"1f96e773-46c5-4266-8a0e-ce7269f3639f","Type":"ContainerStarted","Data":"832905cfd15fd93250037eb71ef82905b1351daf10535cd5bee938e2e0931ec8"} Jul 20 19:00:06.666720 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:06.666680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m" event={"ID":"1f96e773-46c5-4266-8a0e-ce7269f3639f","Type":"ContainerStarted","Data":"6ed09e6815cd18d3f2b34a7dc786325885d690e52769413f54c964d7d2f2fbb2"} Jul 20 19:00:06.686159 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:06.686103 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m" podStartSLOduration=0.701266139 podStartE2EDuration="6.686087451s" totalImagesPullingTime="5.984821312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:00:06.685134433 +0000 UTC m=+2801.005292767" watchObservedRunningTime="2026-07-20 19:00:06.686087451 +0000 UTC m=+2801.006245772" Jul 20 19:00:07.672606 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:07.672572 2576 generic.go:356] "Generic (PLEG): container finished" podID="1f96e773-46c5-4266-8a0e-ce7269f3639f" containerID="6ed09e6815cd18d3f2b34a7dc786325885d690e52769413f54c964d7d2f2fbb2" exitCode=0 Jul 20 19:00:07.673075 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:07.672673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m" event={"ID":"1f96e773-46c5-4266-8a0e-ce7269f3639f","Type":"ContainerDied","Data":"6ed09e6815cd18d3f2b34a7dc786325885d690e52769413f54c964d7d2f2fbb2"} Jul 20 19:00:08.810230 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:08.810202 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m" Jul 20 19:00:09.683082 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:09.683051 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m" Jul 20 19:00:09.683082 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:09.683069 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742900-jrj6m" event={"ID":"1f96e773-46c5-4266-8a0e-ce7269f3639f","Type":"ContainerDied","Data":"832905cfd15fd93250037eb71ef82905b1351daf10535cd5bee938e2e0931ec8"} Jul 20 19:00:09.683306 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:00:09.683114 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="832905cfd15fd93250037eb71ef82905b1351daf10535cd5bee938e2e0931ec8" Jul 20 19:03:26.316809 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:03:26.316781 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 19:03:26.327522 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:03:26.327491 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qz2b5_53121c2e-6d3e-4b04-9aa9-1772f259f653/ovn-acl-logging/0.log" Jul 20 19:04:27.374339 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:27.374301 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2"] Jul 20 19:04:27.374944 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:27.374612 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" podUID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerName="istio-proxy" containerID="cri-o://d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2" gracePeriod=30 Jul 20 19:04:32.628128 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.628097 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 19:04:32.703249 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703149 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-data\") pod \"4388fc8d-c371-450c-8e32-dd59f1afb868\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " Jul 20 19:04:32.703249 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703195 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-socket\") pod \"4388fc8d-c371-450c-8e32-dd59f1afb868\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " Jul 20 19:04:32.703249 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703222 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-envoy\") pod \"4388fc8d-c371-450c-8e32-dd59f1afb868\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " Jul 20 19:04:32.703249 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703247 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4388fc8d-c371-450c-8e32-dd59f1afb868-istiod-ca-cert\") pod \"4388fc8d-c371-450c-8e32-dd59f1afb868\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " Jul 20 19:04:32.703589 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703266 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcmm2\" (UniqueName: \"kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-kube-api-access-tcmm2\") pod \"4388fc8d-c371-450c-8e32-dd59f1afb868\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " Jul 20 19:04:32.703589 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703281 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-credential-socket\") pod \"4388fc8d-c371-450c-8e32-dd59f1afb868\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " Jul 20 19:04:32.703589 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703314 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-token\") pod \"4388fc8d-c371-450c-8e32-dd59f1afb868\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " Jul 20 19:04:32.703589 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703339 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-podinfo\") pod \"4388fc8d-c371-450c-8e32-dd59f1afb868\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " Jul 20 19:04:32.703589 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703366 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-certs\") pod \"4388fc8d-c371-450c-8e32-dd59f1afb868\" (UID: \"4388fc8d-c371-450c-8e32-dd59f1afb868\") " Jul 20 19:04:32.703589 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703534 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4388fc8d-c371-450c-8e32-dd59f1afb868" (UID: "4388fc8d-c371-450c-8e32-dd59f1afb868"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:04:32.703929 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703693 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 19:04:32.703929 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703722 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4388fc8d-c371-450c-8e32-dd59f1afb868" (UID: "4388fc8d-c371-450c-8e32-dd59f1afb868"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:04:32.703929 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703756 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4388fc8d-c371-450c-8e32-dd59f1afb868-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4388fc8d-c371-450c-8e32-dd59f1afb868" (UID: "4388fc8d-c371-450c-8e32-dd59f1afb868"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 19:04:32.703929 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.703761 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4388fc8d-c371-450c-8e32-dd59f1afb868" (UID: "4388fc8d-c371-450c-8e32-dd59f1afb868"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:04:32.704240 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.704207 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-data" (OuterVolumeSpecName: "istio-data") pod "4388fc8d-c371-450c-8e32-dd59f1afb868" (UID: "4388fc8d-c371-450c-8e32-dd59f1afb868"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:04:32.705988 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.705964 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4388fc8d-c371-450c-8e32-dd59f1afb868" (UID: "4388fc8d-c371-450c-8e32-dd59f1afb868"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 19:04:32.706126 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.706110 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4388fc8d-c371-450c-8e32-dd59f1afb868" (UID: "4388fc8d-c371-450c-8e32-dd59f1afb868"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 19:04:32.706182 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.706118 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-token" (OuterVolumeSpecName: "istio-token") pod "4388fc8d-c371-450c-8e32-dd59f1afb868" (UID: "4388fc8d-c371-450c-8e32-dd59f1afb868"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:04:32.706182 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.706134 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-kube-api-access-tcmm2" (OuterVolumeSpecName: "kube-api-access-tcmm2") pod "4388fc8d-c371-450c-8e32-dd59f1afb868" (UID: "4388fc8d-c371-450c-8e32-dd59f1afb868"). InnerVolumeSpecName "kube-api-access-tcmm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 19:04:32.804463 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.804421 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-podinfo\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 19:04:32.804463 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.804454 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-workload-certs\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 19:04:32.804463 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.804464 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-data\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 19:04:32.804463 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.804473 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-envoy\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 19:04:32.804767 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.804480 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4388fc8d-c371-450c-8e32-dd59f1afb868-istiod-ca-cert\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 19:04:32.804767 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.804489 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcmm2\" (UniqueName: \"kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-kube-api-access-tcmm2\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 19:04:32.804767 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.804498 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4388fc8d-c371-450c-8e32-dd59f1afb868-credential-socket\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 19:04:32.804767 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.804506 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4388fc8d-c371-450c-8e32-dd59f1afb868-istio-token\") on node \"ip-10-0-142-149.ec2.internal\" DevicePath \"\"" Jul 20 19:04:32.820998 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.820960 2576 generic.go:356] "Generic (PLEG): container finished" podID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerID="d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2" exitCode=0 Jul 20 19:04:32.821158 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.821021 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" Jul 20 19:04:32.821158 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.821047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" event={"ID":"4388fc8d-c371-450c-8e32-dd59f1afb868","Type":"ContainerDied","Data":"d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2"} Jul 20 19:04:32.821158 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.821129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2" event={"ID":"4388fc8d-c371-450c-8e32-dd59f1afb868","Type":"ContainerDied","Data":"3a78d823e535416fa4e189804099be388589c2fa1bcb8f13214243232837205a"} Jul 20 19:04:32.821158 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.821152 2576 scope.go:117] "RemoveContainer" containerID="d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2" Jul 20 19:04:32.830083 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.830063 2576 scope.go:117] "RemoveContainer" containerID="d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b" Jul 20 19:04:32.837862 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.837844 2576 scope.go:117] "RemoveContainer" containerID="d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2" Jul 20 19:04:32.838182 ip-10-0-142-149 kubenswrapper[2576]: E0720 19:04:32.838162 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2\": container with ID starting with d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2 not found: ID does not exist" containerID="d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2" Jul 20 19:04:32.838229 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.838193 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2"} err="failed to get container status \"d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2\": rpc error: code = NotFound desc = could not find container \"d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2\": container with ID starting with d79ea4b73d85808c012cd5cdc52b4dc5116b45c8dde0ff4cce04a381b4cc9af2 not found: ID does not exist" Jul 20 19:04:32.838229 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.838210 2576 scope.go:117] "RemoveContainer" containerID="d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b" Jul 20 19:04:32.838478 ip-10-0-142-149 kubenswrapper[2576]: E0720 19:04:32.838459 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b\": container with ID starting with d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b not found: ID does not exist" containerID="d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b" Jul 20 19:04:32.838580 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.838486 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b"} err="failed to get container status \"d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b\": rpc error: code = NotFound desc = could not find container \"d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b\": container with ID starting with d9e9df99b3a761c3d1ef0d1991225e661f406da49f2c5ce144538e14460a0b3b not found: ID does not exist" Jul 20 19:04:32.843384 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.843360 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2"] Jul 20 19:04:32.846733 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:32.846712 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-b7bb94-openshift-default-56c65958c9-4kwn2"] Jul 20 19:04:34.272257 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:34.272224 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4388fc8d-c371-450c-8e32-dd59f1afb868" path="/var/lib/kubelet/pods/4388fc8d-c371-450c-8e32-dd59f1afb868/volumes" Jul 20 19:04:55.997153 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:55.997123 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fdd66b9b-b87gr_3d7b7280-3b75-4a78-9ebe-f096ac9a90c5/copy-manifests/0.log" Jul 20 19:04:56.006030 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:56.006008 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fdd66b9b-b87gr_3d7b7280-3b75-4a78-9ebe-f096ac9a90c5/manager/0.log" Jul 20 19:04:56.945990 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:56.945965 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742900-jrj6m_1f96e773-46c5-4266-8a0e-ce7269f3639f/cleanup/0.log" Jul 20 19:04:59.639405 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:59.639373 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8b2r4_8d65cdcd-3d40-4b24-a44a-d1dba4a8a917/discovery/0.log" Jul 20 19:04:59.970952 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:04:59.970845 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-49kt5_4f810006-09fa-4f3f-88d5-0ee7cfe8d68f/istio-proxy/1.log" Jul 20 19:05:00.085174 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:00.085144 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jb52w_6fe407c8-8201-4e43-9efe-1c4fc2602ec2/payload-pre-processing/0.log" Jul 20 19:05:00.768588 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:00.768557 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bj8bk_0efe2778-3f4d-4d17-9a19-2fd2ff8fdb5a/main/0.log" Jul 20 19:05:00.888038 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:00.888009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6z29p_6e837609-9407-49a3-934d-ba67bfb5092f/main/0.log" Jul 20 19:05:01.003895 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:01.003851 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftnk6m_d970eadf-8b3a-400f-af67-d72f3d346f55/main/0.log" Jul 20 19:05:10.075844 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:10.075814 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-skln6_20a22dbd-217f-4cc6-af47-37c63f7e968d/global-pull-secret-syncer/0.log" Jul 20 19:05:10.207275 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:10.207243 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w8szj_3f80181e-e10d-4cb8-8a45-dfe5c6142d82/konnectivity-agent/0.log" Jul 20 19:05:10.280615 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:10.280580 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-149.ec2.internal_e7e85b7071d89f6d9d1647bbf823b423/haproxy/0.log" Jul 20 19:05:17.965555 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:17.965519 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b799b8b6f-tz2gx_924ef3ca-7c93-4f82-b2ca-047d8e49d9d2/metrics-server/0.log" Jul 20 19:05:18.178499 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:18.178471 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wcr5j_a318926c-317c-449d-8697-4258387b6430/node-exporter/0.log" Jul 20 19:05:18.197909 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:18.197881 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wcr5j_a318926c-317c-449d-8697-4258387b6430/kube-rbac-proxy/0.log" Jul 20 19:05:18.233280 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:18.233203 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wcr5j_a318926c-317c-449d-8697-4258387b6430/init-textfile/0.log" Jul 20 19:05:18.253973 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:18.253947 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vggsn_0ea8933a-21da-4900-afed-0344bbec3d27/kube-rbac-proxy-main/0.log" Jul 20 19:05:18.275690 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:18.275624 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vggsn_0ea8933a-21da-4900-afed-0344bbec3d27/kube-rbac-proxy-self/0.log" Jul 20 19:05:18.295896 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:18.295867 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vggsn_0ea8933a-21da-4900-afed-0344bbec3d27/openshift-state-metrics/0.log" Jul 20 19:05:20.236727 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.236690 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp"] Jul 20 19:05:20.237230 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.237126 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerName="istio-proxy" Jul 20 19:05:20.237230 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.237145 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerName="istio-proxy" Jul 20 19:05:20.237230 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.237155 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f96e773-46c5-4266-8a0e-ce7269f3639f" containerName="cleanup" Jul 20 19:05:20.237230 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.237166 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f96e773-46c5-4266-8a0e-ce7269f3639f" containerName="cleanup" Jul 20 19:05:20.237443 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.237257 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerName="istio-proxy" Jul 20 19:05:20.237443 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.237273 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4388fc8d-c371-450c-8e32-dd59f1afb868" containerName="istio-proxy" Jul 20 19:05:20.237443 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.237285 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f96e773-46c5-4266-8a0e-ce7269f3639f" containerName="cleanup" Jul 20 19:05:20.240360 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.240340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.242746 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.242722 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wtj6n\"/\"openshift-service-ca.crt\"" Jul 20 19:05:20.242864 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.242722 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wtj6n\"/\"default-dockercfg-pl49w\"" Jul 20 19:05:20.243765 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.243747 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wtj6n\"/\"kube-root-ca.crt\"" Jul 20 19:05:20.249387 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.249363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp"] Jul 20 19:05:20.309826 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.309782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-lib-modules\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.309826 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.309829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-podres\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.310117 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.309857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp842\" (UniqueName: \"kubernetes.io/projected/380b994c-8907-41d0-a97f-facd9828cfa6-kube-api-access-hp842\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.310117 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.309889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-sys\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.310117 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.309983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-proc\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.413446 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.413406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-proc\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.413696 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.413468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-lib-modules\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.413696 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.413490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-podres\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.413696 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.413508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp842\" (UniqueName: \"kubernetes.io/projected/380b994c-8907-41d0-a97f-facd9828cfa6-kube-api-access-hp842\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.413696 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.413527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-sys\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.413696 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.413544 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-proc\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.413696 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.413619 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-sys\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.413696 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.413627 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-lib-modules\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.413696 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.413686 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/380b994c-8907-41d0-a97f-facd9828cfa6-podres\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.422038 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.422008 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp842\" (UniqueName: \"kubernetes.io/projected/380b994c-8907-41d0-a97f-facd9828cfa6-kube-api-access-hp842\") pod \"perf-node-gather-daemonset-svzsp\" (UID: \"380b994c-8907-41d0-a97f-facd9828cfa6\") " pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.550890 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.550797 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:20.685031 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:20.684999 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp"] Jul 20 19:05:21.039593 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:21.039552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" event={"ID":"380b994c-8907-41d0-a97f-facd9828cfa6","Type":"ContainerStarted","Data":"4f4814041db2bf50e052fc351d9ad2dd2e6b1d347187b416cf205dbe73364e43"} Jul 20 19:05:21.039859 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:21.039633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" event={"ID":"380b994c-8907-41d0-a97f-facd9828cfa6","Type":"ContainerStarted","Data":"6c03fe50896bc93cc171d2fca83591b620892544f73f48ae6457b457c0bff656"} Jul 20 19:05:21.039859 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:21.039703 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:21.057063 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:21.057007 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" podStartSLOduration=1.056991568 podStartE2EDuration="1.056991568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:05:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:21.055866641 +0000 UTC m=+3115.376024954" watchObservedRunningTime="2026-07-20 19:05:21.056991568 +0000 UTC m=+3115.377149887" Jul 20 19:05:22.660499 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:22.660458 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6k5pv_e95e9429-310d-44da-81d5-e279fe4a7089/dns/0.log" Jul 20 19:05:22.682477 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:22.682450 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6k5pv_e95e9429-310d-44da-81d5-e279fe4a7089/kube-rbac-proxy/0.log" Jul 20 19:05:22.853511 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:22.853484 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h2htm_2549c6b2-1753-461c-b823-8db9cc671d86/dns-node-resolver/0.log" Jul 20 19:05:23.403704 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:23.403668 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5cb4f7cc99-nfbss_03680bf7-dc2a-4668-86a7-9dead0431124/registry/0.log" Jul 20 19:05:23.414127 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:23.414096 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5cb4f7cc99-nfbss_03680bf7-dc2a-4668-86a7-9dead0431124/registry/1.log" Jul 20 19:05:23.436576 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:23.436552 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-97dml_2a522f41-ca65-459c-824e-ece681eb3413/node-ca/0.log" Jul 20 19:05:24.530343 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:24.530311 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8b2r4_8d65cdcd-3d40-4b24-a44a-d1dba4a8a917/discovery/0.log" Jul 20 19:05:24.610240 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:24.610207 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-49kt5_4f810006-09fa-4f3f-88d5-0ee7cfe8d68f/istio-proxy/0.log" Jul 20 19:05:24.635060 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:24.635027 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-49kt5_4f810006-09fa-4f3f-88d5-0ee7cfe8d68f/istio-proxy/1.log" Jul 20 19:05:24.665476 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:24.665449 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jb52w_6fe407c8-8201-4e43-9efe-1c4fc2602ec2/payload-pre-processing/0.log" Jul 20 19:05:25.421806 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:25.421775 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bqnvm_0814f23d-fa95-4083-9bc6-9a037644dd2a/serve-healthcheck-canary/0.log" Jul 20 19:05:25.923286 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:25.923256 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25lbl_4e6ce038-b497-4b88-96f1-fea20a09980f/kube-rbac-proxy/0.log" Jul 20 19:05:25.943895 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:25.943870 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25lbl_4e6ce038-b497-4b88-96f1-fea20a09980f/exporter/0.log" Jul 20 19:05:25.963845 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:25.963819 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25lbl_4e6ce038-b497-4b88-96f1-fea20a09980f/extractor/0.log" Jul 20 19:05:27.055091 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:27.055065 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wtj6n/perf-node-gather-daemonset-svzsp" Jul 20 19:05:28.805616 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:28.805575 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fdd66b9b-b87gr_3d7b7280-3b75-4a78-9ebe-f096ac9a90c5/manager/0.log" Jul 20 19:05:28.826874 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:28.826844 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fdd66b9b-b87gr_3d7b7280-3b75-4a78-9ebe-f096ac9a90c5/copy-manifests/0.log" Jul 20 19:05:30.437605 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:30.437574 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-bdf467c7d-qpk2f_5c1b4db2-f103-4b5b-ba92-9d021271eab6/manager/0.log" Jul 20 19:05:30.738441 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:30.738353 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8b2r4_8d65cdcd-3d40-4b24-a44a-d1dba4a8a917/discovery/0.log" Jul 20 19:05:30.794015 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:30.793988 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-49kt5_4f810006-09fa-4f3f-88d5-0ee7cfe8d68f/istio-proxy/0.log" Jul 20 19:05:30.820417 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:30.820376 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-49kt5_4f810006-09fa-4f3f-88d5-0ee7cfe8d68f/istio-proxy/1.log" Jul 20 19:05:30.839753 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:30.839721 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jb52w_6fe407c8-8201-4e43-9efe-1c4fc2602ec2/payload-pre-processing/0.log" Jul 20 19:05:32.187017 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:32.186984 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8b2r4_8d65cdcd-3d40-4b24-a44a-d1dba4a8a917/discovery/0.log" Jul 20 19:05:32.240848 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:32.240803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-49kt5_4f810006-09fa-4f3f-88d5-0ee7cfe8d68f/istio-proxy/0.log" Jul 20 19:05:32.269538 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:32.269501 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-49kt5_4f810006-09fa-4f3f-88d5-0ee7cfe8d68f/istio-proxy/1.log" Jul 20 19:05:32.290609 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:32.290567 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jb52w_6fe407c8-8201-4e43-9efe-1c4fc2602ec2/payload-pre-processing/0.log" Jul 20 19:05:36.649164 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:36.649134 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-75bfs_32d33bd2-2458-4df8-9aca-37ec4d66a9f1/kube-multus/0.log" Jul 20 19:05:36.673046 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:36.673013 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb5xn_09254229-a029-4b42-8634-cc3a565e811c/kube-multus-additional-cni-plugins/0.log" Jul 20 19:05:36.701070 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:36.701044 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb5xn_09254229-a029-4b42-8634-cc3a565e811c/egress-router-binary-copy/0.log" Jul 20 19:05:36.723605 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:36.723579 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb5xn_09254229-a029-4b42-8634-cc3a565e811c/cni-plugins/0.log" Jul 20 19:05:36.746065 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:36.746039 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb5xn_09254229-a029-4b42-8634-cc3a565e811c/bond-cni-plugin/0.log" Jul 20 19:05:36.766071 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:36.766042 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb5xn_09254229-a029-4b42-8634-cc3a565e811c/routeoverride-cni/0.log" Jul 20 19:05:36.785849 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:36.785822 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb5xn_09254229-a029-4b42-8634-cc3a565e811c/whereabouts-cni-bincopy/0.log" Jul 20 19:05:36.805449 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:36.805420 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cb5xn_09254229-a029-4b42-8634-cc3a565e811c/whereabouts-cni/0.log" Jul 20 19:05:37.223233 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:37.223205 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cmnwz_1c37edf7-0b78-44c5-8223-de838b9908dd/network-metrics-daemon/0.log" Jul 20 19:05:37.244001 ip-10-0-142-149 kubenswrapper[2576]: I0720 19:05:37.243977 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cmnwz_1c37edf7-0b78-44c5-8223-de838b9908dd/kube-rbac-proxy/0.log"