Jul 09 18:59:14.475602 ip-10-0-140-253 systemd[1]: Starting Kubernetes Kubelet... Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.796424 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799621 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799631 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799634 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799637 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799640 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799642 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799645 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:59:14.850564 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799648 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799650 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799653 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799655 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799659 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799662 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799664 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799667 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799670 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799672 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799675 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799677 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799680 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799683 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799685 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799689 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799698 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799701 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799703 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799706 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:59:14.851639 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799709 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799711 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799714 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799716 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799719 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799721 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799724 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799727 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799729 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799732 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799735 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799738 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799740 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799743 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799746 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799749 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799752 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799754 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799757 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799760 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:59:14.852266 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799762 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799765 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799768 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799770 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799775 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799778 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799781 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799784 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799787 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799791 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799794 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799797 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799802 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799805 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799809 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799811 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799815 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799818 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799820 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:59:14.852903 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799823 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799825 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799828 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799831 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799834 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799837 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799840 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799842 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799845 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799847 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799850 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799852 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799855 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799857 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799859 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799862 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799864 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799867 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799869 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799872 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:59:14.853543 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799874 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799878 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799880 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799883 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799885 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799889 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799892 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799894 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799897 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799900 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799904 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799907 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.799911 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800628 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800635 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800638 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800642 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800645 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800648 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:59:14.854180 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800651 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800653 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800656 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800659 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800661 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800664 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800666 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800669 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800671 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800674 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800676 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800679 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800681 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800684 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800686 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800689 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800691 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800694 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800696 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:59:14.854821 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800699 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800703 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800707 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800710 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800713 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800716 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800719 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800722 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800725 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800727 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800731 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800734 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800737 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800740 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800742 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800745 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800748 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800751 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800754 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800756 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:59:14.855479 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800759 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800762 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800765 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800769 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800772 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800774 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800777 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800788 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800792 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800797 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800801 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800805 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800808 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800812 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800816 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800820 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800823 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800827 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800831 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800835 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:59:14.856384 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800839 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800843 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800846 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800850 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800855 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800859 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800862 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800869 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800873 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800877 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800881 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800885 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800889 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800893 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800897 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800900 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800905 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800908 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800912 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:59:14.857040 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800919 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800922 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800926 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800930 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800934 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800938 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800941 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800945 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800950 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800956 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800960 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800964 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800967 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800971 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.800975 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801675 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801683 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801687 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801691 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:59:14.857658 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801695 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801699 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801703 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801708 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801712 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801716 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801719 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801724 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801728 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801732 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801738 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801743 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801747 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801754 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801758 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801762 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801766 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801770 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801774 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:59:14.858165 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801778 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801782 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801786 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801791 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801795 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801799 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801804 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801807 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801811 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801815 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801818 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801822 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801826 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801830 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801834 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801838 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801842 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801846 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801849 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801853 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:59:14.858877 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801857 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801860 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801864 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801867 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801871 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801874 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801879 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801883 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801886 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801890 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801893 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801897 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801900 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801904 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801909 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801916 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801920 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801923 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801927 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801931 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:59:14.859520 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801934 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801938 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801942 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801946 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801950 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801955 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801958 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801962 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801965 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801969 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801975 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801979 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801984 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801989 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801992 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.801997 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802001 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802004 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802009 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:59:14.860150 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802013 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802017 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802021 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802024 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802027 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802031 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802035 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802038 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802043 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802048 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802051 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802055 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802059 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802063 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802066 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802070 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802074 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802163 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802172 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802181 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802186 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 18:59:14.860803 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802192 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802197 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802202 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802207 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802211 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802216 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802220 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802225 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802230 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802234 2576 flags.go:64] FLAG: --cgroup-root="" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802240 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802245 2576 flags.go:64] FLAG: --client-ca-file="" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802249 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802252 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802257 2576 flags.go:64] FLAG: --cluster-domain="" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802262 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802266 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802271 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802275 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802282 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802286 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802291 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802295 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802300 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 09 18:59:14.861478 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802303 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802308 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802313 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802317 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802322 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802326 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802331 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802352 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802358 2576 flags.go:64] FLAG: --enable-server="true" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802363 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802369 2576 flags.go:64] FLAG: --event-burst="100" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802373 2576 flags.go:64] FLAG: --event-qps="50" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802377 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802381 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802385 2576 flags.go:64] FLAG: --eviction-hard="" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802390 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802394 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802398 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802404 2576 flags.go:64] FLAG: --eviction-soft="" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802409 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802413 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802417 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802421 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802425 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802429 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 18:59:14.862149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802434 2576 flags.go:64] FLAG: --feature-gates="" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802439 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802445 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802450 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802454 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802459 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802463 2576 flags.go:64] FLAG: --help="false" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802466 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-253.ec2.internal" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802471 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802475 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802480 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802485 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802490 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802494 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802498 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802503 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802507 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802511 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802516 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802520 2576 flags.go:64] FLAG: --kube-reserved="" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802524 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802528 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802532 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802536 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 18:59:14.863039 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802540 2576 flags.go:64] FLAG: --lock-file="" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802545 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802549 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802552 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802558 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802562 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802567 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802571 2576 flags.go:64] FLAG: --logging-format="text" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802575 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802580 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802586 2576 flags.go:64] FLAG: --manifest-url="" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802590 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802596 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802600 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802606 2576 flags.go:64] FLAG: --max-pods="110" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802610 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802614 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802618 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802622 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802626 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802630 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802634 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802645 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802649 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802654 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 18:59:14.866984 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802658 2576 flags.go:64] FLAG: --pod-cidr="" Jul 09 18:59:14.867272 ip-10-0-140-253 systemd[1]: Started Kubernetes Kubelet. Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802662 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802669 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802673 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802678 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802682 2576 flags.go:64] FLAG: --port="10250" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802686 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802690 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01e98f316674f4624" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802696 2576 flags.go:64] FLAG: --qos-reserved="" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802700 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802704 2576 flags.go:64] FLAG: --register-node="true" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802708 2576 flags.go:64] FLAG: --register-with-taints="" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802713 2576 flags.go:64] FLAG: --registry-burst="10" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802717 2576 flags.go:64] FLAG: --registry-qps="5" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802721 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802725 2576 flags.go:64] FLAG: --reserved-memory="" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802730 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802735 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802740 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802744 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802748 2576 flags.go:64] FLAG: --runonce="false" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802752 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802757 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802761 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802765 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 18:59:14.868625 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802768 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802771 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802776 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802780 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802782 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802785 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802788 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802792 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802795 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802798 2576 flags.go:64] FLAG: --system-cgroups="" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802801 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802806 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802809 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802811 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802815 2576 flags.go:64] FLAG: --tls-min-version="" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802819 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802822 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802824 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802827 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802830 2576 flags.go:64] FLAG: --v="2" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802834 2576 flags.go:64] FLAG: --version="false" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802838 2576 flags.go:64] FLAG: --vmodule="" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802841 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.802844 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802968 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:59:14.967281 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802975 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802978 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802980 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802983 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802986 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802988 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802991 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802993 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802996 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.802999 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803002 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803004 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803007 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803009 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803012 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803015 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803018 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803020 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803023 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803026 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:59:14.968176 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803028 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803031 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803034 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803037 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803039 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803042 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803045 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803048 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803051 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803053 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803056 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803058 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803062 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803065 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803067 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803070 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803073 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803075 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803078 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803080 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:59:14.970834 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803083 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803085 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803088 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803090 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803093 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803096 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803098 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803101 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803104 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803107 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803110 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803112 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803114 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803117 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803121 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803123 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803126 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803128 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803131 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:59:14.992367 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803133 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803136 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803138 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803141 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803143 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803147 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803150 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803152 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803155 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803157 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803160 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803162 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803165 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803167 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803170 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803172 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803175 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803177 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803180 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803182 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:59:14.993047 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803185 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803187 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803190 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803192 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803197 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803201 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803204 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803208 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803211 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803215 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803218 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803220 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803223 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803225 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803228 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803230 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803233 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803238 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:59:14.993927 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.803241 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.803740 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.810132 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.810147 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.810757 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.810764 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810828 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810834 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810837 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810840 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810843 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810846 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810848 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810851 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810854 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:59:14.994574 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810856 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810859 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810862 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810864 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810869 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810872 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810875 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810878 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810895 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810899 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810902 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810905 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810908 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810911 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810914 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810916 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810919 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810922 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810925 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:59:14.995232 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810927 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810936 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810941 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810945 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810948 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810950 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810953 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810955 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810958 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810960 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810963 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810966 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810968 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810971 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810974 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810977 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810979 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810983 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810987 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:59:14.995951 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810990 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810993 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810996 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.810998 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811001 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811004 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811007 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811010 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811013 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811016 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811019 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811022 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811025 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811028 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811030 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811044 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811047 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811051 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811054 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811057 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:59:14.996717 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811059 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811062 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811064 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811067 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811069 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811072 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811074 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811077 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811079 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811082 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811084 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811086 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811089 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811091 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811094 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811096 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811099 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811101 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811104 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811106 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:59:14.997398 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811109 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811111 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811116 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811119 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811121 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811124 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811127 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811129 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811137 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811142 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811144 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811147 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.811152 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811290 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811295 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 18:59:14.997993 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811298 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811301 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811303 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811306 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811308 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811311 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811313 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811316 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811318 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811321 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811324 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811326 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811329 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811331 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811334 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811353 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811356 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811358 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811361 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811363 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 18:59:14.998437 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811368 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811371 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811375 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811379 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811382 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811385 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811395 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811398 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811401 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811403 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811406 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811409 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811411 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811414 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811416 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811419 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811421 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811424 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811426 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 18:59:14.999123 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811429 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811431 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811434 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811436 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811439 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811441 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811444 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811446 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811449 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811451 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811454 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811456 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811459 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811462 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811465 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811468 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811470 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811473 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811475 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811479 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 18:59:14.999790 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811487 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811490 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811492 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811495 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811497 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811500 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811502 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811505 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811507 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811511 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811515 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811517 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811520 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811522 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811525 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811527 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811530 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811532 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811535 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811537 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 18:59:15.000461 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811540 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811542 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811545 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811547 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811550 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811555 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811558 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811561 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811564 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811566 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811569 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811575 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811578 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811586 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811589 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811592 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811594 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 18:59:15.001108 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:14.811597 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.811601 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.811720 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.814285 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.815364 2576 server.go:1019] "Starting client certificate rotation" Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.815470 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.815503 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.818937 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.826082 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.833781 2576 log.go:25] "Validated CRI v1 runtime API" Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.835785 2576 log.go:25] "Validated CRI v1 image API" Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.837435 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 18:59:15.001766 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.840246 2576 fs.go:135] Filesystem UUIDs: map[466d1825-e606-453b-bd3b-bac15c1a411f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 855fbaf1-289b-498f-bfa3-b2526777d3aa:/dev/nvme0n1p3] Jul 09 18:59:15.002201 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.840263 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 18:59:15.002648 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.845577 2576 manager.go:216] Machine: {Timestamp:2026-07-09 18:59:14.844880685 +0000 UTC m=+0.270448283 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099734 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a30203a14185adb21cde0e464f194 SystemUUID:ec2a3020-3a14-185a-db21-cde0e464f194 BootID:d10096ce-37a1-42fe-845e-ef689ffc5017 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c2:b2:bd:56:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c2:b2:bd:56:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:b7:8c:d0:8e:a4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 18:59:15.002648 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.845700 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 18:59:15.002648 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.845781 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 18:59:15.002648 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.847884 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 18:59:15.002648 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.847909 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 18:59:15.002648 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.848473 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 18:59:15.002648 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.848482 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 18:59:15.002648 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.848490 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.849633 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.850697 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.853581 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.854813 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.854931 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.854957 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.854966 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.854980 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.854989 2576 kubelet.go:398] "Adding apiserver pod source" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.854998 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.855349 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.855381 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.857147 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.858611 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.858647 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859236 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859252 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859259 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859267 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859279 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859287 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859298 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859306 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859319 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859327 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859355 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.859363 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.860409 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.860419 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.863904 2576 server.go:1268] "Started kubelet" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.863983 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.864057 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.864119 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.867141 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.867523 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.867887 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.867942 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.869538 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 18:59:15.005699 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.871130 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.874682 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-253.ec2.internal.18c0b42c50ae433c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-253.ec2.internal,UID:ip-10-0-140-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-253.ec2.internal,},FirstTimestamp:2026-07-09 18:59:14.863874876 +0000 UTC m=+0.289442477,LastTimestamp:2026-07-09 18:59:14.863874876 +0000 UTC m=+0.289442477,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-253.ec2.internal,}" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.875412 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.875434 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.875481 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876062 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876078 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876065 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876160 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876168 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876248 2576 factory.go:55] Registering systemd factory Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876260 2576 factory.go:223] Registration of the systemd container factory successfully Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876455 2576 factory.go:153] Registering CRI-O factory Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876466 2576 factory.go:223] Registration of the crio container factory successfully Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876516 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876540 2576 factory.go:103] Registering Raw factory Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876550 2576 manager.go:1196] Started watching for new ooms in manager Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.876965 2576 manager.go:349] Starting recovery of all containers Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.879012 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.879070 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.885603 2576 manager.go:354] Recovery completed Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.889308 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.891316 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.891359 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.891371 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.891838 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.891846 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.891859 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.891907 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.894036 2576 policy_none.go:49] "None policy: Start" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.894050 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.894060 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.894367 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.894390 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:59:15.006808 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.894401 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.896014 2576 policy_none.go:47] "Start" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.898859 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-253.ec2.internal.18c0b42c5251347e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-253.ec2.internal,UID:ip-10-0-140-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-253.ec2.internal,},FirstTimestamp:2026-07-09 18:59:14.891330686 +0000 UTC m=+0.316898289,LastTimestamp:2026-07-09 18:59:14.891330686 +0000 UTC m=+0.316898289,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-253.ec2.internal,}" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.904852 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fk5gr" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.908525 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-253.ec2.internal.18c0b42c5251bb70 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-253.ec2.internal,UID:ip-10-0-140-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-253.ec2.internal,},FirstTimestamp:2026-07-09 18:59:14.891365232 +0000 UTC m=+0.316932826,LastTimestamp:2026-07-09 18:59:14.891365232 +0000 UTC m=+0.316932826,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-253.ec2.internal,}" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.909693 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fk5gr" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.912055 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-253.ec2.internal.18c0b42c5251df18 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-253.ec2.internal,UID:ip-10-0-140-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-253.ec2.internal,},FirstTimestamp:2026-07-09 18:59:14.89137436 +0000 UTC m=+0.316941954,LastTimestamp:2026-07-09 18:59:14.89137436 +0000 UTC m=+0.316941954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-253.ec2.internal,}" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.918649 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-253.ec2.internal.18c0b42c5251347e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-253.ec2.internal.18c0b42c5251347e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-253.ec2.internal,UID:ip-10-0-140-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-253.ec2.internal,},FirstTimestamp:2026-07-09 18:59:14.891330686 +0000 UTC m=+0.316898289,LastTimestamp:2026-07-09 18:59:14.894378654 +0000 UTC m=+0.319946247,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-253.ec2.internal,}" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.937914 2576 manager.go:337] "Starting Device Plugin manager" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.938034 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.938043 2576 server.go:87] "Starting device plugin registration server" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.938218 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 18:59:15.014140 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.938227 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 18:59:15.014574 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.938314 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 18:59:15.014574 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.938406 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 18:59:15.014574 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:14.938416 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 18:59:15.014574 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.938848 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 18:59:15.014574 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:14.938894 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-253.ec2.internal\" not found" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.038700 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.040630 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.040655 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.040667 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.040690 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-253.ec2.internal" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.048140 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-253.ec2.internal" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:15.048161 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-253.ec2.internal\": node \"ip-10-0-140-253.ec2.internal\" not found" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:15.070754 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.079854 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.080919 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.080944 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.080962 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:15.080991 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 18:59:15.094151 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:15.083842 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:16.813917 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.823403 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal"] Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.823452 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.824805 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.824833 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.824843 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.827051 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.827179 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.827207 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.827635 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.827661 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.827674 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.827675 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.827694 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.827703 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.829883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.829903 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.830555 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.830578 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.830590 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:16.862111 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-253.ec2.internal\" not found" node="ip-10-0-140-253.ec2.internal" Jul 09 18:59:16.870514 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:16.866360 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-253.ec2.internal\" not found" node="ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.001133 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:16.913973 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" Jul 09 18:59:17.001133 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.922380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a6b77dd27131a920645a2b8ab7fa8ed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"5a6b77dd27131a920645a2b8ab7fa8ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.001133 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.922399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a6b77dd27131a920645a2b8ab7fa8ed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"5a6b77dd27131a920645a2b8ab7fa8ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.001133 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:16.922415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51fdd73d126d5084e958299073e38c7f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-253.ec2.internal\" (UID: \"51fdd73d126d5084e958299073e38c7f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.121752 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.014737 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" Jul 09 18:59:17.121752 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.023130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a6b77dd27131a920645a2b8ab7fa8ed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"5a6b77dd27131a920645a2b8ab7fa8ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.121752 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.023151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a6b77dd27131a920645a2b8ab7fa8ed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"5a6b77dd27131a920645a2b8ab7fa8ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.121752 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.023167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51fdd73d126d5084e958299073e38c7f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-253.ec2.internal\" (UID: \"51fdd73d126d5084e958299073e38c7f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.121752 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.023208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51fdd73d126d5084e958299073e38c7f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-253.ec2.internal\" (UID: \"51fdd73d126d5084e958299073e38c7f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.121752 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.023224 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5a6b77dd27131a920645a2b8ab7fa8ed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"5a6b77dd27131a920645a2b8ab7fa8ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.121752 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.023243 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a6b77dd27131a920645a2b8ab7fa8ed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"5a6b77dd27131a920645a2b8ab7fa8ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.121752 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.115286 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" Jul 09 18:59:17.205521 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.164740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.205521 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.169352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.293079 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.215954 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" Jul 09 18:59:17.386140 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.316483 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" Jul 09 18:59:17.386140 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.374555 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:59:17.492290 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.418669 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.492290 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.428227 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 18:59:17.492290 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.429528 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" Jul 09 18:59:17.492290 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.441179 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 18:59:17.492290 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.457317 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 18:59:17.492290 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.457426 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 18:59:17.492290 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.457427 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 18:59:17.498667 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.497602 2576 apiserver.go:52] "Watching apiserver" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.516350 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.518710 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.519642 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lpcft","kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal","openshift-cluster-node-tuning-operator/tuned-f4s2z","openshift-image-registry/node-ca-k5hq5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal","openshift-multus/multus-w9wrf","openshift-multus/network-metrics-daemon-c4kkr","openshift-network-operator/iptables-alerter-dqf62","kube-system/konnectivity-agent-dg6vk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px","openshift-dns/node-resolver-s4g5r","openshift-multus/multus-additional-cni-plugins-sk5px","openshift-network-diagnostics/network-check-target-q8hn6","openshift-ovn-kubernetes/ovnkube-node-69v7j"] Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.522188 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.524261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.525070 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.525094 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.525172 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2vtnp\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.525287 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.526436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.528714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.529061 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.529283 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.529404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hsvnj\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.529462 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.529515 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lkwqp\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.530242 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.530967 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.532084 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.532699 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.532887 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.533917 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.534684 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dzkpn\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.534823 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.534953 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.535070 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.535211 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 18:59:17.594287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.535369 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.535473 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.535643 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wstz2\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.535763 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.535975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.536492 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w7qxw\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.536626 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.536838 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.538345 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.538406 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.538686 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.538957 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.539137 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.539412 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.539647 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q6cpk\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.540176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.540228 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.540449 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.542391 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.542430 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.545128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.546859 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.547901 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.548455 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qcjkn\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.549929 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.550111 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s9mqf\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.550222 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 18:59:17.595764 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.550317 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 18:59:17.597885 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.563039 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 18:54:16 +0000 UTC" deadline="2028-03-22 04:14:55.886765652 +0000 UTC" Jul 09 18:59:17.597885 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.563080 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14913h15m38.323689617s" Jul 09 18:59:17.597885 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.564604 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jcpzn" Jul 09 18:59:17.597885 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.573688 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jcpzn" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.619452 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-systemd\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-conf-dir\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-run-ovn\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-sysconfig\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-socket-dir-parent\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-run-netns\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-cni-bin\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-os-release\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-lib-modules\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b717b23c-d36c-453a-9f54-a03a5e8d7317-agent-certs\") pod \"konnectivity-agent-dg6vk\" (UID: \"b717b23c-d36c-453a-9f54-a03a5e8d7317\") " pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-cni-dir\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e432054c-7eae-4a1f-a642-1c56f474dbb8-host\") pod \"node-ca-k5hq5\" (UID: \"e432054c-7eae-4a1f-a642-1c56f474dbb8\") " pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.692294 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nz85\" (UniqueName: \"kubernetes.io/projected/e432054c-7eae-4a1f-a642-1c56f474dbb8-kube-api-access-9nz85\") pod \"node-ca-k5hq5\" (UID: \"e432054c-7eae-4a1f-a642-1c56f474dbb8\") " pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-node-log\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-var-lib-cni-bin\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-run-multus-certs\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-tmp\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr7qf\" (UniqueName: \"kubernetes.io/projected/559bf9aa-006f-4808-b979-aecf3bb3b1cf-kube-api-access-zr7qf\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-cnibin\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d15fd65-8806-4f8c-a67e-48e48d1617dd-host-slash\") pod \"iptables-alerter-dqf62\" (UID: \"0d15fd65-8806-4f8c-a67e-48e48d1617dd\") " pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-daemon-config\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-run-systemd\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-cni-netd\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6380f011-119f-4154-824a-51ddb4626e9c-env-overrides\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkvcb\" (UniqueName: \"kubernetes.io/projected/6380f011-119f-4154-824a-51ddb4626e9c-kube-api-access-kkvcb\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmdzx\" (UniqueName: \"kubernetes.io/projected/a9f3616e-5200-4753-8a67-1252d9f93c23-kube-api-access-gmdzx\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:17.695183 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-system-cni-dir\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-hostroot\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-etc-selinux\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-sys-fs\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2c4f776-0c98-4e11-bb43-23c96122f8ff-hosts-file\") pod \"node-resolver-s4g5r\" (UID: \"b2c4f776-0c98-4e11-bb43-23c96122f8ff\") " pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6380f011-119f-4154-824a-51ddb4626e9c-ovn-node-metrics-cert\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6380f011-119f-4154-824a-51ddb4626e9c-ovnkube-script-lib\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpkv6\" (UniqueName: \"kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6\") pod \"network-check-target-q8hn6\" (UID: \"a0b2df71-b27f-4108-826a-b3cf0827e637\") " pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-os-release\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-socket-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-kubernetes\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e432054c-7eae-4a1f-a642-1c56f474dbb8-serviceca\") pod \"node-ca-k5hq5\" (UID: \"e432054c-7eae-4a1f-a642-1c56f474dbb8\") " pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.695837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-run-netns\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-etc-openvswitch\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-run-openvswitch\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.627997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7cd65f36-9ffa-46e3-995f-7cc0395f757d-dbus\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/559bf9aa-006f-4808-b979-aecf3bb3b1cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b717b23c-d36c-453a-9f54-a03a5e8d7317-konnectivity-ca\") pod \"konnectivity-agent-dg6vk\" (UID: \"b717b23c-d36c-453a-9f54-a03a5e8d7317\") " pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-log-socket\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6380f011-119f-4154-824a-51ddb4626e9c-ovnkube-config\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-sys\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-sysctl-conf\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-run\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.696811 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/559bf9aa-006f-4808-b979-aecf3bb3b1cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-run-k8s-cni-cncf-io\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-registration-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-systemd-units\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-var-lib-kubelet\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-device-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2c4f776-0c98-4e11-bb43-23c96122f8ff-tmp-dir\") pod \"node-resolver-s4g5r\" (UID: \"b2c4f776-0c98-4e11-bb43-23c96122f8ff\") " pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7cd65f36-9ffa-46e3-995f-7cc0395f757d-kubelet-config\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-system-cni-dir\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngx9g\" (UniqueName: \"kubernetes.io/projected/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-kube-api-access-ngx9g\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-slash\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thxtk\" (UniqueName: \"kubernetes.io/projected/0d15fd65-8806-4f8c-a67e-48e48d1617dd-kube-api-access-thxtk\") pod \"iptables-alerter-dqf62\" (UID: \"0d15fd65-8806-4f8c-a67e-48e48d1617dd\") " pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/559bf9aa-006f-4808-b979-aecf3bb3b1cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.697257 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-modprobe-d\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-var-lib-kubelet\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qfg4\" (UniqueName: \"kubernetes.io/projected/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-kube-api-access-6qfg4\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d15fd65-8806-4f8c-a67e-48e48d1617dd-iptables-alerter-script\") pod \"iptables-alerter-dqf62\" (UID: \"0d15fd65-8806-4f8c-a67e-48e48d1617dd\") " pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-var-lib-cni-multus\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmmhh\" (UniqueName: \"kubernetes.io/projected/07f68d9e-d699-4cd8-a254-c641caf926f9-kube-api-access-cmmhh\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-sysctl-d\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-host\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-tuned\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-var-lib-openvswitch\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-cnibin\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07f68d9e-d699-4cd8-a254-c641caf926f9-cni-binary-copy\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-etc-kubernetes\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.697946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msglk\" (UniqueName: \"kubernetes.io/projected/b2c4f776-0c98-4e11-bb43-23c96122f8ff-kube-api-access-msglk\") pod \"node-resolver-s4g5r\" (UID: \"b2c4f776-0c98-4e11-bb43-23c96122f8ff\") " pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.698390 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.628818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-kubelet\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-socket-dir-parent\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-run-netns\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-cni-bin\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738791 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-socket-dir-parent\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-os-release\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-lib-modules\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738875 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-os-release\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b717b23c-d36c-453a-9f54-a03a5e8d7317-agent-certs\") pod \"konnectivity-agent-dg6vk\" (UID: \"b717b23c-d36c-453a-9f54-a03a5e8d7317\") " pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-cni-dir\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e432054c-7eae-4a1f-a642-1c56f474dbb8-host\") pod \"node-ca-k5hq5\" (UID: \"e432054c-7eae-4a1f-a642-1c56f474dbb8\") " pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.738974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nz85\" (UniqueName: \"kubernetes.io/projected/e432054c-7eae-4a1f-a642-1c56f474dbb8-kube-api-access-9nz85\") pod \"node-ca-k5hq5\" (UID: \"e432054c-7eae-4a1f-a642-1c56f474dbb8\") " pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-node-log\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-var-lib-cni-bin\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-run-multus-certs\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.774081 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-tmp\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr7qf\" (UniqueName: \"kubernetes.io/projected/559bf9aa-006f-4808-b979-aecf3bb3b1cf-kube-api-access-zr7qf\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-cnibin\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d15fd65-8806-4f8c-a67e-48e48d1617dd-host-slash\") pod \"iptables-alerter-dqf62\" (UID: \"0d15fd65-8806-4f8c-a67e-48e48d1617dd\") " pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-daemon-config\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739212 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-run-systemd\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-cni-netd\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6380f011-119f-4154-824a-51ddb4626e9c-env-overrides\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkvcb\" (UniqueName: \"kubernetes.io/projected/6380f011-119f-4154-824a-51ddb4626e9c-kube-api-access-kkvcb\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmdzx\" (UniqueName: \"kubernetes.io/projected/a9f3616e-5200-4753-8a67-1252d9f93c23-kube-api-access-gmdzx\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-system-cni-dir\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-hostroot\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-etc-selinux\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-sys-fs\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.775034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2c4f776-0c98-4e11-bb43-23c96122f8ff-hosts-file\") pod \"node-resolver-s4g5r\" (UID: \"b2c4f776-0c98-4e11-bb43-23c96122f8ff\") " pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6380f011-119f-4154-824a-51ddb4626e9c-ovn-node-metrics-cert\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6380f011-119f-4154-824a-51ddb4626e9c-ovnkube-script-lib\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkv6\" (UniqueName: \"kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6\") pod \"network-check-target-q8hn6\" (UID: \"a0b2df71-b27f-4108-826a-b3cf0827e637\") " pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-os-release\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739632 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-lib-modules\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-socket-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-run-systemd\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-kubernetes\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739766 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-run-netns\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e432054c-7eae-4a1f-a642-1c56f474dbb8-serviceca\") pod \"node-ca-k5hq5\" (UID: \"e432054c-7eae-4a1f-a642-1c56f474dbb8\") " pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-run-netns\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.778166 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-etc-openvswitch\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-run-openvswitch\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7cd65f36-9ffa-46e3-995f-7cc0395f757d-dbus\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/559bf9aa-006f-4808-b979-aecf3bb3b1cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b717b23c-d36c-453a-9f54-a03a5e8d7317-konnectivity-ca\") pod \"konnectivity-agent-dg6vk\" (UID: \"b717b23c-d36c-453a-9f54-a03a5e8d7317\") " pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.739994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-log-socket\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6380f011-119f-4154-824a-51ddb4626e9c-ovnkube-config\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-sys\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-sysctl-conf\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-run\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/559bf9aa-006f-4808-b979-aecf3bb3b1cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-run-k8s-cni-cncf-io\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.778936 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-registration-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-systemd-units\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-var-lib-kubelet\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740291 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e432054c-7eae-4a1f-a642-1c56f474dbb8-serviceca\") pod \"node-ca-k5hq5\" (UID: \"e432054c-7eae-4a1f-a642-1c56f474dbb8\") " pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740344 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2c4f776-0c98-4e11-bb43-23c96122f8ff-hosts-file\") pod \"node-resolver-s4g5r\" (UID: \"b2c4f776-0c98-4e11-bb43-23c96122f8ff\") " pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-var-lib-kubelet\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740386 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-cni-bin\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740398 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-cni-netd\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740520 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-cni-dir\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740693 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-os-release\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740801 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-socket-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740874 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6380f011-119f-4154-824a-51ddb4626e9c-env-overrides\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.740933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.741029 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741054 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6380f011-119f-4154-824a-51ddb4626e9c-ovnkube-script-lib\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.779777 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.741103 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret podName:7cd65f36-9ffa-46e3-995f-7cc0395f757d nodeName:}" failed. No retries permitted until 2026-07-09 18:59:18.241083538 +0000 UTC m=+2.024491295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret") pod "global-pull-secret-syncer-lpcft" (UID: "7cd65f36-9ffa-46e3-995f-7cc0395f757d") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741131 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e432054c-7eae-4a1f-a642-1c56f474dbb8-host\") pod \"node-ca-k5hq5\" (UID: \"e432054c-7eae-4a1f-a642-1c56f474dbb8\") " pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741196 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-hostroot\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741206 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-node-log\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741262 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-var-lib-cni-bin\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741276 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-run-multus-certs\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741369 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-run-netns\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741617 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d15fd65-8806-4f8c-a67e-48e48d1617dd-host-slash\") pod \"iptables-alerter-dqf62\" (UID: \"0d15fd65-8806-4f8c-a67e-48e48d1617dd\") " pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741705 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-cnibin\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741738 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b717b23c-d36c-453a-9f54-a03a5e8d7317-konnectivity-ca\") pod \"konnectivity-agent-dg6vk\" (UID: \"b717b23c-d36c-453a-9f54-a03a5e8d7317\") " pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741765 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-run-openvswitch\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741846 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-log-socket\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741853 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-run\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.741986 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-sys\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-system-cni-dir\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.781287 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742279 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-sys-fs\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742344 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742023 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-sysctl-conf\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742344 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-kubernetes\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-device-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742468 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-etc-selinux\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742545 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6380f011-119f-4154-824a-51ddb4626e9c-ovnkube-config\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/559bf9aa-006f-4808-b979-aecf3bb3b1cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742668 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-etc-openvswitch\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742672 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-systemd-units\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742728 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742883 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-device-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2c4f776-0c98-4e11-bb43-23c96122f8ff-tmp-dir\") pod \"node-resolver-s4g5r\" (UID: \"b2c4f776-0c98-4e11-bb43-23c96122f8ff\") " pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.742969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7cd65f36-9ffa-46e3-995f-7cc0395f757d-kubelet-config\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:17.781947 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743014 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/559bf9aa-006f-4808-b979-aecf3bb3b1cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743031 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7cd65f36-9ffa-46e3-995f-7cc0395f757d-kubelet-config\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743034 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7cd65f36-9ffa-46e3-995f-7cc0395f757d-dbus\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-daemon-config\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-system-cni-dir\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743102 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2c4f776-0c98-4e11-bb43-23c96122f8ff-tmp-dir\") pod \"node-resolver-s4g5r\" (UID: \"b2c4f776-0c98-4e11-bb43-23c96122f8ff\") " pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngx9g\" (UniqueName: \"kubernetes.io/projected/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-kube-api-access-ngx9g\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743132 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-run-k8s-cni-cncf-io\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743180 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-registration-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-slash\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743212 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-system-cni-dir\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thxtk\" (UniqueName: \"kubernetes.io/projected/0d15fd65-8806-4f8c-a67e-48e48d1617dd-kube-api-access-thxtk\") pod \"iptables-alerter-dqf62\" (UID: \"0d15fd65-8806-4f8c-a67e-48e48d1617dd\") " pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-slash\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/559bf9aa-006f-4808-b979-aecf3bb3b1cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-modprobe-d\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.784210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743344 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b717b23c-d36c-453a-9f54-a03a5e8d7317-agent-certs\") pod \"konnectivity-agent-dg6vk\" (UID: \"b717b23c-d36c-453a-9f54-a03a5e8d7317\") " pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-var-lib-kubelet\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qfg4\" (UniqueName: \"kubernetes.io/projected/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-kube-api-access-6qfg4\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d15fd65-8806-4f8c-a67e-48e48d1617dd-iptables-alerter-script\") pod \"iptables-alerter-dqf62\" (UID: \"0d15fd65-8806-4f8c-a67e-48e48d1617dd\") " pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-var-lib-cni-multus\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-var-lib-kubelet\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-modprobe-d\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.743992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmmhh\" (UniqueName: \"kubernetes.io/projected/07f68d9e-d699-4cd8-a254-c641caf926f9-kube-api-access-cmmhh\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-sysctl-d\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-host\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-tuned\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744113 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-host-var-lib-cni-multus\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744150 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-sysctl-d\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.785095 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-var-lib-openvswitch\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744193 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/559bf9aa-006f-4808-b979-aecf3bb3b1cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-cnibin\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744250 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07f68d9e-d699-4cd8-a254-c641caf926f9-cni-binary-copy\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744291 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-host\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/559bf9aa-006f-4808-b979-aecf3bb3b1cf-cnibin\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-etc-kubernetes\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744273 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-var-lib-openvswitch\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744347 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-tmp\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msglk\" (UniqueName: \"kubernetes.io/projected/b2c4f776-0c98-4e11-bb43-23c96122f8ff-kube-api-access-msglk\") pod \"node-resolver-s4g5r\" (UID: \"b2c4f776-0c98-4e11-bb43-23c96122f8ff\") " pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-kubelet\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744393 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-etc-kubernetes\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-systemd\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744434 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-host-kubelet\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.855480 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-conf-dir\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-run-ovn\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744476 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6380f011-119f-4154-824a-51ddb4626e9c-ovn-node-metrics-cert\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744493 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-systemd\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744525 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d15fd65-8806-4f8c-a67e-48e48d1617dd-iptables-alerter-script\") pod \"iptables-alerter-dqf62\" (UID: \"0d15fd65-8806-4f8c-a67e-48e48d1617dd\") " pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-sysconfig\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07f68d9e-d699-4cd8-a254-c641caf926f9-multus-conf-dir\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744551 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6380f011-119f-4154-824a-51ddb4626e9c-run-ovn\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.744574 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744603 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-sysconfig\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.744624 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs podName:a9f3616e-5200-4753-8a67-1252d9f93c23 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:18.244607565 +0000 UTC m=+2.028015311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs") pod "network-metrics-daemon-c4kkr" (UID: "a9f3616e-5200-4753-8a67-1252d9f93c23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.744749 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07f68d9e-d699-4cd8-a254-c641caf926f9-cni-binary-copy\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.745957 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-etc-tuned\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.751743 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:59:17.856143 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.751761 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.751775 2576 projected.go:196] Error preparing data for projected volume kube-api-access-mpkv6 for pod openshift-network-diagnostics/network-check-target-q8hn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:17.751838 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6 podName:a0b2df71-b27f-4108-826a-b3cf0827e637 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:18.251822727 +0000 UTC m=+2.035230505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkv6" (UniqueName: "kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6") pod "network-check-target-q8hn6" (UID: "a0b2df71-b27f-4108-826a-b3cf0827e637") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.754538 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thxtk\" (UniqueName: \"kubernetes.io/projected/0d15fd65-8806-4f8c-a67e-48e48d1617dd-kube-api-access-thxtk\") pod \"iptables-alerter-dqf62\" (UID: \"0d15fd65-8806-4f8c-a67e-48e48d1617dd\") " pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.755225 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr7qf\" (UniqueName: \"kubernetes.io/projected/559bf9aa-006f-4808-b979-aecf3bb3b1cf-kube-api-access-zr7qf\") pod \"multus-additional-cni-plugins-sk5px\" (UID: \"559bf9aa-006f-4808-b979-aecf3bb3b1cf\") " pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.756289 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qfg4\" (UniqueName: \"kubernetes.io/projected/bb1b739f-b577-43c5-9e2b-ad4953d97f5c-kube-api-access-6qfg4\") pod \"tuned-f4s2z\" (UID: \"bb1b739f-b577-43c5-9e2b-ad4953d97f5c\") " pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.757118 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nz85\" (UniqueName: \"kubernetes.io/projected/e432054c-7eae-4a1f-a642-1c56f474dbb8-kube-api-access-9nz85\") pod \"node-ca-k5hq5\" (UID: \"e432054c-7eae-4a1f-a642-1c56f474dbb8\") " pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.759765 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmmhh\" (UniqueName: \"kubernetes.io/projected/07f68d9e-d699-4cd8-a254-c641caf926f9-kube-api-access-cmmhh\") pod \"multus-w9wrf\" (UID: \"07f68d9e-d699-4cd8-a254-c641caf926f9\") " pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.759801 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msglk\" (UniqueName: \"kubernetes.io/projected/b2c4f776-0c98-4e11-bb43-23c96122f8ff-kube-api-access-msglk\") pod \"node-resolver-s4g5r\" (UID: \"b2c4f776-0c98-4e11-bb43-23c96122f8ff\") " pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.765645 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmdzx\" (UniqueName: \"kubernetes.io/projected/a9f3616e-5200-4753-8a67-1252d9f93c23-kube-api-access-gmdzx\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.766069 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkvcb\" (UniqueName: \"kubernetes.io/projected/6380f011-119f-4154-824a-51ddb4626e9c-kube-api-access-kkvcb\") pod \"ovnkube-node-69v7j\" (UID: \"6380f011-119f-4154-824a-51ddb4626e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.767163 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngx9g\" (UniqueName: \"kubernetes.io/projected/e436780c-2fe2-4b90-ad37-8f07c7b3bdc6-kube-api-access-ngx9g\") pod \"aws-ebs-csi-driver-node-w96px\" (UID: \"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.768268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w9wrf" Jul 09 18:59:17.862061 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.780722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k5hq5" Jul 09 18:59:17.877821 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.877801 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" Jul 09 18:59:17.879390 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:17.879358 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6b77dd27131a920645a2b8ab7fa8ed.slice/crio-1237af1c18772130a1bce020c2f1a1292aefe2bcfff66ccc3a0eece20324f7c2 WatchSource:0}: Error finding container 1237af1c18772130a1bce020c2f1a1292aefe2bcfff66ccc3a0eece20324f7c2: Status 404 returned error can't find the container with id 1237af1c18772130a1bce020c2f1a1292aefe2bcfff66ccc3a0eece20324f7c2 Jul 09 18:59:17.882072 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.882056 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:59:17.886987 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.886898 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 18:59:17.892566 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:17.892543 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51fdd73d126d5084e958299073e38c7f.slice/crio-32b060026e85795a1523968d510d1058dd0b54f521fe3cd295217d394925b6cc WatchSource:0}: Error finding container 32b060026e85795a1523968d510d1058dd0b54f521fe3cd295217d394925b6cc: Status 404 returned error can't find the container with id 32b060026e85795a1523968d510d1058dd0b54f521fe3cd295217d394925b6cc Jul 09 18:59:17.893784 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:17.893764 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode436780c_2fe2_4b90_ad37_8f07c7b3bdc6.slice/crio-b84ec1a4f4212d2c8b057103fca61157288c0d6a55eac363970d5ca61537a3ed WatchSource:0}: Error finding container b84ec1a4f4212d2c8b057103fca61157288c0d6a55eac363970d5ca61537a3ed: Status 404 returned error can't find the container with id b84ec1a4f4212d2c8b057103fca61157288c0d6a55eac363970d5ca61537a3ed Jul 09 18:59:17.894423 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.894409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s4g5r" Jul 09 18:59:17.900192 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.900178 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" Jul 09 18:59:17.903760 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:17.903739 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c4f776_0c98_4e11_bb43_23c96122f8ff.slice/crio-ffe1c3cd475f32cfe1f0e7b3bdf8cd128cd07fefae592968e451d9310f2676b3 WatchSource:0}: Error finding container ffe1c3cd475f32cfe1f0e7b3bdf8cd128cd07fefae592968e451d9310f2676b3: Status 404 returned error can't find the container with id ffe1c3cd475f32cfe1f0e7b3bdf8cd128cd07fefae592968e451d9310f2676b3 Jul 09 18:59:17.908078 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:17.908057 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1b739f_b577_43c5_9e2b_ad4953d97f5c.slice/crio-813be8d904201f924bd91ccde66bfac5c73a9cd1b4a7de53147e96c45ef9d2c7 WatchSource:0}: Error finding container 813be8d904201f924bd91ccde66bfac5c73a9cd1b4a7de53147e96c45ef9d2c7: Status 404 returned error can't find the container with id 813be8d904201f924bd91ccde66bfac5c73a9cd1b4a7de53147e96c45ef9d2c7 Jul 09 18:59:17.920858 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.920829 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:17.932225 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.932145 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:59:17.951641 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.951625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dqf62" Jul 09 18:59:17.958329 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:17.958314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sk5px" Jul 09 18:59:17.958608 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:17.958580 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d15fd65_8806_4f8c_a67e_48e48d1617dd.slice/crio-96214eff96a67e17067820f2edf583c67e76e7afacfb584db2ae3d3e6ce56684 WatchSource:0}: Error finding container 96214eff96a67e17067820f2edf583c67e76e7afacfb584db2ae3d3e6ce56684: Status 404 returned error can't find the container with id 96214eff96a67e17067820f2edf583c67e76e7afacfb584db2ae3d3e6ce56684 Jul 09 18:59:17.965528 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:17.965476 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559bf9aa_006f_4808_b979_aecf3bb3b1cf.slice/crio-888f48df89a1e1643aea44ecf47bcbb4fce8c55a7175f87f87c4d605ab97528a WatchSource:0}: Error finding container 888f48df89a1e1643aea44ecf47bcbb4fce8c55a7175f87f87c4d605ab97528a: Status 404 returned error can't find the container with id 888f48df89a1e1643aea44ecf47bcbb4fce8c55a7175f87f87c4d605ab97528a Jul 09 18:59:18.021525 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.021488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:18.030228 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:18.030211 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb717b23c_d36c_453a_9f54_a03a5e8d7317.slice/crio-f920ed00cfd77946321006be85c7a8bde9bf10eef3844f6582c8ff5783f8603a WatchSource:0}: Error finding container f920ed00cfd77946321006be85c7a8bde9bf10eef3844f6582c8ff5783f8603a: Status 404 returned error can't find the container with id f920ed00cfd77946321006be85c7a8bde9bf10eef3844f6582c8ff5783f8603a Jul 09 18:59:18.230107 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:18.230086 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode432054c_7eae_4a1f_a642_1c56f474dbb8.slice/crio-a9eadc4278378fccb7bbf12adbc9c4e9053a2be964ef60e3e6fe183d3ef76c47 WatchSource:0}: Error finding container a9eadc4278378fccb7bbf12adbc9c4e9053a2be964ef60e3e6fe183d3ef76c47: Status 404 returned error can't find the container with id a9eadc4278378fccb7bbf12adbc9c4e9053a2be964ef60e3e6fe183d3ef76c47 Jul 09 18:59:18.248608 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.248590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:18.248693 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.248636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:18.248739 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:18.248714 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:18.248739 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:18.248717 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:18.248803 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:18.248755 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs podName:a9f3616e-5200-4753-8a67-1252d9f93c23 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:19.248741961 +0000 UTC m=+3.032149705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs") pod "network-metrics-daemon-c4kkr" (UID: "a9f3616e-5200-4753-8a67-1252d9f93c23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:18.248803 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:18.248769 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret podName:7cd65f36-9ffa-46e3-995f-7cc0395f757d nodeName:}" failed. No retries permitted until 2026-07-09 18:59:19.248761705 +0000 UTC m=+3.032169448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret") pod "global-pull-secret-syncer-lpcft" (UID: "7cd65f36-9ffa-46e3-995f-7cc0395f757d") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:18.274280 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:18.274259 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f68d9e_d699_4cd8_a254_c641caf926f9.slice/crio-5f9cbf888a6b704f8c2aa735c77418ff59f72dc47137fdec0f386faf594224b4 WatchSource:0}: Error finding container 5f9cbf888a6b704f8c2aa735c77418ff59f72dc47137fdec0f386faf594224b4: Status 404 returned error can't find the container with id 5f9cbf888a6b704f8c2aa735c77418ff59f72dc47137fdec0f386faf594224b4 Jul 09 18:59:18.349891 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.349870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkv6\" (UniqueName: \"kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6\") pod \"network-check-target-q8hn6\" (UID: \"a0b2df71-b27f-4108-826a-b3cf0827e637\") " pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:18.350001 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:18.349987 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:59:18.350043 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:18.350004 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:59:18.350043 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:18.350012 2576 projected.go:196] Error preparing data for projected volume kube-api-access-mpkv6 for pod openshift-network-diagnostics/network-check-target-q8hn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:18.350114 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:18.350062 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6 podName:a0b2df71-b27f-4108-826a-b3cf0827e637 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:19.35004844 +0000 UTC m=+3.133456183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkv6" (UniqueName: "kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6") pod "network-check-target-q8hn6" (UID: "a0b2df71-b27f-4108-826a-b3cf0827e637") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:18.576872 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.576732 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:54:17 +0000 UTC" deadline="2028-03-14 20:20:48.92007777 +0000 UTC" Jul 09 18:59:18.576872 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.576780 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14737h21m30.343303048s" Jul 09 18:59:18.683558 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.683363 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:59:18.745904 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.745845 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w9wrf" event={"ID":"07f68d9e-d699-4cd8-a254-c641caf926f9","Type":"ContainerStarted","Data":"5f9cbf888a6b704f8c2aa735c77418ff59f72dc47137fdec0f386faf594224b4"} Jul 09 18:59:18.765073 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.764973 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk5px" event={"ID":"559bf9aa-006f-4808-b979-aecf3bb3b1cf","Type":"ContainerStarted","Data":"888f48df89a1e1643aea44ecf47bcbb4fce8c55a7175f87f87c4d605ab97528a"} Jul 09 18:59:18.768239 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.768159 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dqf62" event={"ID":"0d15fd65-8806-4f8c-a67e-48e48d1617dd","Type":"ContainerStarted","Data":"96214eff96a67e17067820f2edf583c67e76e7afacfb584db2ae3d3e6ce56684"} Jul 09 18:59:18.781182 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.781098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerStarted","Data":"f6aa605454f18cc475773486290aa18e44c9a75dde992eb844801a7243494cfe"} Jul 09 18:59:18.784261 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.784211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" event={"ID":"bb1b739f-b577-43c5-9e2b-ad4953d97f5c","Type":"ContainerStarted","Data":"813be8d904201f924bd91ccde66bfac5c73a9cd1b4a7de53147e96c45ef9d2c7"} Jul 09 18:59:18.797723 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.797696 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s4g5r" event={"ID":"b2c4f776-0c98-4e11-bb43-23c96122f8ff","Type":"ContainerStarted","Data":"ffe1c3cd475f32cfe1f0e7b3bdf8cd128cd07fefae592968e451d9310f2676b3"} Jul 09 18:59:18.825167 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.825090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" event={"ID":"5a6b77dd27131a920645a2b8ab7fa8ed","Type":"ContainerStarted","Data":"1237af1c18772130a1bce020c2f1a1292aefe2bcfff66ccc3a0eece20324f7c2"} Jul 09 18:59:18.848110 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.848039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k5hq5" event={"ID":"e432054c-7eae-4a1f-a642-1c56f474dbb8","Type":"ContainerStarted","Data":"a9eadc4278378fccb7bbf12adbc9c4e9053a2be964ef60e3e6fe183d3ef76c47"} Jul 09 18:59:18.863985 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.863920 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dg6vk" event={"ID":"b717b23c-d36c-453a-9f54-a03a5e8d7317","Type":"ContainerStarted","Data":"f920ed00cfd77946321006be85c7a8bde9bf10eef3844f6582c8ff5783f8603a"} Jul 09 18:59:18.883641 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.883559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" event={"ID":"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6","Type":"ContainerStarted","Data":"b84ec1a4f4212d2c8b057103fca61157288c0d6a55eac363970d5ca61537a3ed"} Jul 09 18:59:18.907666 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:18.907609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" event={"ID":"51fdd73d126d5084e958299073e38c7f","Type":"ContainerStarted","Data":"32b060026e85795a1523968d510d1058dd0b54f521fe3cd295217d394925b6cc"} Jul 09 18:59:19.259632 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:19.259550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:19.259789 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:19.259631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:19.259849 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.259785 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:19.259849 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.259846 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret podName:7cd65f36-9ffa-46e3-995f-7cc0395f757d nodeName:}" failed. No retries permitted until 2026-07-09 18:59:21.259828269 +0000 UTC m=+5.043236014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret") pod "global-pull-secret-syncer-lpcft" (UID: "7cd65f36-9ffa-46e3-995f-7cc0395f757d") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:19.259953 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.259915 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:19.259953 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.259950 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs podName:a9f3616e-5200-4753-8a67-1252d9f93c23 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:21.259938373 +0000 UTC m=+5.043346139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs") pod "network-metrics-daemon-c4kkr" (UID: "a9f3616e-5200-4753-8a67-1252d9f93c23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:19.360071 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:19.360017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkv6\" (UniqueName: \"kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6\") pod \"network-check-target-q8hn6\" (UID: \"a0b2df71-b27f-4108-826a-b3cf0827e637\") " pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:19.360233 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.360218 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:59:19.360306 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.360238 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:59:19.360306 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.360251 2576 projected.go:196] Error preparing data for projected volume kube-api-access-mpkv6 for pod openshift-network-diagnostics/network-check-target-q8hn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:19.360411 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.360311 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6 podName:a0b2df71-b27f-4108-826a-b3cf0827e637 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:21.360287433 +0000 UTC m=+5.143695181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkv6" (UniqueName: "kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6") pod "network-check-target-q8hn6" (UID: "a0b2df71-b27f-4108-826a-b3cf0827e637") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:19.577237 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:19.577136 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:54:17 +0000 UTC" deadline="2027-12-07 13:21:14.321381363 +0000 UTC" Jul 09 18:59:19.577237 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:19.577196 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12378h21m54.744188905s" Jul 09 18:59:19.724983 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:19.724180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:19.724983 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.724304 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:19.724983 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:19.724705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:19.724983 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.724793 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:19.724983 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:19.724853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:19.724983 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:19.724932 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:20.056170 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:20.055910 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 18:59:21.274801 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:21.274767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:21.275243 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:21.274846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:21.275243 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.274975 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:21.275243 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.275033 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret podName:7cd65f36-9ffa-46e3-995f-7cc0395f757d nodeName:}" failed. No retries permitted until 2026-07-09 18:59:25.27501543 +0000 UTC m=+9.058423179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret") pod "global-pull-secret-syncer-lpcft" (UID: "7cd65f36-9ffa-46e3-995f-7cc0395f757d") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:21.275433 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.275399 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:21.275487 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.275447 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs podName:a9f3616e-5200-4753-8a67-1252d9f93c23 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:25.275431184 +0000 UTC m=+9.058838942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs") pod "network-metrics-daemon-c4kkr" (UID: "a9f3616e-5200-4753-8a67-1252d9f93c23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:21.376224 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:21.376149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkv6\" (UniqueName: \"kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6\") pod \"network-check-target-q8hn6\" (UID: \"a0b2df71-b27f-4108-826a-b3cf0827e637\") " pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:21.376413 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.376371 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:59:21.376413 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.376394 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:59:21.376413 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.376407 2576 projected.go:196] Error preparing data for projected volume kube-api-access-mpkv6 for pod openshift-network-diagnostics/network-check-target-q8hn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:21.376593 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.376461 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6 podName:a0b2df71-b27f-4108-826a-b3cf0827e637 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:25.376443054 +0000 UTC m=+9.159850802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkv6" (UniqueName: "kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6") pod "network-check-target-q8hn6" (UID: "a0b2df71-b27f-4108-826a-b3cf0827e637") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:21.724303 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:21.724230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:21.724463 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.724352 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:21.725100 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:21.724701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:21.725100 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.724881 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:21.725100 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:21.724966 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:21.725100 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:21.725061 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:23.724419 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:23.724381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:23.724842 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:23.724430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:23.724842 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:23.724519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:23.724842 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:23.724523 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:23.724842 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:23.724618 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:23.724842 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:23.724687 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:25.312353 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:25.312316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:25.312779 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:25.312392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:25.312779 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.312486 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:25.312779 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.312528 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:25.312779 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.312572 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs podName:a9f3616e-5200-4753-8a67-1252d9f93c23 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:33.312551565 +0000 UTC m=+17.095959310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs") pod "network-metrics-daemon-c4kkr" (UID: "a9f3616e-5200-4753-8a67-1252d9f93c23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:25.312779 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.312589 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret podName:7cd65f36-9ffa-46e3-995f-7cc0395f757d nodeName:}" failed. No retries permitted until 2026-07-09 18:59:33.312580709 +0000 UTC m=+17.095988452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret") pod "global-pull-secret-syncer-lpcft" (UID: "7cd65f36-9ffa-46e3-995f-7cc0395f757d") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:25.413204 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:25.413163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkv6\" (UniqueName: \"kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6\") pod \"network-check-target-q8hn6\" (UID: \"a0b2df71-b27f-4108-826a-b3cf0827e637\") " pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:25.413392 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.413370 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:59:25.413392 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.413390 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:59:25.413587 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.413403 2576 projected.go:196] Error preparing data for projected volume kube-api-access-mpkv6 for pod openshift-network-diagnostics/network-check-target-q8hn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:25.413587 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.413471 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6 podName:a0b2df71-b27f-4108-826a-b3cf0827e637 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:33.413453058 +0000 UTC m=+17.196860818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkv6" (UniqueName: "kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6") pod "network-check-target-q8hn6" (UID: "a0b2df71-b27f-4108-826a-b3cf0827e637") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:25.723926 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:25.723812 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:25.723926 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:25.723843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:25.724134 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.723936 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:25.724273 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:25.723812 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:25.724388 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.724308 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:25.724453 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:25.724401 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:27.724896 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:27.724142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:27.724896 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:27.724257 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:27.724896 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:27.724334 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:27.724896 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:27.724414 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:27.724896 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:27.724469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:27.724896 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:27.724555 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:29.723465 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:29.723395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:29.723465 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:29.723409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:29.723918 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:29.723530 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:29.723918 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:29.723577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:29.723918 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:29.723662 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:29.723918 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:29.723743 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:31.724214 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:31.724177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:31.724214 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:31.724200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:31.724748 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:31.724205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:31.724748 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:31.724284 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:31.724748 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:31.724397 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:31.724748 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:31.724519 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:33.371127 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:33.371090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:33.371579 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:33.371145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:33.371579 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.371245 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:33.371579 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.371251 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:33.371579 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.371308 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret podName:7cd65f36-9ffa-46e3-995f-7cc0395f757d nodeName:}" failed. No retries permitted until 2026-07-09 18:59:49.371290039 +0000 UTC m=+33.154697782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret") pod "global-pull-secret-syncer-lpcft" (UID: "7cd65f36-9ffa-46e3-995f-7cc0395f757d") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:33.371579 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.371329 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs podName:a9f3616e-5200-4753-8a67-1252d9f93c23 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:49.371317701 +0000 UTC m=+33.154725455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs") pod "network-metrics-daemon-c4kkr" (UID: "a9f3616e-5200-4753-8a67-1252d9f93c23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:33.472379 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:33.472289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkv6\" (UniqueName: \"kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6\") pod \"network-check-target-q8hn6\" (UID: \"a0b2df71-b27f-4108-826a-b3cf0827e637\") " pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:33.472531 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.472458 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:59:33.472531 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.472478 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:59:33.472531 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.472490 2576 projected.go:196] Error preparing data for projected volume kube-api-access-mpkv6 for pod openshift-network-diagnostics/network-check-target-q8hn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:33.472655 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.472561 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6 podName:a0b2df71-b27f-4108-826a-b3cf0827e637 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:49.472545046 +0000 UTC m=+33.255952789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkv6" (UniqueName: "kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6") pod "network-check-target-q8hn6" (UID: "a0b2df71-b27f-4108-826a-b3cf0827e637") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:33.724247 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:33.724167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:33.724403 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:33.724167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:33.724403 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.724290 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:33.724403 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.724383 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:33.724403 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:33.724182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:33.724646 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:33.724486 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:35.723841 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:35.723806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:35.724293 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:35.723919 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:35.724293 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:35.723934 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:35.724293 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:35.723925 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:35.724293 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:35.724037 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:35.724293 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:35.724109 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:37.723416 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:37.723390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:37.723786 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:37.723483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:37.723786 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:37.723483 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:37.723786 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:37.723486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:37.723786 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:37.723613 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:37.723786 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:37.723743 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:37.965817 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:37.965775 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 18:59:37.966887 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:37.966859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerStarted","Data":"95462f03a0330ccaf85c467b64d5576d2d74fbff48b12872bc936a84e6edfb58"} Jul 09 18:59:37.967013 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:37.966955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerStarted","Data":"1c3f093de4c77b852829a180e5cc726328c952649194ef67edbafbc113f0fb95"} Jul 09 18:59:37.971169 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:37.971054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" event={"ID":"bb1b739f-b577-43c5-9e2b-ad4953d97f5c","Type":"ContainerStarted","Data":"569324a432ce7175c7979eb4bf0d7e8ea6024a8ccfb2bbdb32596459d795ff33"} Jul 09 18:59:37.978376 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:37.978350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" event={"ID":"51fdd73d126d5084e958299073e38c7f","Type":"ContainerStarted","Data":"7d190d5594d412cc8691a158d8f9cfa15484ca5e15f8e00597c8cdc0d41bf717"} Jul 09 18:59:37.992149 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:37.990535 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f4s2z" podStartSLOduration=2.369530237 podStartE2EDuration="21.990478456s" totalImagesPullingTime="19.620948219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:37.990182158 +0000 UTC m=+21.773589924" watchObservedRunningTime="2026-07-09 18:59:37.990478456 +0000 UTC m=+21.773886224" Jul 09 18:59:38.982251 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.982014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dqf62" event={"ID":"0d15fd65-8806-4f8c-a67e-48e48d1617dd","Type":"ContainerStarted","Data":"832271857e7f6bb83d18f50dc86c734ce0646cf126352daa767143efd264b409"} Jul 09 18:59:38.985093 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.985067 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 18:59:38.985485 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.985462 2576 generic.go:356] "Generic (PLEG): container finished" podID="6380f011-119f-4154-824a-51ddb4626e9c" containerID="95462f03a0330ccaf85c467b64d5576d2d74fbff48b12872bc936a84e6edfb58" exitCode=1 Jul 09 18:59:38.985601 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.985540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerDied","Data":"95462f03a0330ccaf85c467b64d5576d2d74fbff48b12872bc936a84e6edfb58"} Jul 09 18:59:38.985601 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.985606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerStarted","Data":"9d8c1b457b96dac42799fffd39a3dafbeb020bffdf8687f58460f8665e86fb50"} Jul 09 18:59:38.985727 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.985655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerStarted","Data":"5f342c2332d37e2619fa9d55d53b977a8fd0e2a1bb5c20b5254b6f5d35a4333a"} Jul 09 18:59:38.985920 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.985863 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerStarted","Data":"1794cbddc6e364e882979a1a5d06cae35cad8eabc49e57d00162adceb3569eb7"} Jul 09 18:59:38.985979 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.985935 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerStarted","Data":"b92068cb9c26015d059fa120b19ac085824ad0688e9453c3d6d5b4e1670c2318"} Jul 09 18:59:38.987133 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.987107 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s4g5r" event={"ID":"b2c4f776-0c98-4e11-bb43-23c96122f8ff","Type":"ContainerStarted","Data":"b8eb170333c1b8619e73783a9ded0fad6bfb48ced1b86898320a8a35dd178ba9"} Jul 09 18:59:38.988627 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.988606 2576 generic.go:356] "Generic (PLEG): container finished" podID="5a6b77dd27131a920645a2b8ab7fa8ed" containerID="851ffc9a74bb562d241bca34fdcb41bc56bdfdf665bfd604206ced5927065291" exitCode=0 Jul 09 18:59:38.988726 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.988681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" event={"ID":"5a6b77dd27131a920645a2b8ab7fa8ed","Type":"ContainerDied","Data":"851ffc9a74bb562d241bca34fdcb41bc56bdfdf665bfd604206ced5927065291"} Jul 09 18:59:38.990259 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.990238 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k5hq5" event={"ID":"e432054c-7eae-4a1f-a642-1c56f474dbb8","Type":"ContainerStarted","Data":"6e1ef44390f0587b2120ba8fb2e5f2343864e496428a206a0d0b570a392e4ae9"} Jul 09 18:59:38.991722 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.991703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dg6vk" event={"ID":"b717b23c-d36c-453a-9f54-a03a5e8d7317","Type":"ContainerStarted","Data":"f8a451c3695bc8474fc4afe1820a1b46f577dbf36043be909565e217aad8d2ad"} Jul 09 18:59:38.993245 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.993224 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" event={"ID":"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6","Type":"ContainerStarted","Data":"467c91632a4eee8858b9d2ed2d38de6814b001f3394c8681c72bbe38dd67ebf8"} Jul 09 18:59:38.994747 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.994723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w9wrf" event={"ID":"07f68d9e-d699-4cd8-a254-c641caf926f9","Type":"ContainerStarted","Data":"90b77b2f78cdd10ae64b419b14e0a29533bf25f84bb357cadce8be598c0b0b18"} Jul 09 18:59:38.996301 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.996278 2576 generic.go:356] "Generic (PLEG): container finished" podID="559bf9aa-006f-4808-b979-aecf3bb3b1cf" containerID="bcf220bd4c3885a18bc46702460064175c6dbe1e6b9e01655d16bf21eaf9a85d" exitCode=0 Jul 09 18:59:38.996403 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.996337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk5px" event={"ID":"559bf9aa-006f-4808-b979-aecf3bb3b1cf","Type":"ContainerDied","Data":"bcf220bd4c3885a18bc46702460064175c6dbe1e6b9e01655d16bf21eaf9a85d"} Jul 09 18:59:38.998423 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.998387 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" podStartSLOduration=21.998371378999998 podStartE2EDuration="21.998371379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:38.007035092 +0000 UTC m=+21.790442858" watchObservedRunningTime="2026-07-09 18:59:38.998371379 +0000 UTC m=+22.781779146" Jul 09 18:59:38.998760 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:38.998728 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dqf62" podStartSLOduration=3.428245284 podStartE2EDuration="22.998717424s" totalImagesPullingTime="19.57047214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:38.997890526 +0000 UTC m=+22.781298293" watchObservedRunningTime="2026-07-09 18:59:38.998717424 +0000 UTC m=+22.782125189" Jul 09 18:59:39.034779 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.034696 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dg6vk" podStartSLOduration=3.550165806 podStartE2EDuration="23.034684065s" totalImagesPullingTime="19.484518259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:39.034354447 +0000 UTC m=+22.817762213" watchObservedRunningTime="2026-07-09 18:59:39.034684065 +0000 UTC m=+22.818091830" Jul 09 18:59:39.069486 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.069451 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s4g5r" podStartSLOduration=3.458127327 podStartE2EDuration="23.069439987s" totalImagesPullingTime="19.61131266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:39.069220101 +0000 UTC m=+22.852627867" watchObservedRunningTime="2026-07-09 18:59:39.069439987 +0000 UTC m=+22.852847751" Jul 09 18:59:39.086853 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.086814 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w9wrf" podStartSLOduration=2.449243489 podStartE2EDuration="22.086800113s" totalImagesPullingTime="19.637556624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:39.086416756 +0000 UTC m=+22.869824544" watchObservedRunningTime="2026-07-09 18:59:39.086800113 +0000 UTC m=+22.870207879" Jul 09 18:59:39.104398 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.104366 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k5hq5" podStartSLOduration=2.8192429629999998 podStartE2EDuration="22.104354831s" totalImagesPullingTime="19.285111868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:39.104173218 +0000 UTC m=+22.887580983" watchObservedRunningTime="2026-07-09 18:59:39.104354831 +0000 UTC m=+22.887762656" Jul 09 18:59:39.576562 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.576533 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 18:59:39.592976 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.592903 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T18:59:39.576558525Z","UUID":"fc3c5c99-1c30-4136-b3a2-2489da801e01","Handler":null,"Name":"","Endpoint":""} Jul 09 18:59:39.594200 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.594184 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 18:59:39.594268 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.594220 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 18:59:39.724068 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.724012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:39.724229 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.724115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:39.724229 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:39.724124 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:39.724229 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.724138 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:39.724229 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:39.724194 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:39.724377 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:39.724253 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:39.775939 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.775925 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:39.776353 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:39.776339 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:40.000983 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:40.000904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" event={"ID":"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6","Type":"ContainerStarted","Data":"25727404237d4bdaede1c53777b50dc48badf72aab484573fd38993b41479d94"} Jul 09 18:59:40.002837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:40.002719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" event={"ID":"5a6b77dd27131a920645a2b8ab7fa8ed","Type":"ContainerStarted","Data":"74a36b516c196e31b415b8fb8dc9204b95c4c83ca8e0107ebc0201e60d55a2af"} Jul 09 18:59:40.002837 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:40.002782 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:40.003560 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:40.003537 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dg6vk" Jul 09 18:59:40.021541 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:40.021485 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" podStartSLOduration=23.021473382 podStartE2EDuration="23.021473382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:40.021278799 +0000 UTC m=+23.804686565" watchObservedRunningTime="2026-07-09 18:59:40.021473382 +0000 UTC m=+23.804881146" Jul 09 18:59:41.006993 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:41.006957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" event={"ID":"e436780c-2fe2-4b90-ad37-8f07c7b3bdc6","Type":"ContainerStarted","Data":"71473f27bec00eb9e27eda3c904fada507d26884dcea3af2fd9a31094fe27346"} Jul 09 18:59:41.010337 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:41.010318 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 18:59:41.010956 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:41.010743 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerStarted","Data":"c834658ca96d08ed712915e760271d2224de83d6241202f7528678e533d11ab5"} Jul 09 18:59:41.029158 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:41.029123 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w96px" podStartSLOduration=2.892863765 podStartE2EDuration="25.029109175s" totalImagesPullingTime="22.13624541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:41.028714744 +0000 UTC m=+24.812122505" watchObservedRunningTime="2026-07-09 18:59:41.029109175 +0000 UTC m=+24.812516949" Jul 09 18:59:41.723477 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:41.723447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:41.723661 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:41.723447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:41.723661 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:41.723567 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:41.723661 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:41.723645 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:41.723821 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:41.723454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:41.723821 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:41.723738 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:43.018861 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:43.018655 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 18:59:43.019422 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:43.019183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerStarted","Data":"31b0612d8355601c1c97d619508350af43dd0fc67a751e046742f1e34061d04d"} Jul 09 18:59:43.019476 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:43.019426 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:43.019540 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:43.019488 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:43.019657 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:43.019636 2576 scope.go:117] "RemoveContainer" containerID="95462f03a0330ccaf85c467b64d5576d2d74fbff48b12872bc936a84e6edfb58" Jul 09 18:59:43.035724 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:43.035696 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:43.036071 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:43.036055 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:43.723581 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:43.723557 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:43.723759 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:43.723553 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:43.723759 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:43.723654 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:43.723759 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:43.723566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:43.723880 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:43.723713 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:43.723880 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:43.723838 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:44.557731 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:44.557694 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lpcft"] Jul 09 18:59:44.558308 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:44.557784 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:44.558308 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:44.557859 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:44.559718 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:44.559693 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q8hn6"] Jul 09 18:59:44.560411 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:44.560092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:44.560411 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:44.560249 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:44.563310 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:44.562815 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c4kkr"] Jul 09 18:59:44.563310 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:44.563069 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:44.563310 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:44.563202 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:45.026982 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:45.026965 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 18:59:45.027293 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:45.027270 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" event={"ID":"6380f011-119f-4154-824a-51ddb4626e9c","Type":"ContainerStarted","Data":"e278b347f3d93a7e2e480ddd33e510b04d997b551aa1d891d9ef750f4b78841c"} Jul 09 18:59:45.027373 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:45.027361 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 18:59:45.061466 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:45.061429 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" podStartSLOduration=9.400030181 podStartE2EDuration="29.061414694s" totalImagesPullingTime="19.661384513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:45.061159846 +0000 UTC m=+28.844567610" watchObservedRunningTime="2026-07-09 18:59:45.061414694 +0000 UTC m=+28.844822455" Jul 09 18:59:46.032938 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:46.032732 2576 generic.go:356] "Generic (PLEG): container finished" podID="559bf9aa-006f-4808-b979-aecf3bb3b1cf" containerID="d01bea9a8b82a38346299aa1f37d0c7d82ee104d43d81dea967c0c2be9f9d923" exitCode=0 Jul 09 18:59:46.033334 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:46.032775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk5px" event={"ID":"559bf9aa-006f-4808-b979-aecf3bb3b1cf","Type":"ContainerDied","Data":"d01bea9a8b82a38346299aa1f37d0c7d82ee104d43d81dea967c0c2be9f9d923"} Jul 09 18:59:46.033334 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:46.033073 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 18:59:46.725014 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:46.724980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:46.725146 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:46.725094 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:46.725146 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:46.725107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:46.725263 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:46.725169 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:46.725306 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:46.725265 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:46.725368 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:46.725349 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:47.037254 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:47.037226 2576 generic.go:356] "Generic (PLEG): container finished" podID="559bf9aa-006f-4808-b979-aecf3bb3b1cf" containerID="c3c10a219240db5710e0f977a9f81b176c77d7d329a9eeb472bb2a0cccacb870" exitCode=0 Jul 09 18:59:47.037587 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:47.037278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk5px" event={"ID":"559bf9aa-006f-4808-b979-aecf3bb3b1cf","Type":"ContainerDied","Data":"c3c10a219240db5710e0f977a9f81b176c77d7d329a9eeb472bb2a0cccacb870"} Jul 09 18:59:47.424597 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:47.424532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 18:59:47.424765 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:47.424750 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 18:59:47.434179 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:47.434143 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" podUID="6380f011-119f-4154-824a-51ddb4626e9c" containerName="ovnkube-controller" probeResult="failure" output="" Jul 09 18:59:47.442133 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:47.442104 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" podUID="6380f011-119f-4154-824a-51ddb4626e9c" containerName="ovnkube-controller" probeResult="failure" output="" Jul 09 18:59:48.041361 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:48.041286 2576 generic.go:356] "Generic (PLEG): container finished" podID="559bf9aa-006f-4808-b979-aecf3bb3b1cf" containerID="cbfc54c84d82bf2c3ea60803ecfd07884a24d34fca346daa95ac7457e82dcd64" exitCode=0 Jul 09 18:59:48.041712 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:48.041351 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk5px" event={"ID":"559bf9aa-006f-4808-b979-aecf3bb3b1cf","Type":"ContainerDied","Data":"cbfc54c84d82bf2c3ea60803ecfd07884a24d34fca346daa95ac7457e82dcd64"} Jul 09 18:59:48.723370 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:48.723337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:48.723370 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:48.723372 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:48.723616 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:48.723346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:48.723616 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:48.723486 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4kkr" podUID="a9f3616e-5200-4753-8a67-1252d9f93c23" Jul 09 18:59:48.723616 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:48.723558 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcft" podUID="7cd65f36-9ffa-46e3-995f-7cc0395f757d" Jul 09 18:59:48.723730 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:48.723631 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q8hn6" podUID="a0b2df71-b27f-4108-826a-b3cf0827e637" Jul 09 18:59:49.401601 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:49.401519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:49.401601 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:49.401585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:49.402073 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:49.401604 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:49.402073 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:49.401664 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs podName:a9f3616e-5200-4753-8a67-1252d9f93c23 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:21.401643442 +0000 UTC m=+65.185051186 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs") pod "network-metrics-daemon-c4kkr" (UID: "a9f3616e-5200-4753-8a67-1252d9f93c23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 18:59:49.402073 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:49.401686 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:49.402073 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:49.401731 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret podName:7cd65f36-9ffa-46e3-995f-7cc0395f757d nodeName:}" failed. No retries permitted until 2026-07-09 19:00:21.401715791 +0000 UTC m=+65.185123534 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret") pod "global-pull-secret-syncer-lpcft" (UID: "7cd65f36-9ffa-46e3-995f-7cc0395f757d") : object "kube-system"/"original-pull-secret" not registered Jul 09 18:59:49.502303 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:49.502275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkv6\" (UniqueName: \"kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6\") pod \"network-check-target-q8hn6\" (UID: \"a0b2df71-b27f-4108-826a-b3cf0827e637\") " pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:49.502462 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:49.502425 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 18:59:49.502462 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:49.502444 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 18:59:49.502462 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:49.502455 2576 projected.go:196] Error preparing data for projected volume kube-api-access-mpkv6 for pod openshift-network-diagnostics/network-check-target-q8hn6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:49.502631 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:49.502531 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6 podName:a0b2df71-b27f-4108-826a-b3cf0827e637 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:21.50251079 +0000 UTC m=+65.285918548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mpkv6" (UniqueName: "kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6") pod "network-check-target-q8hn6" (UID: "a0b2df71-b27f-4108-826a-b3cf0827e637") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 18:59:50.514272 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.514245 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeReady" Jul 09 18:59:50.514604 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.514344 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 18:59:50.550634 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.550603 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c5976f478-z4dlj"] Jul 09 18:59:50.554432 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.554413 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.557210 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.557186 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 18:59:50.557397 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.557346 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-chfdb\"" Jul 09 18:59:50.557549 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.557529 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 18:59:50.557609 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.557560 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 18:59:50.564663 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.564601 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 18:59:50.567658 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.567639 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tkm5j"] Jul 09 18:59:50.571819 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.571799 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c5976f478-z4dlj"] Jul 09 18:59:50.571915 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.571837 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rqlrt"] Jul 09 18:59:50.571915 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.571911 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.574868 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.574674 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ssx5x\"" Jul 09 18:59:50.574868 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.574684 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 18:59:50.574868 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.574812 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 18:59:50.576459 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.576442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqlrt" Jul 09 18:59:50.579175 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.579092 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 18:59:50.579175 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.579132 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cqw8d\"" Jul 09 18:59:50.580275 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.580249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tkm5j"] Jul 09 18:59:50.580375 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.580335 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 18:59:50.580448 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.580390 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 18:59:50.583123 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.583031 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqlrt"] Jul 09 18:59:50.710597 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.710566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59nc2\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-kube-api-access-59nc2\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.710751 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.710605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78435845-9b02-4b2a-9c9e-8ee04618f9c0-config-volume\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.710751 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.710633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2bafddc-bab1-4ebb-9bcf-edb32662e310-ca-trust-extracted\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.710751 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.710693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-trusted-ca\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.710886 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.710756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-installation-pull-secrets\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.710886 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.710790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-image-registry-private-configuration\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.710886 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.710829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-certificates\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.710886 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.710845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdjg4\" (UniqueName: \"kubernetes.io/projected/78435845-9b02-4b2a-9c9e-8ee04618f9c0-kube-api-access-qdjg4\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.711023 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.710924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-bound-sa-token\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.711023 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.710986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78435845-9b02-4b2a-9c9e-8ee04618f9c0-tmp-dir\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.711023 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.711017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.711123 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.711058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dead0cf-83f9-471d-a4b9-7de73e42c48a-cert\") pod \"ingress-canary-rqlrt\" (UID: \"5dead0cf-83f9-471d-a4b9-7de73e42c48a\") " pod="openshift-ingress-canary/ingress-canary-rqlrt" Jul 09 18:59:50.711123 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.711084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wfmm\" (UniqueName: \"kubernetes.io/projected/5dead0cf-83f9-471d-a4b9-7de73e42c48a-kube-api-access-4wfmm\") pod \"ingress-canary-rqlrt\" (UID: \"5dead0cf-83f9-471d-a4b9-7de73e42c48a\") " pod="openshift-ingress-canary/ingress-canary-rqlrt" Jul 09 18:59:50.711188 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.711140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.723757 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.723729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 18:59:50.723757 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.723752 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 18:59:50.723946 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.723920 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 18:59:50.727233 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.727211 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 18:59:50.727333 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.727235 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 18:59:50.727333 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.727257 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8ctlj\"" Jul 09 18:59:50.727333 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.727294 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 18:59:50.727479 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.727219 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 18:59:50.727589 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.727561 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dlpdq\"" Jul 09 18:59:50.811697 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-trusted-ca\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.811794 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-installation-pull-secrets\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.811794 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-image-registry-private-configuration\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.811794 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-certificates\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.811794 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdjg4\" (UniqueName: \"kubernetes.io/projected/78435845-9b02-4b2a-9c9e-8ee04618f9c0-kube-api-access-qdjg4\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.811941 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-bound-sa-token\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.811941 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78435845-9b02-4b2a-9c9e-8ee04618f9c0-tmp-dir\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.811941 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.811941 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dead0cf-83f9-471d-a4b9-7de73e42c48a-cert\") pod \"ingress-canary-rqlrt\" (UID: \"5dead0cf-83f9-471d-a4b9-7de73e42c48a\") " pod="openshift-ingress-canary/ingress-canary-rqlrt" Jul 09 18:59:50.811941 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wfmm\" (UniqueName: \"kubernetes.io/projected/5dead0cf-83f9-471d-a4b9-7de73e42c48a-kube-api-access-4wfmm\") pod \"ingress-canary-rqlrt\" (UID: \"5dead0cf-83f9-471d-a4b9-7de73e42c48a\") " pod="openshift-ingress-canary/ingress-canary-rqlrt" Jul 09 18:59:50.812159 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.812159 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.811979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59nc2\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-kube-api-access-59nc2\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.812159 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.812003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78435845-9b02-4b2a-9c9e-8ee04618f9c0-config-volume\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.812159 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.812025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2bafddc-bab1-4ebb-9bcf-edb32662e310-ca-trust-extracted\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.812364 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:50.812339 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:59:50.812420 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:50.812405 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls podName:78435845-9b02-4b2a-9c9e-8ee04618f9c0 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:51.312389988 +0000 UTC m=+35.095797734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls") pod "dns-default-tkm5j" (UID: "78435845-9b02-4b2a-9c9e-8ee04618f9c0") : secret "dns-default-metrics-tls" not found Jul 09 18:59:50.812530 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.812490 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78435845-9b02-4b2a-9c9e-8ee04618f9c0-tmp-dir\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.812584 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:50.812346 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:59:50.812584 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:50.812567 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5976f478-z4dlj: secret "image-registry-tls" not found Jul 09 18:59:50.812834 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:50.812632 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls podName:c2bafddc-bab1-4ebb-9bcf-edb32662e310 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:51.312615058 +0000 UTC m=+35.096022814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls") pod "image-registry-c5976f478-z4dlj" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310") : secret "image-registry-tls" not found Jul 09 18:59:50.812930 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.812917 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78435845-9b02-4b2a-9c9e-8ee04618f9c0-config-volume\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.813006 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.812990 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2bafddc-bab1-4ebb-9bcf-edb32662e310-ca-trust-extracted\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.813170 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.813146 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-certificates\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.813729 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.813696 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-trusted-ca\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.816557 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.816476 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-image-registry-private-configuration\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.816557 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.816476 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-installation-pull-secrets\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.816774 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.816756 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5dead0cf-83f9-471d-a4b9-7de73e42c48a-cert\") pod \"ingress-canary-rqlrt\" (UID: \"5dead0cf-83f9-471d-a4b9-7de73e42c48a\") " pod="openshift-ingress-canary/ingress-canary-rqlrt" Jul 09 18:59:50.823613 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.823580 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wfmm\" (UniqueName: \"kubernetes.io/projected/5dead0cf-83f9-471d-a4b9-7de73e42c48a-kube-api-access-4wfmm\") pod \"ingress-canary-rqlrt\" (UID: \"5dead0cf-83f9-471d-a4b9-7de73e42c48a\") " pod="openshift-ingress-canary/ingress-canary-rqlrt" Jul 09 18:59:50.823908 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.823865 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdjg4\" (UniqueName: \"kubernetes.io/projected/78435845-9b02-4b2a-9c9e-8ee04618f9c0-kube-api-access-qdjg4\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:50.824131 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.824111 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-bound-sa-token\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.824218 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.824145 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59nc2\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-kube-api-access-59nc2\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:50.893205 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:50.893178 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqlrt" Jul 09 18:59:51.034071 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:51.034014 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqlrt"] Jul 09 18:59:51.037925 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:51.037869 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dead0cf_83f9_471d_a4b9_7de73e42c48a.slice/crio-4201803d32b76ab5927699b00a415b70ae0afa0246c8acccebba241e46857788 WatchSource:0}: Error finding container 4201803d32b76ab5927699b00a415b70ae0afa0246c8acccebba241e46857788: Status 404 returned error can't find the container with id 4201803d32b76ab5927699b00a415b70ae0afa0246c8acccebba241e46857788 Jul 09 18:59:51.049614 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:51.049588 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqlrt" event={"ID":"5dead0cf-83f9-471d-a4b9-7de73e42c48a","Type":"ContainerStarted","Data":"4201803d32b76ab5927699b00a415b70ae0afa0246c8acccebba241e46857788"} Jul 09 18:59:51.316023 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:51.315985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:51.316271 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:51.316108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:51.316271 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:51.316150 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:59:51.316271 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:51.316169 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5976f478-z4dlj: secret "image-registry-tls" not found Jul 09 18:59:51.316271 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:51.316225 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls podName:c2bafddc-bab1-4ebb-9bcf-edb32662e310 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:52.316209829 +0000 UTC m=+36.099617581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls") pod "image-registry-c5976f478-z4dlj" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310") : secret "image-registry-tls" not found Jul 09 18:59:51.316271 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:51.316248 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:59:51.316535 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:51.316328 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls podName:78435845-9b02-4b2a-9c9e-8ee04618f9c0 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:52.316308827 +0000 UTC m=+36.099716569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls") pod "dns-default-tkm5j" (UID: "78435845-9b02-4b2a-9c9e-8ee04618f9c0") : secret "dns-default-metrics-tls" not found Jul 09 18:59:52.325616 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:52.325578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:52.326440 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:52.325651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:52.326440 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:52.325714 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:59:52.326440 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:52.325757 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:59:52.326440 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:52.325770 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5976f478-z4dlj: secret "image-registry-tls" not found Jul 09 18:59:52.326440 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:52.325787 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls podName:78435845-9b02-4b2a-9c9e-8ee04618f9c0 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:54.325767545 +0000 UTC m=+38.109175288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls") pod "dns-default-tkm5j" (UID: "78435845-9b02-4b2a-9c9e-8ee04618f9c0") : secret "dns-default-metrics-tls" not found Jul 09 18:59:52.326440 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:52.325810 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls podName:c2bafddc-bab1-4ebb-9bcf-edb32662e310 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:54.32579708 +0000 UTC m=+38.109204822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls") pod "image-registry-c5976f478-z4dlj" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310") : secret "image-registry-tls" not found Jul 09 18:59:54.341383 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:54.341347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:54.341943 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:54.341526 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:59:54.341943 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:54.341530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:54.341943 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:54.341600 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:59:54.341943 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:54.341615 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5976f478-z4dlj: secret "image-registry-tls" not found Jul 09 18:59:54.341943 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:54.341603 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls podName:78435845-9b02-4b2a-9c9e-8ee04618f9c0 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:58.341583756 +0000 UTC m=+42.124991501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls") pod "dns-default-tkm5j" (UID: "78435845-9b02-4b2a-9c9e-8ee04618f9c0") : secret "dns-default-metrics-tls" not found Jul 09 18:59:54.341943 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:54.341662 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls podName:c2bafddc-bab1-4ebb-9bcf-edb32662e310 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:58.341651261 +0000 UTC m=+42.125059009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls") pod "image-registry-c5976f478-z4dlj" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310") : secret "image-registry-tls" not found Jul 09 18:59:55.061809 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:55.061615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqlrt" event={"ID":"5dead0cf-83f9-471d-a4b9-7de73e42c48a","Type":"ContainerStarted","Data":"5080fdf285a36f5b0a3a510b78e6b38b5e08938cffd7726f1dcf2f7077550fad"} Jul 09 18:59:55.064219 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:55.064196 2576 generic.go:356] "Generic (PLEG): container finished" podID="559bf9aa-006f-4808-b979-aecf3bb3b1cf" containerID="f6c237a5da3966cc5f91a6758524036d4a277b6a213824eed45d3df611bef1e1" exitCode=0 Jul 09 18:59:55.064328 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:55.064245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk5px" event={"ID":"559bf9aa-006f-4808-b979-aecf3bb3b1cf","Type":"ContainerDied","Data":"f6c237a5da3966cc5f91a6758524036d4a277b6a213824eed45d3df611bef1e1"} Jul 09 18:59:55.079384 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:55.079347 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rqlrt" podStartSLOduration=1.6665351830000001 podStartE2EDuration="5.079334774s" totalImagesPullingTime="3.412799591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:55.078438196 +0000 UTC m=+38.861845980" watchObservedRunningTime="2026-07-09 18:59:55.079334774 +0000 UTC m=+38.862742539" Jul 09 18:59:56.069601 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.069571 2576 generic.go:356] "Generic (PLEG): container finished" podID="559bf9aa-006f-4808-b979-aecf3bb3b1cf" containerID="3da114aca38533473d109d2989e87788c44e8a1d71bb67667f16329d14c8b769" exitCode=0 Jul 09 18:59:56.070034 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.069656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk5px" event={"ID":"559bf9aa-006f-4808-b979-aecf3bb3b1cf","Type":"ContainerDied","Data":"3da114aca38533473d109d2989e87788c44e8a1d71bb67667f16329d14c8b769"} Jul 09 18:59:56.301040 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.301014 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-gwnzq"] Jul 09 18:59:56.318460 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.318438 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xdwrm"] Jul 09 18:59:56.318558 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.318494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.322676 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.322626 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 18:59:56.323141 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.323118 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 18:59:56.323748 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.323731 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hz6wx\"" Jul 09 18:59:56.324346 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.324329 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:59:56.326038 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.326022 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 18:59:56.344378 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.344359 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-gwnzq"] Jul 09 18:59:56.344462 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.344389 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xdwrm"] Jul 09 18:59:56.344462 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.344455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.348093 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.348072 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 18:59:56.348347 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.348334 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 18:59:56.349619 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.349596 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 18:59:56.349691 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.349652 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 18:59:56.358317 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.358301 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-62s6d\"" Jul 09 18:59:56.365226 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.365195 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 18:59:56.369023 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.369006 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 18:59:56.391030 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.391008 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb"] Jul 09 18:59:56.408957 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.408935 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb"] Jul 09 18:59:56.408957 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.408944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.411769 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.411753 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 18:59:56.411862 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.411843 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 18:59:56.411985 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.411966 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ph4nc\"" Jul 09 18:59:56.412073 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.411997 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 18:59:56.412208 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.412186 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 18:59:56.457132 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.457111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4834de22-67ed-4151-abd1-01db4df72cbf-serving-cert\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.457217 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.457155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4c316ad-4abf-4014-8d87-01cf69151274-serving-cert\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.457217 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.457171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4834de22-67ed-4151-abd1-01db4df72cbf-tmp\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.457295 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.457233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4834de22-67ed-4151-abd1-01db4df72cbf-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.457295 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.457253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4834de22-67ed-4151-abd1-01db4df72cbf-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.457295 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.457284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4c316ad-4abf-4014-8d87-01cf69151274-trusted-ca\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.457394 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.457298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj5zm\" (UniqueName: \"kubernetes.io/projected/4834de22-67ed-4151-abd1-01db4df72cbf-kube-api-access-pj5zm\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.457394 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.457358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8rm7\" (UniqueName: \"kubernetes.io/projected/f4c316ad-4abf-4014-8d87-01cf69151274-kube-api-access-b8rm7\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.457461 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.457390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4834de22-67ed-4151-abd1-01db4df72cbf-snapshots\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.457461 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.457422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4c316ad-4abf-4014-8d87-01cf69151274-config\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.557820 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.557797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4c316ad-4abf-4014-8d87-01cf69151274-trusted-ca\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.557910 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.557827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8rm7\" (UniqueName: \"kubernetes.io/projected/f4c316ad-4abf-4014-8d87-01cf69151274-kube-api-access-b8rm7\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.557910 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.557844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4834de22-67ed-4151-abd1-01db4df72cbf-snapshots\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.557910 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.557862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab0cfcbe-e253-4c76-80cf-4feff0136d56-serving-cert\") pod \"service-ca-operator-7695fc6c8c-cg9gb\" (UID: \"ab0cfcbe-e253-4c76-80cf-4feff0136d56\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.558018 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.557928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4834de22-67ed-4151-abd1-01db4df72cbf-serving-cert\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.558018 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.557966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4834de22-67ed-4151-abd1-01db4df72cbf-tmp\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.558018 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.558004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4c316ad-4abf-4014-8d87-01cf69151274-serving-cert\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.558155 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.558134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab0cfcbe-e253-4c76-80cf-4feff0136d56-config\") pod \"service-ca-operator-7695fc6c8c-cg9gb\" (UID: \"ab0cfcbe-e253-4c76-80cf-4feff0136d56\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.558209 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.558194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4834de22-67ed-4151-abd1-01db4df72cbf-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.558264 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.558233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bc24\" (UniqueName: \"kubernetes.io/projected/ab0cfcbe-e253-4c76-80cf-4feff0136d56-kube-api-access-2bc24\") pod \"service-ca-operator-7695fc6c8c-cg9gb\" (UID: \"ab0cfcbe-e253-4c76-80cf-4feff0136d56\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.558319 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.558273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4834de22-67ed-4151-abd1-01db4df72cbf-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.558398 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.558373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj5zm\" (UniqueName: \"kubernetes.io/projected/4834de22-67ed-4151-abd1-01db4df72cbf-kube-api-access-pj5zm\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.558452 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.558427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4c316ad-4abf-4014-8d87-01cf69151274-config\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.558597 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.558576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4834de22-67ed-4151-abd1-01db4df72cbf-snapshots\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.559156 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.558965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4834de22-67ed-4151-abd1-01db4df72cbf-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.559234 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.559208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4834de22-67ed-4151-abd1-01db4df72cbf-tmp\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.559288 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.559239 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4c316ad-4abf-4014-8d87-01cf69151274-config\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.559532 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.559514 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4c316ad-4abf-4014-8d87-01cf69151274-trusted-ca\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.559844 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.559826 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4834de22-67ed-4151-abd1-01db4df72cbf-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.561457 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.561434 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4c316ad-4abf-4014-8d87-01cf69151274-serving-cert\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.561457 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.561449 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4834de22-67ed-4151-abd1-01db4df72cbf-serving-cert\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.567917 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.567893 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8rm7\" (UniqueName: \"kubernetes.io/projected/f4c316ad-4abf-4014-8d87-01cf69151274-kube-api-access-b8rm7\") pod \"console-operator-7866497494-gwnzq\" (UID: \"f4c316ad-4abf-4014-8d87-01cf69151274\") " pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.568296 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.568276 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj5zm\" (UniqueName: \"kubernetes.io/projected/4834de22-67ed-4151-abd1-01db4df72cbf-kube-api-access-pj5zm\") pod \"insights-operator-68d9dd94cf-xdwrm\" (UID: \"4834de22-67ed-4151-abd1-01db4df72cbf\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.626913 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.626865 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 18:59:56.655681 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.655662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" Jul 09 18:59:56.658953 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.658935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab0cfcbe-e253-4c76-80cf-4feff0136d56-serving-cert\") pod \"service-ca-operator-7695fc6c8c-cg9gb\" (UID: \"ab0cfcbe-e253-4c76-80cf-4feff0136d56\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.659056 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.658979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab0cfcbe-e253-4c76-80cf-4feff0136d56-config\") pod \"service-ca-operator-7695fc6c8c-cg9gb\" (UID: \"ab0cfcbe-e253-4c76-80cf-4feff0136d56\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.659056 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.658998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bc24\" (UniqueName: \"kubernetes.io/projected/ab0cfcbe-e253-4c76-80cf-4feff0136d56-kube-api-access-2bc24\") pod \"service-ca-operator-7695fc6c8c-cg9gb\" (UID: \"ab0cfcbe-e253-4c76-80cf-4feff0136d56\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.659574 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.659556 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ab0cfcbe-e253-4c76-80cf-4feff0136d56-config\") pod \"service-ca-operator-7695fc6c8c-cg9gb\" (UID: \"ab0cfcbe-e253-4c76-80cf-4feff0136d56\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.660885 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.660866 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ab0cfcbe-e253-4c76-80cf-4feff0136d56-serving-cert\") pod \"service-ca-operator-7695fc6c8c-cg9gb\" (UID: \"ab0cfcbe-e253-4c76-80cf-4feff0136d56\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.668054 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.668033 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bc24\" (UniqueName: \"kubernetes.io/projected/ab0cfcbe-e253-4c76-80cf-4feff0136d56-kube-api-access-2bc24\") pod \"service-ca-operator-7695fc6c8c-cg9gb\" (UID: \"ab0cfcbe-e253-4c76-80cf-4feff0136d56\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.717087 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.717040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" Jul 09 18:59:56.789328 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.784652 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-gwnzq"] Jul 09 18:59:56.793516 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:56.789978 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c316ad_4abf_4014_8d87_01cf69151274.slice/crio-7751f453da318535bb3346e6a60b05103a8a3c6b673a3537ea28d32ae289323f WatchSource:0}: Error finding container 7751f453da318535bb3346e6a60b05103a8a3c6b673a3537ea28d32ae289323f: Status 404 returned error can't find the container with id 7751f453da318535bb3346e6a60b05103a8a3c6b673a3537ea28d32ae289323f Jul 09 18:59:56.842135 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.842110 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xdwrm"] Jul 09 18:59:56.844051 ip-10-0-140-253 kubenswrapper[2576]: W0709 18:59:56.844025 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4834de22_67ed_4151_abd1_01db4df72cbf.slice/crio-0c25aa79416656ed351a3916e16275c80b83e3c798c472ad541f62d111173046 WatchSource:0}: Error finding container 0c25aa79416656ed351a3916e16275c80b83e3c798c472ad541f62d111173046: Status 404 returned error can't find the container with id 0c25aa79416656ed351a3916e16275c80b83e3c798c472ad541f62d111173046 Jul 09 18:59:56.893029 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:56.889981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb"] Jul 09 18:59:57.073027 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:57.072995 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" event={"ID":"4834de22-67ed-4151-abd1-01db4df72cbf","Type":"ContainerStarted","Data":"0c25aa79416656ed351a3916e16275c80b83e3c798c472ad541f62d111173046"} Jul 09 18:59:57.076189 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:57.076168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk5px" event={"ID":"559bf9aa-006f-4808-b979-aecf3bb3b1cf","Type":"ContainerStarted","Data":"e0c2d7fd14032b38fb3cc60ef71a1d19bfc70c7cefdd5676eb368873964abca5"} Jul 09 18:59:57.077263 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:57.077242 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gwnzq" event={"ID":"f4c316ad-4abf-4014-8d87-01cf69151274","Type":"ContainerStarted","Data":"7751f453da318535bb3346e6a60b05103a8a3c6b673a3537ea28d32ae289323f"} Jul 09 18:59:57.078356 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:57.078337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" event={"ID":"ab0cfcbe-e253-4c76-80cf-4feff0136d56","Type":"ContainerStarted","Data":"f615543d3b1bd67f9b3116f7e1b0e58ffaeb8d527c3c1280c6f3253fd4c5f926"} Jul 09 18:59:57.102784 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:57.102742 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sk5px" podStartSLOduration=7.747411355 podStartE2EDuration="41.102728282s" totalImagesPullingTime="33.355316927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:57.100945673 +0000 UTC m=+40.884353439" watchObservedRunningTime="2026-07-09 18:59:57.102728282 +0000 UTC m=+40.886136047" Jul 09 18:59:58.374236 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:58.374193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 18:59:58.374693 ip-10-0-140-253 kubenswrapper[2576]: I0709 18:59:58.374251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 18:59:58.374693 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:58.374383 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 18:59:58.374693 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:58.374393 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 18:59:58.374693 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:58.374400 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5976f478-z4dlj: secret "image-registry-tls" not found Jul 09 18:59:58.374693 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:58.374447 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls podName:78435845-9b02-4b2a-9c9e-8ee04618f9c0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:06.374429981 +0000 UTC m=+50.157837731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls") pod "dns-default-tkm5j" (UID: "78435845-9b02-4b2a-9c9e-8ee04618f9c0") : secret "dns-default-metrics-tls" not found Jul 09 18:59:58.374693 ip-10-0-140-253 kubenswrapper[2576]: E0709 18:59:58.374464 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls podName:c2bafddc-bab1-4ebb-9bcf-edb32662e310 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:06.374455625 +0000 UTC m=+50.157863372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls") pod "image-registry-c5976f478-z4dlj" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310") : secret "image-registry-tls" not found Jul 09 19:00:02.093338 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.093307 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/0.log" Jul 09 19:00:02.093789 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.093355 2576 generic.go:356] "Generic (PLEG): container finished" podID="f4c316ad-4abf-4014-8d87-01cf69151274" containerID="2e76e854b84791540082398803c332d18cc8b89ebb27f7a31d0c49be18125fb3" exitCode=255 Jul 09 19:00:02.093789 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.093450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gwnzq" event={"ID":"f4c316ad-4abf-4014-8d87-01cf69151274","Type":"ContainerDied","Data":"2e76e854b84791540082398803c332d18cc8b89ebb27f7a31d0c49be18125fb3"} Jul 09 19:00:02.093789 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.093669 2576 scope.go:117] "RemoveContainer" containerID="2e76e854b84791540082398803c332d18cc8b89ebb27f7a31d0c49be18125fb3" Jul 09 19:00:02.095219 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.095197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" event={"ID":"ab0cfcbe-e253-4c76-80cf-4feff0136d56","Type":"ContainerStarted","Data":"3590b96d86acdbcafd4f2c38545c702464c4377f3c03e91379e9a8091fbf5fe3"} Jul 09 19:00:02.096820 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.096797 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" event={"ID":"4834de22-67ed-4151-abd1-01db4df72cbf","Type":"ContainerStarted","Data":"950e2eacc926361ca692d7c178ddbdd60d6b300aa4fcc86fe4d2854d3012a63d"} Jul 09 19:00:02.126825 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.126789 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vlcpp"] Jul 09 19:00:02.144771 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.143983 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" podStartSLOduration=1.779332887 podStartE2EDuration="6.143961768s" totalImagesPullingTime="4.364628881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:02.143092061 +0000 UTC m=+45.926499828" watchObservedRunningTime="2026-07-09 19:00:02.143961768 +0000 UTC m=+45.927369534" Jul 09 19:00:02.154875 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.154853 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlcpp"] Jul 09 19:00:02.155026 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.154991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.157889 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.157869 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 19:00:02.158223 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.158203 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 19:00:02.158326 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.158297 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ntcpk\"" Jul 09 19:00:02.178238 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.178196 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" podStartSLOduration=1.86188658 podStartE2EDuration="6.178179664s" totalImagesPullingTime="4.316293084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:02.177615886 +0000 UTC m=+45.961023651" watchObservedRunningTime="2026-07-09 19:00:02.178179664 +0000 UTC m=+45.961587420" Jul 09 19:00:02.304644 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.304611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc23d3a6-a4c6-4790-aade-ca148619d0d0-data-volume\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.304792 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.304649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.304792 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.304757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc23d3a6-a4c6-4790-aade-ca148619d0d0-crio-socket\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.304906 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.304852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jc29\" (UniqueName: \"kubernetes.io/projected/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-api-access-8jc29\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.304906 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.304895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.406000 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.405916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jc29\" (UniqueName: \"kubernetes.io/projected/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-api-access-8jc29\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.406000 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.405965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.406197 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:02.406063 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 19:00:02.406197 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:02.406125 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls podName:fc23d3a6-a4c6-4790-aade-ca148619d0d0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:02.906111088 +0000 UTC m=+46.689518830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlcpp" (UID: "fc23d3a6-a4c6-4790-aade-ca148619d0d0") : secret "insights-runtime-extractor-tls" not found Jul 09 19:00:02.406197 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.406152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc23d3a6-a4c6-4790-aade-ca148619d0d0-data-volume\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.406197 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.406172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.406390 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.406230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc23d3a6-a4c6-4790-aade-ca148619d0d0-crio-socket\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.406390 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:02.406289 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 19:00:02.406483 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:02.406390 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm podName:fc23d3a6-a4c6-4790-aade-ca148619d0d0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:02.906375253 +0000 UTC m=+46.689783001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlcpp" (UID: "fc23d3a6-a4c6-4790-aade-ca148619d0d0") : configmap "kube-rbac-proxy" not found Jul 09 19:00:02.406483 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.406396 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc23d3a6-a4c6-4790-aade-ca148619d0d0-crio-socket\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.406630 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.406559 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc23d3a6-a4c6-4790-aade-ca148619d0d0-data-volume\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.417101 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.417077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jc29\" (UniqueName: \"kubernetes.io/projected/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-api-access-8jc29\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.909222 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.909190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.909369 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:02.909257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:02.909369 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:02.909346 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 19:00:02.909430 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:02.909382 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 19:00:02.909430 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:02.909423 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls podName:fc23d3a6-a4c6-4790-aade-ca148619d0d0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:03.909406435 +0000 UTC m=+47.692814179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlcpp" (UID: "fc23d3a6-a4c6-4790-aade-ca148619d0d0") : secret "insights-runtime-extractor-tls" not found Jul 09 19:00:02.909540 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:02.909439 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm podName:fc23d3a6-a4c6-4790-aade-ca148619d0d0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:03.909431866 +0000 UTC m=+47.692839609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlcpp" (UID: "fc23d3a6-a4c6-4790-aade-ca148619d0d0") : configmap "kube-rbac-proxy" not found Jul 09 19:00:03.101438 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.101414 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:00:03.101828 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.101813 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/0.log" Jul 09 19:00:03.101871 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.101851 2576 generic.go:356] "Generic (PLEG): container finished" podID="f4c316ad-4abf-4014-8d87-01cf69151274" containerID="9c68fb286fa337377b2ba64e4cb80efb8f4b6282235d9dc334307d17f98b17b4" exitCode=255 Jul 09 19:00:03.101960 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.101938 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gwnzq" event={"ID":"f4c316ad-4abf-4014-8d87-01cf69151274","Type":"ContainerDied","Data":"9c68fb286fa337377b2ba64e4cb80efb8f4b6282235d9dc334307d17f98b17b4"} Jul 09 19:00:03.102018 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.102006 2576 scope.go:117] "RemoveContainer" containerID="2e76e854b84791540082398803c332d18cc8b89ebb27f7a31d0c49be18125fb3" Jul 09 19:00:03.102201 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.102182 2576 scope.go:117] "RemoveContainer" containerID="9c68fb286fa337377b2ba64e4cb80efb8f4b6282235d9dc334307d17f98b17b4" Jul 09 19:00:03.102391 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:03.102369 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gwnzq_openshift-console-operator(f4c316ad-4abf-4014-8d87-01cf69151274)\"" pod="openshift-console-operator/console-operator-7866497494-gwnzq" podUID="f4c316ad-4abf-4014-8d87-01cf69151274" Jul 09 19:00:03.180545 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.180517 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf"] Jul 09 19:00:03.200628 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.200602 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf"] Jul 09 19:00:03.200736 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.200702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf" Jul 09 19:00:03.203383 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.203365 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 19:00:03.203491 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.203408 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 19:00:03.203773 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.203759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kb8r7\"" Jul 09 19:00:03.212243 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.212225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j29jr\" (UniqueName: \"kubernetes.io/projected/431e59c7-f782-4fa2-8268-05bd691f7605-kube-api-access-j29jr\") pod \"migrator-7f59b54f6c-qhngf\" (UID: \"431e59c7-f782-4fa2-8268-05bd691f7605\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf" Jul 09 19:00:03.312667 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.312630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j29jr\" (UniqueName: \"kubernetes.io/projected/431e59c7-f782-4fa2-8268-05bd691f7605-kube-api-access-j29jr\") pod \"migrator-7f59b54f6c-qhngf\" (UID: \"431e59c7-f782-4fa2-8268-05bd691f7605\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf" Jul 09 19:00:03.320739 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.320712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j29jr\" (UniqueName: \"kubernetes.io/projected/431e59c7-f782-4fa2-8268-05bd691f7605-kube-api-access-j29jr\") pod \"migrator-7f59b54f6c-qhngf\" (UID: \"431e59c7-f782-4fa2-8268-05bd691f7605\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf" Jul 09 19:00:03.509294 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.509197 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf" Jul 09 19:00:03.662250 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.662219 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf"] Jul 09 19:00:03.664990 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:03.664956 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431e59c7_f782_4fa2_8268_05bd691f7605.slice/crio-80831478b9e888ac54988117ba6a0ff22f0b31d109ee39214c350a42b6dfbfaf WatchSource:0}: Error finding container 80831478b9e888ac54988117ba6a0ff22f0b31d109ee39214c350a42b6dfbfaf: Status 404 returned error can't find the container with id 80831478b9e888ac54988117ba6a0ff22f0b31d109ee39214c350a42b6dfbfaf Jul 09 19:00:03.917428 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.917347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:03.917589 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:03.917463 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 19:00:03.917589 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.917469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:03.917589 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:03.917543 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm podName:fc23d3a6-a4c6-4790-aade-ca148619d0d0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:05.917524012 +0000 UTC m=+49.700931757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlcpp" (UID: "fc23d3a6-a4c6-4790-aade-ca148619d0d0") : configmap "kube-rbac-proxy" not found Jul 09 19:00:03.917732 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:03.917600 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 19:00:03.917732 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:03.917651 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls podName:fc23d3a6-a4c6-4790-aade-ca148619d0d0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:05.917638333 +0000 UTC m=+49.701046076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlcpp" (UID: "fc23d3a6-a4c6-4790-aade-ca148619d0d0") : secret "insights-runtime-extractor-tls" not found Jul 09 19:00:03.929410 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:03.929389 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s4g5r_b2c4f776-0c98-4e11-bb43-23c96122f8ff/dns-node-resolver/0.log" Jul 09 19:00:04.105572 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.105542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf" event={"ID":"431e59c7-f782-4fa2-8268-05bd691f7605","Type":"ContainerStarted","Data":"80831478b9e888ac54988117ba6a0ff22f0b31d109ee39214c350a42b6dfbfaf"} Jul 09 19:00:04.107061 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.107043 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:00:04.107339 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.107325 2576 scope.go:117] "RemoveContainer" containerID="9c68fb286fa337377b2ba64e4cb80efb8f4b6282235d9dc334307d17f98b17b4" Jul 09 19:00:04.107484 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:04.107468 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gwnzq_openshift-console-operator(f4c316ad-4abf-4014-8d87-01cf69151274)\"" pod="openshift-console-operator/console-operator-7866497494-gwnzq" podUID="f4c316ad-4abf-4014-8d87-01cf69151274" Jul 09 19:00:04.463054 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.463021 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rx7p4"] Jul 09 19:00:04.495489 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.495455 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rx7p4"] Jul 09 19:00:04.495668 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.495593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.498824 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.498801 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 19:00:04.498918 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.498801 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 19:00:04.498918 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.498857 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 19:00:04.500059 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.500038 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 19:00:04.500160 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.500048 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mn2lw\"" Jul 09 19:00:04.522516 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.522476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/de4eff7b-7594-4c0f-ba00-c6a1196b4651-signing-key\") pod \"service-ca-79f68b9f4f-rx7p4\" (UID: \"de4eff7b-7594-4c0f-ba00-c6a1196b4651\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.522638 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.522520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/de4eff7b-7594-4c0f-ba00-c6a1196b4651-signing-cabundle\") pod \"service-ca-79f68b9f4f-rx7p4\" (UID: \"de4eff7b-7594-4c0f-ba00-c6a1196b4651\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.522638 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.522616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q67sc\" (UniqueName: \"kubernetes.io/projected/de4eff7b-7594-4c0f-ba00-c6a1196b4651-kube-api-access-q67sc\") pod \"service-ca-79f68b9f4f-rx7p4\" (UID: \"de4eff7b-7594-4c0f-ba00-c6a1196b4651\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.622959 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.622915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q67sc\" (UniqueName: \"kubernetes.io/projected/de4eff7b-7594-4c0f-ba00-c6a1196b4651-kube-api-access-q67sc\") pod \"service-ca-79f68b9f4f-rx7p4\" (UID: \"de4eff7b-7594-4c0f-ba00-c6a1196b4651\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.623121 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.623030 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/de4eff7b-7594-4c0f-ba00-c6a1196b4651-signing-key\") pod \"service-ca-79f68b9f4f-rx7p4\" (UID: \"de4eff7b-7594-4c0f-ba00-c6a1196b4651\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.623121 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.623047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/de4eff7b-7594-4c0f-ba00-c6a1196b4651-signing-cabundle\") pod \"service-ca-79f68b9f4f-rx7p4\" (UID: \"de4eff7b-7594-4c0f-ba00-c6a1196b4651\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.623684 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.623662 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/de4eff7b-7594-4c0f-ba00-c6a1196b4651-signing-cabundle\") pod \"service-ca-79f68b9f4f-rx7p4\" (UID: \"de4eff7b-7594-4c0f-ba00-c6a1196b4651\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.625330 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.625310 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/de4eff7b-7594-4c0f-ba00-c6a1196b4651-signing-key\") pod \"service-ca-79f68b9f4f-rx7p4\" (UID: \"de4eff7b-7594-4c0f-ba00-c6a1196b4651\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.630959 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.630925 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q67sc\" (UniqueName: \"kubernetes.io/projected/de4eff7b-7594-4c0f-ba00-c6a1196b4651-kube-api-access-q67sc\") pod \"service-ca-79f68b9f4f-rx7p4\" (UID: \"de4eff7b-7594-4c0f-ba00-c6a1196b4651\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.730307 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.730236 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5hq5_e432054c-7eae-4a1f-a642-1c56f474dbb8/node-ca/0.log" Jul 09 19:00:04.805109 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.805074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" Jul 09 19:00:04.941341 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:04.941313 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rx7p4"] Jul 09 19:00:04.944297 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:04.944267 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4eff7b_7594_4c0f_ba00_c6a1196b4651.slice/crio-4e71d769a917489a4828e62f5fba8c01b43d4d876bad17ecb71d153ce55af1f5 WatchSource:0}: Error finding container 4e71d769a917489a4828e62f5fba8c01b43d4d876bad17ecb71d153ce55af1f5: Status 404 returned error can't find the container with id 4e71d769a917489a4828e62f5fba8c01b43d4d876bad17ecb71d153ce55af1f5 Jul 09 19:00:05.112112 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:05.112065 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" event={"ID":"de4eff7b-7594-4c0f-ba00-c6a1196b4651","Type":"ContainerStarted","Data":"5c6caf8cc7e0b08237b63d970d961820f03a8f57fd3c70d1b3b807a2aecfad60"} Jul 09 19:00:05.112564 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:05.112121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" event={"ID":"de4eff7b-7594-4c0f-ba00-c6a1196b4651","Type":"ContainerStarted","Data":"4e71d769a917489a4828e62f5fba8c01b43d4d876bad17ecb71d153ce55af1f5"} Jul 09 19:00:05.128149 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:05.128085 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-rx7p4" podStartSLOduration=1.128070818 podStartE2EDuration="1.128070818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:05.127042656 +0000 UTC m=+48.910450433" watchObservedRunningTime="2026-07-09 19:00:05.128070818 +0000 UTC m=+48.911478560" Jul 09 19:00:05.530611 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:05.530585 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqlrt_5dead0cf-83f9-471d-a4b9-7de73e42c48a/serve-healthcheck-canary/0.log" Jul 09 19:00:05.933548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:05.933524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:05.933696 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:05.933576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:05.933696 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:05.933667 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 19:00:05.933769 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:05.933722 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls podName:fc23d3a6-a4c6-4790-aade-ca148619d0d0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:09.93370912 +0000 UTC m=+53.717116866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlcpp" (UID: "fc23d3a6-a4c6-4790-aade-ca148619d0d0") : secret "insights-runtime-extractor-tls" not found Jul 09 19:00:05.933769 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:05.933671 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 19:00:05.933844 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:05.933781 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm podName:fc23d3a6-a4c6-4790-aade-ca148619d0d0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:09.933769375 +0000 UTC m=+53.717177118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlcpp" (UID: "fc23d3a6-a4c6-4790-aade-ca148619d0d0") : configmap "kube-rbac-proxy" not found Jul 09 19:00:06.437594 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:06.437550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 19:00:06.437963 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:06.437612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 19:00:06.437963 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:06.437737 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 19:00:06.437963 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:06.437754 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c5976f478-z4dlj: secret "image-registry-tls" not found Jul 09 19:00:06.437963 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:06.437760 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 19:00:06.437963 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:06.437806 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls podName:c2bafddc-bab1-4ebb-9bcf-edb32662e310 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:22.437791813 +0000 UTC m=+66.221199556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls") pod "image-registry-c5976f478-z4dlj" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310") : secret "image-registry-tls" not found Jul 09 19:00:06.437963 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:06.437820 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls podName:78435845-9b02-4b2a-9c9e-8ee04618f9c0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:22.437813814 +0000 UTC m=+66.221221556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls") pod "dns-default-tkm5j" (UID: "78435845-9b02-4b2a-9c9e-8ee04618f9c0") : secret "dns-default-metrics-tls" not found Jul 09 19:00:06.627664 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:06.627580 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 19:00:06.627806 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:06.627681 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 19:00:06.628093 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:06.628081 2576 scope.go:117] "RemoveContainer" containerID="9c68fb286fa337377b2ba64e4cb80efb8f4b6282235d9dc334307d17f98b17b4" Jul 09 19:00:06.628284 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:06.628261 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gwnzq_openshift-console-operator(f4c316ad-4abf-4014-8d87-01cf69151274)\"" pod="openshift-console-operator/console-operator-7866497494-gwnzq" podUID="f4c316ad-4abf-4014-8d87-01cf69151274" Jul 09 19:00:07.121838 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:07.121798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf" event={"ID":"431e59c7-f782-4fa2-8268-05bd691f7605","Type":"ContainerStarted","Data":"1a24f6203bc3d37198608bf3143b3a138495f857a080ec705c7d26519cf9c28a"} Jul 09 19:00:07.122013 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:07.121873 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf" event={"ID":"431e59c7-f782-4fa2-8268-05bd691f7605","Type":"ContainerStarted","Data":"eb9df7fb7c9f03644a9dd7ea1f4c14f8d13fd3276555f36ee709a2b167254a6b"} Jul 09 19:00:07.139778 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:07.139725 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qhngf" podStartSLOduration=1.663645572 podStartE2EDuration="4.139707828s" totalImagesPullingTime="2.476062256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:07.139527797 +0000 UTC m=+50.922935581" watchObservedRunningTime="2026-07-09 19:00:07.139707828 +0000 UTC m=+50.923115593" Jul 09 19:00:09.965717 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:09.965686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:09.966214 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:09.965741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:09.966214 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:09.965838 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 19:00:09.966214 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:00:09.965903 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls podName:fc23d3a6-a4c6-4790-aade-ca148619d0d0 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:17.965887437 +0000 UTC m=+61.749295200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlcpp" (UID: "fc23d3a6-a4c6-4790-aade-ca148619d0d0") : secret "insights-runtime-extractor-tls" not found Jul 09 19:00:09.966214 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:09.966183 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc23d3a6-a4c6-4790-aade-ca148619d0d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:17.443679 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:17.443650 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-69v7j" Jul 09 19:00:18.025165 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:18.025127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:18.027441 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:18.027386 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc23d3a6-a4c6-4790-aade-ca148619d0d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlcpp\" (UID: \"fc23d3a6-a4c6-4790-aade-ca148619d0d0\") " pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:18.067342 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:18.067319 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ntcpk\"" Jul 09 19:00:18.074877 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:18.074859 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlcpp" Jul 09 19:00:18.200717 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:18.200578 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlcpp"] Jul 09 19:00:18.203184 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:18.203155 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc23d3a6_a4c6_4790_aade_ca148619d0d0.slice/crio-f2e6fd2021da886d8574cf547377d07e6a8768c0a18e44aeef39f434174241c0 WatchSource:0}: Error finding container f2e6fd2021da886d8574cf547377d07e6a8768c0a18e44aeef39f434174241c0: Status 404 returned error can't find the container with id f2e6fd2021da886d8574cf547377d07e6a8768c0a18e44aeef39f434174241c0 Jul 09 19:00:18.724112 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:18.724042 2576 scope.go:117] "RemoveContainer" containerID="9c68fb286fa337377b2ba64e4cb80efb8f4b6282235d9dc334307d17f98b17b4" Jul 09 19:00:19.163253 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:19.163183 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:00:19.163415 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:19.163315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gwnzq" event={"ID":"f4c316ad-4abf-4014-8d87-01cf69151274","Type":"ContainerStarted","Data":"355e1374fc9408e8866b21552762c6ef1e1872a84105e8e37b9ebd171aa1deeb"} Jul 09 19:00:19.163999 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:19.163941 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 19:00:19.164939 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:19.164876 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlcpp" event={"ID":"fc23d3a6-a4c6-4790-aade-ca148619d0d0","Type":"ContainerStarted","Data":"f2e6fd2021da886d8574cf547377d07e6a8768c0a18e44aeef39f434174241c0"} Jul 09 19:00:19.183995 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:19.183922 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-gwnzq" podStartSLOduration=18.761624654 podStartE2EDuration="23.183908193s" totalImagesPullingTime="4.422283539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:19.183281493 +0000 UTC m=+62.966689252" watchObservedRunningTime="2026-07-09 19:00:19.183908193 +0000 UTC m=+62.967315957" Jul 09 19:00:19.802732 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:19.802697 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-gwnzq" Jul 09 19:00:21.457493 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.457459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 19:00:21.457841 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.457522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 19:00:21.460655 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.460633 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 19:00:21.460655 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.460649 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 19:00:21.470036 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.470010 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f3616e-5200-4753-8a67-1252d9f93c23-metrics-certs\") pod \"network-metrics-daemon-c4kkr\" (UID: \"a9f3616e-5200-4753-8a67-1252d9f93c23\") " pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 19:00:21.470129 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.470085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7cd65f36-9ffa-46e3-995f-7cc0395f757d-original-pull-secret\") pod \"global-pull-secret-syncer-lpcft\" (UID: \"7cd65f36-9ffa-46e3-995f-7cc0395f757d\") " pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 19:00:21.558537 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.558487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkv6\" (UniqueName: \"kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6\") pod \"network-check-target-q8hn6\" (UID: \"a0b2df71-b27f-4108-826a-b3cf0827e637\") " pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 19:00:21.561600 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.561578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 19:00:21.571488 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.571465 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 19:00:21.582215 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.582194 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpkv6\" (UniqueName: \"kubernetes.io/projected/a0b2df71-b27f-4108-826a-b3cf0827e637-kube-api-access-mpkv6\") pod \"network-check-target-q8hn6\" (UID: \"a0b2df71-b27f-4108-826a-b3cf0827e637\") " pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 19:00:21.637566 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.637545 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dlpdq\"" Jul 09 19:00:21.643752 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.643560 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8ctlj\"" Jul 09 19:00:21.645598 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.645577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 19:00:21.645730 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.645706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcft" Jul 09 19:00:21.651781 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.651756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4kkr" Jul 09 19:00:21.967909 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:21.967836 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q8hn6"] Jul 09 19:00:21.971087 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:21.971064 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b2df71_b27f_4108_826a_b3cf0827e637.slice/crio-792936cab40cabd465dda894686214e49633645654cea762fa8158af0dfe6b22 WatchSource:0}: Error finding container 792936cab40cabd465dda894686214e49633645654cea762fa8158af0dfe6b22: Status 404 returned error can't find the container with id 792936cab40cabd465dda894686214e49633645654cea762fa8158af0dfe6b22 Jul 09 19:00:22.176416 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.176385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q8hn6" event={"ID":"a0b2df71-b27f-4108-826a-b3cf0827e637","Type":"ContainerStarted","Data":"792936cab40cabd465dda894686214e49633645654cea762fa8158af0dfe6b22"} Jul 09 19:00:22.177974 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.177949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlcpp" event={"ID":"fc23d3a6-a4c6-4790-aade-ca148619d0d0","Type":"ContainerStarted","Data":"0f903ee5e80eb84c3658c43356198fb77630175520782cf1fe8bf8497410bd43"} Jul 09 19:00:22.189269 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.189245 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lpcft"] Jul 09 19:00:22.191811 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:22.191790 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd65f36_9ffa_46e3_995f_7cc0395f757d.slice/crio-ff8aea348f03f728e8b239d5a313ad16ef3f86539e48e167effe768075bd8900 WatchSource:0}: Error finding container ff8aea348f03f728e8b239d5a313ad16ef3f86539e48e167effe768075bd8900: Status 404 returned error can't find the container with id ff8aea348f03f728e8b239d5a313ad16ef3f86539e48e167effe768075bd8900 Jul 09 19:00:22.194272 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.194249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c4kkr"] Jul 09 19:00:22.196226 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:22.196203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f3616e_5200_4753_8a67_1252d9f93c23.slice/crio-5243fb382f9f86afdf9ebd794eb7d997cf91cc5e4a91bffb53d6dc23b40bd2e6 WatchSource:0}: Error finding container 5243fb382f9f86afdf9ebd794eb7d997cf91cc5e4a91bffb53d6dc23b40bd2e6: Status 404 returned error can't find the container with id 5243fb382f9f86afdf9ebd794eb7d997cf91cc5e4a91bffb53d6dc23b40bd2e6 Jul 09 19:00:22.466410 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.466349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 19:00:22.466410 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.466384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 19:00:22.468593 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.468570 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78435845-9b02-4b2a-9c9e-8ee04618f9c0-metrics-tls\") pod \"dns-default-tkm5j\" (UID: \"78435845-9b02-4b2a-9c9e-8ee04618f9c0\") " pod="openshift-dns/dns-default-tkm5j" Jul 09 19:00:22.468766 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.468747 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") pod \"image-registry-c5976f478-z4dlj\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 19:00:22.669093 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.669057 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-chfdb\"" Jul 09 19:00:22.677253 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.677233 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 19:00:22.687604 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.687580 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ssx5x\"" Jul 09 19:00:22.695961 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.695922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tkm5j" Jul 09 19:00:22.824180 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.824121 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c5976f478-z4dlj"] Jul 09 19:00:22.826209 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:22.826179 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2bafddc_bab1_4ebb_9bcf_edb32662e310.slice/crio-c88fd5d06ffe8ec0e48086074102e10d767f325ffcae464ef9f5ba153b151e83 WatchSource:0}: Error finding container c88fd5d06ffe8ec0e48086074102e10d767f325ffcae464ef9f5ba153b151e83: Status 404 returned error can't find the container with id c88fd5d06ffe8ec0e48086074102e10d767f325ffcae464ef9f5ba153b151e83 Jul 09 19:00:22.841659 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:22.841636 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tkm5j"] Jul 09 19:00:22.844864 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:22.844838 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78435845_9b02_4b2a_9c9e_8ee04618f9c0.slice/crio-5eaa55b6e3623429e4fd0df791042eca325f89d92b57bc6f2d6de3939fbcbacf WatchSource:0}: Error finding container 5eaa55b6e3623429e4fd0df791042eca325f89d92b57bc6f2d6de3939fbcbacf: Status 404 returned error can't find the container with id 5eaa55b6e3623429e4fd0df791042eca325f89d92b57bc6f2d6de3939fbcbacf Jul 09 19:00:23.183721 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.183637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4kkr" event={"ID":"a9f3616e-5200-4753-8a67-1252d9f93c23","Type":"ContainerStarted","Data":"5243fb382f9f86afdf9ebd794eb7d997cf91cc5e4a91bffb53d6dc23b40bd2e6"} Jul 09 19:00:23.185581 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.185553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" event={"ID":"c2bafddc-bab1-4ebb-9bcf-edb32662e310","Type":"ContainerStarted","Data":"c1da431221fe5b4529bd36e3d5977813187b2d23fdb94fd945b74e93034d22fe"} Jul 09 19:00:23.185707 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.185605 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" event={"ID":"c2bafddc-bab1-4ebb-9bcf-edb32662e310","Type":"ContainerStarted","Data":"c88fd5d06ffe8ec0e48086074102e10d767f325ffcae464ef9f5ba153b151e83"} Jul 09 19:00:23.185802 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.185789 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 19:00:23.187223 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.187200 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkm5j" event={"ID":"78435845-9b02-4b2a-9c9e-8ee04618f9c0","Type":"ContainerStarted","Data":"5eaa55b6e3623429e4fd0df791042eca325f89d92b57bc6f2d6de3939fbcbacf"} Jul 09 19:00:23.188441 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.188419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lpcft" event={"ID":"7cd65f36-9ffa-46e3-995f-7cc0395f757d","Type":"ContainerStarted","Data":"ff8aea348f03f728e8b239d5a313ad16ef3f86539e48e167effe768075bd8900"} Jul 09 19:00:23.208619 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.208580 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" podStartSLOduration=66.208565474 podStartE2EDuration="1m6.208565474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:23.207962374 +0000 UTC m=+66.991370142" watchObservedRunningTime="2026-07-09 19:00:23.208565474 +0000 UTC m=+66.991973239" Jul 09 19:00:23.700935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.700863 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8"] Jul 09 19:00:23.721372 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.721342 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd"] Jul 09 19:00:23.721543 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.721461 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" Jul 09 19:00:23.724777 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.724751 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 19:00:23.724923 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.724818 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bhg98\"" Jul 09 19:00:23.725478 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.725258 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 19:00:23.725478 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.725272 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 19:00:23.725478 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.725258 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 19:00:23.738852 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.738833 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8"] Jul 09 19:00:23.738961 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.738876 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd"] Jul 09 19:00:23.738961 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.738933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.741850 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.741835 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 19:00:23.742224 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.742200 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 19:00:23.742367 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.742350 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 19:00:23.742430 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.742416 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 19:00:23.777177 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.777148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/114b1876-e7a9-4956-9153-b8deec646559-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58f59f4cd-669k8\" (UID: \"114b1876-e7a9-4956-9153-b8deec646559\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" Jul 09 19:00:23.777300 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.777193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbkz7\" (UniqueName: \"kubernetes.io/projected/114b1876-e7a9-4956-9153-b8deec646559-kube-api-access-qbkz7\") pod \"managed-serviceaccount-addon-agent-58f59f4cd-669k8\" (UID: \"114b1876-e7a9-4956-9153-b8deec646559\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" Jul 09 19:00:23.878114 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.878081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/114b1876-e7a9-4956-9153-b8deec646559-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58f59f4cd-669k8\" (UID: \"114b1876-e7a9-4956-9153-b8deec646559\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" Jul 09 19:00:23.878262 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.878122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-ca\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.878262 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.878143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54kh9\" (UniqueName: \"kubernetes.io/projected/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-kube-api-access-54kh9\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.878262 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.878170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbkz7\" (UniqueName: \"kubernetes.io/projected/114b1876-e7a9-4956-9153-b8deec646559-kube-api-access-qbkz7\") pod \"managed-serviceaccount-addon-agent-58f59f4cd-669k8\" (UID: \"114b1876-e7a9-4956-9153-b8deec646559\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" Jul 09 19:00:23.878262 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.878189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.878262 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.878231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-hub\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.878262 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.878254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.878528 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.878288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.881540 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.881517 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/114b1876-e7a9-4956-9153-b8deec646559-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58f59f4cd-669k8\" (UID: \"114b1876-e7a9-4956-9153-b8deec646559\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" Jul 09 19:00:23.890937 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.890892 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbkz7\" (UniqueName: \"kubernetes.io/projected/114b1876-e7a9-4956-9153-b8deec646559-kube-api-access-qbkz7\") pod \"managed-serviceaccount-addon-agent-58f59f4cd-669k8\" (UID: \"114b1876-e7a9-4956-9153-b8deec646559\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" Jul 09 19:00:23.979561 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.978723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-hub\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.979561 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.978765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.979561 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.978818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.979561 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.978867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-ca\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.979561 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.978893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54kh9\" (UniqueName: \"kubernetes.io/projected/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-kube-api-access-54kh9\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.979561 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.978929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.980026 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.979962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.982950 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.982909 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-hub\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.983455 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.983416 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-ca\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.985435 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.985409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.990117 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.990059 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:23.990351 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:23.990288 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54kh9\" (UniqueName: \"kubernetes.io/projected/9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8-kube-api-access-54kh9\") pod \"cluster-proxy-proxy-agent-76dbc55cf4-j2xrd\" (UID: \"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:24.044491 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:24.044277 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" Jul 09 19:00:24.055055 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:24.055032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" Jul 09 19:00:24.196828 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:24.196798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4kkr" event={"ID":"a9f3616e-5200-4753-8a67-1252d9f93c23","Type":"ContainerStarted","Data":"366ecaaa51b0add2942d8b79b204fbe666d7140e8ab8386f5ec0b218e1c76d5a"} Jul 09 19:00:24.196997 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:24.196852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4kkr" event={"ID":"a9f3616e-5200-4753-8a67-1252d9f93c23","Type":"ContainerStarted","Data":"9040d763df197d92f50762123ba72cbc6ded8e87091c9b2f54d9d9f9f54a7caf"} Jul 09 19:00:24.214371 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:24.213829 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c4kkr" podStartSLOduration=67.150036191 podStartE2EDuration="1m8.213809441s" totalImagesPullingTime="1.06377325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:24.212553466 +0000 UTC m=+67.995961233" watchObservedRunningTime="2026-07-09 19:00:24.213809441 +0000 UTC m=+67.997217207" Jul 09 19:00:24.412661 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:24.412439 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8"] Jul 09 19:00:24.416478 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:24.416434 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod114b1876_e7a9_4956_9153_b8deec646559.slice/crio-3e0b59b40a73411fbdf6ec55d750166516556a5e942e04a812ddbeee1bf37db6 WatchSource:0}: Error finding container 3e0b59b40a73411fbdf6ec55d750166516556a5e942e04a812ddbeee1bf37db6: Status 404 returned error can't find the container with id 3e0b59b40a73411fbdf6ec55d750166516556a5e942e04a812ddbeee1bf37db6 Jul 09 19:00:24.452274 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:24.452251 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd"] Jul 09 19:00:24.455221 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:24.455194 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9834a4dd_b4f2_42fc_b11a_f3ed41c0c0b8.slice/crio-da5df732fdc7ed647fdffedad34f053d041bdc159f7a2736cabff87fdacea776 WatchSource:0}: Error finding container da5df732fdc7ed647fdffedad34f053d041bdc159f7a2736cabff87fdacea776: Status 404 returned error can't find the container with id da5df732fdc7ed647fdffedad34f053d041bdc159f7a2736cabff87fdacea776 Jul 09 19:00:25.206195 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:25.206068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlcpp" event={"ID":"fc23d3a6-a4c6-4790-aade-ca148619d0d0","Type":"ContainerStarted","Data":"c90423a4cfb0af285180f2fe19327b1274d3e385c208b177461129c2fe8e9b62"} Jul 09 19:00:25.209219 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:25.209151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" event={"ID":"114b1876-e7a9-4956-9153-b8deec646559","Type":"ContainerStarted","Data":"3e0b59b40a73411fbdf6ec55d750166516556a5e942e04a812ddbeee1bf37db6"} Jul 09 19:00:25.211860 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:25.211809 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" event={"ID":"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8","Type":"ContainerStarted","Data":"da5df732fdc7ed647fdffedad34f053d041bdc159f7a2736cabff87fdacea776"} Jul 09 19:00:27.224942 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:27.224903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkm5j" event={"ID":"78435845-9b02-4b2a-9c9e-8ee04618f9c0","Type":"ContainerStarted","Data":"b0a30ed10ebf665632b6dcb05ba8ee9b061f8f2739b0f6b0e05e0888dd5734eb"} Jul 09 19:00:33.250817 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.250779 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" event={"ID":"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8","Type":"ContainerStarted","Data":"54147bc44cc1043a42a751f75e583cfe6778d74b01f0ce248216f6a8229a7b6f"} Jul 09 19:00:33.251126 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.250825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" event={"ID":"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8","Type":"ContainerStarted","Data":"a118992be5c54c0438eb010a0cc4bcb6258e2f02871e499762d1a0cf3e8d3da7"} Jul 09 19:00:33.252549 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.252524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkm5j" event={"ID":"78435845-9b02-4b2a-9c9e-8ee04618f9c0","Type":"ContainerStarted","Data":"10d047409586ecc31da0c9d80a3d5d2b912e5fa99195d942c259911d3c34e7ed"} Jul 09 19:00:33.252775 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.252754 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tkm5j" Jul 09 19:00:33.254007 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.253985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lpcft" event={"ID":"7cd65f36-9ffa-46e3-995f-7cc0395f757d","Type":"ContainerStarted","Data":"675757dba9b1d3cfc6b522ea2bbe1cb98b97ab1d378bf87dea5b2064fba8f64e"} Jul 09 19:00:33.255590 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.255569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q8hn6" event={"ID":"a0b2df71-b27f-4108-826a-b3cf0827e637","Type":"ContainerStarted","Data":"dabaccb96532fdca01c191423b125b485929ad9b53658563ae21312393148b6d"} Jul 09 19:00:33.255671 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.255632 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 19:00:33.257684 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.257665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlcpp" event={"ID":"fc23d3a6-a4c6-4790-aade-ca148619d0d0","Type":"ContainerStarted","Data":"bc6e4ffd0faa866d5f5684899cc2c1afeed20a9d82d9e136c842ffd81257ac1b"} Jul 09 19:00:33.258926 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.258904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" event={"ID":"114b1876-e7a9-4956-9153-b8deec646559","Type":"ContainerStarted","Data":"1e750e09e4045cbeae4130d7955a4755d250c968191637da63ff741dfb325222"} Jul 09 19:00:33.271140 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.271100 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tkm5j" podStartSLOduration=39.989643691 podStartE2EDuration="43.271086971s" totalImagesPullingTime="3.28144328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:33.269870069 +0000 UTC m=+77.053277860" watchObservedRunningTime="2026-07-09 19:00:33.271086971 +0000 UTC m=+77.054494736" Jul 09 19:00:33.302768 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.302729 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58f59f4cd-669k8" podStartSLOduration=2.249582467 podStartE2EDuration="10.302717031s" totalImagesPullingTime="8.053134564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:33.287401331 +0000 UTC m=+77.070809121" watchObservedRunningTime="2026-07-09 19:00:33.302717031 +0000 UTC m=+77.086124795" Jul 09 19:00:33.302982 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.302958 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q8hn6" podStartSLOduration=66.802831309 podStartE2EDuration="1m17.302950863s" totalImagesPullingTime="10.500119554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:33.302312994 +0000 UTC m=+77.085720776" watchObservedRunningTime="2026-07-09 19:00:33.302950863 +0000 UTC m=+77.086358628" Jul 09 19:00:33.317169 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.317131 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lpcft" podStartSLOduration=66.037758623 podStartE2EDuration="1m16.317119187s" totalImagesPullingTime="10.279360564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:33.316237249 +0000 UTC m=+77.099645028" watchObservedRunningTime="2026-07-09 19:00:33.317119187 +0000 UTC m=+77.100526952" Jul 09 19:00:33.333738 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:33.333701 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vlcpp" podStartSLOduration=17.335256043 podStartE2EDuration="31.333689356s" totalImagesPullingTime="13.998433313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:00:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:33.332219098 +0000 UTC m=+77.115626879" watchObservedRunningTime="2026-07-09 19:00:33.333689356 +0000 UTC m=+77.117097121" Jul 09 19:00:34.264585 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:34.264550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" event={"ID":"9834a4dd-b4f2-42fc-b11a-f3ed41c0c0b8","Type":"ContainerStarted","Data":"60dfe55ea10c70cd335b527cb075ab60a2955f4f8210c50e141b0d367f987fe3"} Jul 09 19:00:34.288968 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:34.288920 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76dbc55cf4-j2xrd" podStartSLOduration=2.79230934 podStartE2EDuration="11.288904947s" totalImagesPullingTime="8.496595607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:34.286754615 +0000 UTC m=+78.070162405" watchObservedRunningTime="2026-07-09 19:00:34.288904947 +0000 UTC m=+78.072312712" Jul 09 19:00:37.268015 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:37.267983 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tkm5j" Jul 09 19:00:42.682170 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:42.682053 2576 patch_prober.go:28] interesting pod/image-registry-c5976f478-z4dlj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 19:00:42.682170 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:42.682125 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" podUID="c2bafddc-bab1-4ebb-9bcf-edb32662e310" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 19:00:44.200333 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:44.200304 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 19:00:46.258306 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:46.258271 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c5976f478-z4dlj"] Jul 09 19:00:54.001424 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.001389 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5c8cd"] Jul 09 19:00:54.006198 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.006177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.009143 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.009123 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5v9q2\"" Jul 09 19:00:54.009303 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.009148 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 19:00:54.009422 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.009148 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 19:00:54.009422 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.009148 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 19:00:54.009422 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.009201 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 19:00:54.009612 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.009259 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 19:00:54.010478 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.010451 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 19:00:54.104702 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.104680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0923fce-5a9a-4b14-99e0-f69f8c615e37-sys\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.104815 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.104719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-textfile\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.104815 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.104752 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.104815 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.104793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-tls\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.104976 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.104839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-wtmp\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.104976 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.104865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-accelerators-collector-config\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.104976 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.104895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0923fce-5a9a-4b14-99e0-f69f8c615e37-metrics-client-ca\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.104976 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.104935 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb47t\" (UniqueName: \"kubernetes.io/projected/e0923fce-5a9a-4b14-99e0-f69f8c615e37-kube-api-access-sb47t\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.104976 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.104959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e0923fce-5a9a-4b14-99e0-f69f8c615e37-root\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.205324 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.205294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.205483 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.205338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-tls\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.205483 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.205368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-wtmp\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.205483 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.205392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-accelerators-collector-config\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.205483 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.205423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0923fce-5a9a-4b14-99e0-f69f8c615e37-metrics-client-ca\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.205483 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.205474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb47t\" (UniqueName: \"kubernetes.io/projected/e0923fce-5a9a-4b14-99e0-f69f8c615e37-kube-api-access-sb47t\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.205984 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.205768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e0923fce-5a9a-4b14-99e0-f69f8c615e37-root\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.205984 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.205921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0923fce-5a9a-4b14-99e0-f69f8c615e37-sys\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.205984 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.205953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-textfile\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.205984 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.205971 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-wtmp\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.206186 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.206049 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e0923fce-5a9a-4b14-99e0-f69f8c615e37-root\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.206248 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.206215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-textfile\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.206306 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.206260 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0923fce-5a9a-4b14-99e0-f69f8c615e37-sys\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.206858 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.206833 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0923fce-5a9a-4b14-99e0-f69f8c615e37-metrics-client-ca\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.207196 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.207174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-accelerators-collector-config\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.208219 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.208186 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-tls\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.208668 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.208646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0923fce-5a9a-4b14-99e0-f69f8c615e37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.216881 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.216857 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb47t\" (UniqueName: \"kubernetes.io/projected/e0923fce-5a9a-4b14-99e0-f69f8c615e37-kube-api-access-sb47t\") pod \"node-exporter-5c8cd\" (UID: \"e0923fce-5a9a-4b14-99e0-f69f8c615e37\") " pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.317246 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:54.317193 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5c8cd" Jul 09 19:00:54.331634 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:00:54.331602 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0923fce_5a9a_4b14_99e0_f69f8c615e37.slice/crio-8832beba054311daf1b64fad33afcdfc76a35b23a35a4490bc87ba7f422ed9b4 WatchSource:0}: Error finding container 8832beba054311daf1b64fad33afcdfc76a35b23a35a4490bc87ba7f422ed9b4: Status 404 returned error can't find the container with id 8832beba054311daf1b64fad33afcdfc76a35b23a35a4490bc87ba7f422ed9b4 Jul 09 19:00:55.339394 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:55.339359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5c8cd" event={"ID":"e0923fce-5a9a-4b14-99e0-f69f8c615e37","Type":"ContainerStarted","Data":"8832beba054311daf1b64fad33afcdfc76a35b23a35a4490bc87ba7f422ed9b4"} Jul 09 19:00:58.351852 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:58.351815 2576 generic.go:356] "Generic (PLEG): container finished" podID="e0923fce-5a9a-4b14-99e0-f69f8c615e37" containerID="49f33fd06b8ad6e7e1664aadb7d83bb5dceb6ac24b0c3ac2c8cf3e1da4901446" exitCode=0 Jul 09 19:00:58.352209 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:58.351895 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5c8cd" event={"ID":"e0923fce-5a9a-4b14-99e0-f69f8c615e37","Type":"ContainerDied","Data":"49f33fd06b8ad6e7e1664aadb7d83bb5dceb6ac24b0c3ac2c8cf3e1da4901446"} Jul 09 19:00:59.357852 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:59.357814 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5c8cd" event={"ID":"e0923fce-5a9a-4b14-99e0-f69f8c615e37","Type":"ContainerStarted","Data":"c0f0504c4b58305f641a7e2cefee2fc3b28dd980a652f46ed8417dde355c8e03"} Jul 09 19:00:59.358225 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:59.357871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5c8cd" event={"ID":"e0923fce-5a9a-4b14-99e0-f69f8c615e37","Type":"ContainerStarted","Data":"1a59cb8bf20430581ae7a0471580d5bed750bb4ce5c658a445b4a96625c17494"} Jul 09 19:00:59.378241 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:00:59.378194 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5c8cd" podStartSLOduration=3.257443888 podStartE2EDuration="6.378179358s" totalImagesPullingTime="3.016489138s" totalInitContainerRuntime="104.246332ms" isStatefulPod=true podCreationTimestamp="2026-07-09 19:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:59.376488999 +0000 UTC m=+103.159896777" watchObservedRunningTime="2026-07-09 19:00:59.378179358 +0000 UTC m=+103.161587148" Jul 09 19:01:04.267856 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:04.267828 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q8hn6" Jul 09 19:01:07.387158 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:07.387123 2576 generic.go:356] "Generic (PLEG): container finished" podID="ab0cfcbe-e253-4c76-80cf-4feff0136d56" containerID="3590b96d86acdbcafd4f2c38545c702464c4377f3c03e91379e9a8091fbf5fe3" exitCode=0 Jul 09 19:01:07.387665 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:07.387201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" event={"ID":"ab0cfcbe-e253-4c76-80cf-4feff0136d56","Type":"ContainerDied","Data":"3590b96d86acdbcafd4f2c38545c702464c4377f3c03e91379e9a8091fbf5fe3"} Jul 09 19:01:07.387665 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:07.387647 2576 scope.go:117] "RemoveContainer" containerID="3590b96d86acdbcafd4f2c38545c702464c4377f3c03e91379e9a8091fbf5fe3" Jul 09 19:01:08.392361 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:08.392328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-cg9gb" event={"ID":"ab0cfcbe-e253-4c76-80cf-4feff0136d56","Type":"ContainerStarted","Data":"bbacf8715b6b9a4f1bd93501bbc57cea92707b2a906ab53c2e536856a55e6eca"} Jul 09 19:01:11.286021 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.285985 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" podUID="c2bafddc-bab1-4ebb-9bcf-edb32662e310" containerName="registry" containerID="cri-o://c1da431221fe5b4529bd36e3d5977813187b2d23fdb94fd945b74e93034d22fe" gracePeriod=30 Jul 09 19:01:11.404768 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.404745 2576 generic.go:356] "Generic (PLEG): container finished" podID="c2bafddc-bab1-4ebb-9bcf-edb32662e310" containerID="c1da431221fe5b4529bd36e3d5977813187b2d23fdb94fd945b74e93034d22fe" exitCode=0 Jul 09 19:01:11.404859 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.404816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" event={"ID":"c2bafddc-bab1-4ebb-9bcf-edb32662e310","Type":"ContainerDied","Data":"c1da431221fe5b4529bd36e3d5977813187b2d23fdb94fd945b74e93034d22fe"} Jul 09 19:01:11.522198 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.522174 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 19:01:11.630606 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.630555 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59nc2\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-kube-api-access-59nc2\") pod \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " Jul 09 19:01:11.630606 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.630585 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2bafddc-bab1-4ebb-9bcf-edb32662e310-ca-trust-extracted\") pod \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " Jul 09 19:01:11.630760 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.630618 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-image-registry-private-configuration\") pod \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " Jul 09 19:01:11.630760 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.630644 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-installation-pull-secrets\") pod \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " Jul 09 19:01:11.630760 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.630669 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-certificates\") pod \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " Jul 09 19:01:11.630760 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.630692 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-bound-sa-token\") pod \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " Jul 09 19:01:11.630760 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.630712 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") pod \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " Jul 09 19:01:11.630760 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.630728 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-trusted-ca\") pod \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\" (UID: \"c2bafddc-bab1-4ebb-9bcf-edb32662e310\") " Jul 09 19:01:11.631317 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.631258 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c2bafddc-bab1-4ebb-9bcf-edb32662e310" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:01:11.631317 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.631249 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c2bafddc-bab1-4ebb-9bcf-edb32662e310" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:01:11.633216 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.633160 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c2bafddc-bab1-4ebb-9bcf-edb32662e310" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 19:01:11.633434 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.633225 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c2bafddc-bab1-4ebb-9bcf-edb32662e310" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:01:11.633434 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.633349 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-kube-api-access-59nc2" (OuterVolumeSpecName: "kube-api-access-59nc2") pod "c2bafddc-bab1-4ebb-9bcf-edb32662e310" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310"). InnerVolumeSpecName "kube-api-access-59nc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:01:11.633434 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.633361 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c2bafddc-bab1-4ebb-9bcf-edb32662e310" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 19:01:11.633434 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.633402 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c2bafddc-bab1-4ebb-9bcf-edb32662e310" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:01:11.639588 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.639566 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2bafddc-bab1-4ebb-9bcf-edb32662e310-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c2bafddc-bab1-4ebb-9bcf-edb32662e310" (UID: "c2bafddc-bab1-4ebb-9bcf-edb32662e310"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:01:11.731708 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.731690 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59nc2\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-kube-api-access-59nc2\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:01:11.731708 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.731708 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2bafddc-bab1-4ebb-9bcf-edb32662e310-ca-trust-extracted\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:01:11.731816 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.731718 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-image-registry-private-configuration\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:01:11.731816 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.731728 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2bafddc-bab1-4ebb-9bcf-edb32662e310-installation-pull-secrets\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:01:11.731816 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.731736 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-certificates\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:01:11.731816 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.731745 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-bound-sa-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:01:11.731816 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.731752 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2bafddc-bab1-4ebb-9bcf-edb32662e310-registry-tls\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:01:11.731816 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:11.731760 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2bafddc-bab1-4ebb-9bcf-edb32662e310-trusted-ca\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:01:12.413351 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:12.413314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" event={"ID":"c2bafddc-bab1-4ebb-9bcf-edb32662e310","Type":"ContainerDied","Data":"c88fd5d06ffe8ec0e48086074102e10d767f325ffcae464ef9f5ba153b151e83"} Jul 09 19:01:12.413351 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:12.413333 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c5976f478-z4dlj" Jul 09 19:01:12.413908 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:12.413393 2576 scope.go:117] "RemoveContainer" containerID="c1da431221fe5b4529bd36e3d5977813187b2d23fdb94fd945b74e93034d22fe" Jul 09 19:01:12.435781 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:12.435755 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c5976f478-z4dlj"] Jul 09 19:01:12.441381 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:12.441360 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c5976f478-z4dlj"] Jul 09 19:01:12.728444 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:12.728417 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2bafddc-bab1-4ebb-9bcf-edb32662e310" path="/var/lib/kubelet/pods/c2bafddc-bab1-4ebb-9bcf-edb32662e310/volumes" Jul 09 19:01:37.498754 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:37.498722 2576 generic.go:356] "Generic (PLEG): container finished" podID="4834de22-67ed-4151-abd1-01db4df72cbf" containerID="950e2eacc926361ca692d7c178ddbdd60d6b300aa4fcc86fe4d2854d3012a63d" exitCode=0 Jul 09 19:01:37.499130 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:37.498792 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" event={"ID":"4834de22-67ed-4151-abd1-01db4df72cbf","Type":"ContainerDied","Data":"950e2eacc926361ca692d7c178ddbdd60d6b300aa4fcc86fe4d2854d3012a63d"} Jul 09 19:01:37.499130 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:37.499078 2576 scope.go:117] "RemoveContainer" containerID="950e2eacc926361ca692d7c178ddbdd60d6b300aa4fcc86fe4d2854d3012a63d" Jul 09 19:01:38.504152 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:01:38.504112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xdwrm" event={"ID":"4834de22-67ed-4151-abd1-01db4df72cbf","Type":"ContainerStarted","Data":"7488afece99a417a32a1f6cf4041d351d80c673d1d9f1a65454c6f0a304e5b69"} Jul 09 19:04:14.318423 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.318389 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv"] Jul 09 19:04:14.318877 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.318669 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2bafddc-bab1-4ebb-9bcf-edb32662e310" containerName="registry" Jul 09 19:04:14.318877 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.318680 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2bafddc-bab1-4ebb-9bcf-edb32662e310" containerName="registry" Jul 09 19:04:14.318877 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.318728 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2bafddc-bab1-4ebb-9bcf-edb32662e310" containerName="registry" Jul 09 19:04:14.321641 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.321621 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.336881 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.336857 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 19:04:14.337119 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.337102 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 19:04:14.337385 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.337328 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 19:04:14.337385 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.337333 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-67swh\"" Jul 09 19:04:14.337806 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.337791 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 19:04:14.344764 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.344733 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv"] Jul 09 19:04:14.439721 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.439686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tgvw\" (UniqueName: \"kubernetes.io/projected/604e7ad9-1534-4442-8020-31b24525ec41-kube-api-access-7tgvw\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.439895 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.439729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/604e7ad9-1534-4442-8020-31b24525ec41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.439895 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.439755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/604e7ad9-1534-4442-8020-31b24525ec41-webhook-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.439895 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.439774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/604e7ad9-1534-4442-8020-31b24525ec41-manifests\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.439895 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.439836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/604e7ad9-1534-4442-8020-31b24525ec41-tmp\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.540231 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.540191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tgvw\" (UniqueName: \"kubernetes.io/projected/604e7ad9-1534-4442-8020-31b24525ec41-kube-api-access-7tgvw\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.540399 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.540247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/604e7ad9-1534-4442-8020-31b24525ec41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.540399 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.540275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/604e7ad9-1534-4442-8020-31b24525ec41-webhook-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.540399 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.540295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/604e7ad9-1534-4442-8020-31b24525ec41-manifests\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.540399 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.540324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/604e7ad9-1534-4442-8020-31b24525ec41-tmp\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.540774 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.540750 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/604e7ad9-1534-4442-8020-31b24525ec41-manifests\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.542679 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.542651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/604e7ad9-1534-4442-8020-31b24525ec41-tmp\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.542875 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.542850 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/604e7ad9-1534-4442-8020-31b24525ec41-webhook-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.542930 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.542870 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/604e7ad9-1534-4442-8020-31b24525ec41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.552484 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.552463 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tgvw\" (UniqueName: \"kubernetes.io/projected/604e7ad9-1534-4442-8020-31b24525ec41-kube-api-access-7tgvw\") pod \"opendatahub-operator-controller-manager-779db88bb-g84xv\" (UID: \"604e7ad9-1534-4442-8020-31b24525ec41\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.630952 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.630879 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:14.761906 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.761877 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d"] Jul 09 19:04:14.765490 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.765467 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.766710 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.766588 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv"] Jul 09 19:04:14.768846 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.768827 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 19:04:14.769013 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:04:14.768991 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604e7ad9_1534_4442_8020_31b24525ec41.slice/crio-d7191feb4ef6408ea4b74508936588eaaca368923a3776fe638a059f7be0a96c WatchSource:0}: Error finding container d7191feb4ef6408ea4b74508936588eaaca368923a3776fe638a059f7be0a96c: Status 404 returned error can't find the container with id d7191feb4ef6408ea4b74508936588eaaca368923a3776fe638a059f7be0a96c Jul 09 19:04:14.769246 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.769225 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 19:04:14.769368 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.769285 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-74stm\"" Jul 09 19:04:14.769432 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.769381 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 19:04:14.769777 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.769760 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 19:04:14.770023 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.770006 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 19:04:14.785517 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.785472 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d"] Jul 09 19:04:14.843576 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.843551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcd6t\" (UniqueName: \"kubernetes.io/projected/d5abd29a-12cd-44de-9f02-f12040efb394-kube-api-access-bcd6t\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.843690 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.843581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5abd29a-12cd-44de-9f02-f12040efb394-metrics-cert\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.843690 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.843601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5abd29a-12cd-44de-9f02-f12040efb394-cert\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.843690 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.843630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d5abd29a-12cd-44de-9f02-f12040efb394-manager-config\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.943929 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.943901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcd6t\" (UniqueName: \"kubernetes.io/projected/d5abd29a-12cd-44de-9f02-f12040efb394-kube-api-access-bcd6t\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.944061 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.943938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5abd29a-12cd-44de-9f02-f12040efb394-metrics-cert\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.944061 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.943969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5abd29a-12cd-44de-9f02-f12040efb394-cert\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.944061 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.944006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d5abd29a-12cd-44de-9f02-f12040efb394-manager-config\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.944666 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.944646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d5abd29a-12cd-44de-9f02-f12040efb394-manager-config\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.946330 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.946311 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5abd29a-12cd-44de-9f02-f12040efb394-cert\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.946416 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.946359 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5abd29a-12cd-44de-9f02-f12040efb394-metrics-cert\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:14.960733 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:14.960713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcd6t\" (UniqueName: \"kubernetes.io/projected/d5abd29a-12cd-44de-9f02-f12040efb394-kube-api-access-bcd6t\") pod \"lws-controller-manager-8ff7d7b96-g698d\" (UID: \"d5abd29a-12cd-44de-9f02-f12040efb394\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:15.019871 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:15.019840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" event={"ID":"604e7ad9-1534-4442-8020-31b24525ec41","Type":"ContainerStarted","Data":"d7191feb4ef6408ea4b74508936588eaaca368923a3776fe638a059f7be0a96c"} Jul 09 19:04:15.075723 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:15.075699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:15.207315 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:15.207244 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d"] Jul 09 19:04:15.211652 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:04:15.211621 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5abd29a_12cd_44de_9f02_f12040efb394.slice/crio-9189b2c0d61a0b9c3d720919c14dda193e046d11a73163aaa3bdbee961bc542f WatchSource:0}: Error finding container 9189b2c0d61a0b9c3d720919c14dda193e046d11a73163aaa3bdbee961bc542f: Status 404 returned error can't find the container with id 9189b2c0d61a0b9c3d720919c14dda193e046d11a73163aaa3bdbee961bc542f Jul 09 19:04:16.025273 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:16.025203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" event={"ID":"d5abd29a-12cd-44de-9f02-f12040efb394","Type":"ContainerStarted","Data":"9189b2c0d61a0b9c3d720919c14dda193e046d11a73163aaa3bdbee961bc542f"} Jul 09 19:04:17.813488 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:17.813450 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:04:17.815815 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:17.813678 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:04:17.818931 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:17.818914 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:04:17.819290 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:17.819267 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:04:17.822841 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:17.822826 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 19:04:18.035363 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:18.035327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" event={"ID":"604e7ad9-1534-4442-8020-31b24525ec41","Type":"ContainerStarted","Data":"bc73ede27d0740577c9c78236a01de84c40133307b3e76c90de34461b0540aa2"} Jul 09 19:04:20.044340 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:20.044305 2576 generic.go:356] "Generic (PLEG): container finished" podID="604e7ad9-1534-4442-8020-31b24525ec41" containerID="bc73ede27d0740577c9c78236a01de84c40133307b3e76c90de34461b0540aa2" exitCode=0 Jul 09 19:04:20.044760 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:20.044379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" event={"ID":"604e7ad9-1534-4442-8020-31b24525ec41","Type":"ContainerDied","Data":"bc73ede27d0740577c9c78236a01de84c40133307b3e76c90de34461b0540aa2"} Jul 09 19:04:20.045053 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:20.045028 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 19:04:20.045939 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:20.045917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" event={"ID":"d5abd29a-12cd-44de-9f02-f12040efb394","Type":"ContainerStarted","Data":"da322e90862878171b3fbfdbaf96c2927a8534217f8f7717f56f6003fc799256"} Jul 09 19:04:20.046078 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:20.046053 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:20.085016 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:20.084981 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" podStartSLOduration=1.77881754 podStartE2EDuration="6.084968704s" totalImagesPullingTime="4.306151164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:04:20.083905658 +0000 UTC m=+303.867313422" watchObservedRunningTime="2026-07-09 19:04:20.084968704 +0000 UTC m=+303.868376469" Jul 09 19:04:21.050975 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:21.050941 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" event={"ID":"604e7ad9-1534-4442-8020-31b24525ec41","Type":"ContainerStarted","Data":"123060a231f7aa64f949f57934cae7a6df26a9d7fe04f2a7e946b069cd1e3e32"} Jul 09 19:04:21.051426 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:21.051221 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:21.077514 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:21.077453 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" podStartSLOduration=2.402425806 podStartE2EDuration="7.077438784s" totalImagesPullingTime="3.4333106s" totalInitContainerRuntime="1.241702378s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:04:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:04:21.075823126 +0000 UTC m=+304.859230891" watchObservedRunningTime="2026-07-09 19:04:21.077438784 +0000 UTC m=+304.860846543" Jul 09 19:04:31.053703 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:31.053675 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-g698d" Jul 09 19:04:32.056296 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:32.056269 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-g84xv" Jul 09 19:04:48.302430 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.302396 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr"] Jul 09 19:04:48.305720 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.305699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.312326 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.312306 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-l295l\"" Jul 09 19:04:48.312458 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.312423 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 19:04:48.312458 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.312440 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 19:04:48.313281 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.313267 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 19:04:48.351493 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.351463 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr"] Jul 09 19:04:48.391158 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.391124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.391292 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.391165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.391292 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.391197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.391409 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.391336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.391409 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.391395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fskts\" (UniqueName: \"kubernetes.io/projected/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-kube-api-access-fskts\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.391484 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.391448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.391555 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.391488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.391555 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.391537 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.391633 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.391567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.492351 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.492315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.492542 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.492361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.492542 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.492390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.492542 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.492424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.492727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.492581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.492727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.492647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fskts\" (UniqueName: \"kubernetes.io/projected/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-kube-api-access-fskts\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.492727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.492690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.492882 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.492727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.492882 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.492757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.492982 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.492897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.493035 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.493000 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.493091 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.493079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.493149 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.493130 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.493306 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.493280 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.494677 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.494660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.495268 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.495250 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.504931 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.504912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.510298 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.510266 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fskts\" (UniqueName: \"kubernetes.io/projected/3f94e877-a5bd-4a5c-bd39-892fb88b2cb1-kube-api-access-fskts\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4th8cr\" (UID: \"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.615488 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.615403 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:48.747197 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.747174 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr"] Jul 09 19:04:48.748969 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:04:48.748944 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f94e877_a5bd_4a5c_bd39_892fb88b2cb1.slice/crio-4a895c4c4a5154ca57e3c55ea130c76e99b7b36f1960c05a33d93c66b06b83c3 WatchSource:0}: Error finding container 4a895c4c4a5154ca57e3c55ea130c76e99b7b36f1960c05a33d93c66b06b83c3: Status 404 returned error can't find the container with id 4a895c4c4a5154ca57e3c55ea130c76e99b7b36f1960c05a33d93c66b06b83c3 Jul 09 19:04:48.908796 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.908715 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd"] Jul 09 19:04:48.912868 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.912852 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:48.916662 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.916641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 19:04:48.916767 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.916735 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zddjl\"" Jul 09 19:04:48.917082 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.917066 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 19:04:48.917460 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.917446 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 19:04:48.933242 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.933212 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd"] Jul 09 19:04:48.997747 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.997716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/20b54ef1-0b20-4956-9821-fba26ddab0c9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:48.997897 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.997758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvbql\" (UniqueName: \"kubernetes.io/projected/20b54ef1-0b20-4956-9821-fba26ddab0c9-kube-api-access-xvbql\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:48.997897 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.997782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:48.997897 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.997810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:48.997897 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.997844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/20b54ef1-0b20-4956-9821-fba26ddab0c9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:48.997897 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.997864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:48.998116 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:48.997925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.099103 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.099067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/20b54ef1-0b20-4956-9821-fba26ddab0c9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.099291 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.099120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvbql\" (UniqueName: \"kubernetes.io/projected/20b54ef1-0b20-4956-9821-fba26ddab0c9-kube-api-access-xvbql\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.099291 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.099155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.099291 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.099183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.099291 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.099223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/20b54ef1-0b20-4956-9821-fba26ddab0c9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.099291 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.099250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.099291 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.099277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.100059 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.100010 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.101714 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.101688 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.101714 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.101704 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/20b54ef1-0b20-4956-9821-fba26ddab0c9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.101859 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.101713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/20b54ef1-0b20-4956-9821-fba26ddab0c9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.102072 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.102053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.114417 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.114393 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvbql\" (UniqueName: \"kubernetes.io/projected/20b54ef1-0b20-4956-9821-fba26ddab0c9-kube-api-access-xvbql\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.123084 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.123068 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20b54ef1-0b20-4956-9821-fba26ddab0c9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jglcd\" (UID: \"20b54ef1-0b20-4956-9821-fba26ddab0c9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.147890 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.147865 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" event={"ID":"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1","Type":"ContainerStarted","Data":"4a895c4c4a5154ca57e3c55ea130c76e99b7b36f1960c05a33d93c66b06b83c3"} Jul 09 19:04:49.221507 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.221479 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:49.348430 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:49.348285 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd"] Jul 09 19:04:49.350898 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:04:49.350859 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b54ef1_0b20_4956_9821_fba26ddab0c9.slice/crio-2ccae6700bd40754ed42f7425e92a04fec1c65f8f04a5070f19f37d506e17b4e WatchSource:0}: Error finding container 2ccae6700bd40754ed42f7425e92a04fec1c65f8f04a5070f19f37d506e17b4e: Status 404 returned error can't find the container with id 2ccae6700bd40754ed42f7425e92a04fec1c65f8f04a5070f19f37d506e17b4e Jul 09 19:04:50.154313 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:50.154276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" event={"ID":"20b54ef1-0b20-4956-9821-fba26ddab0c9","Type":"ContainerStarted","Data":"2ccae6700bd40754ed42f7425e92a04fec1c65f8f04a5070f19f37d506e17b4e"} Jul 09 19:04:52.721391 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:52.721346 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:04:52.721701 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:52.721418 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:04:52.724343 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:52.724315 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:04:52.724439 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:52.724373 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:04:52.724439 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:52.724406 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:04:53.172838 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:53.172742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" event={"ID":"3f94e877-a5bd-4a5c-bd39-892fb88b2cb1","Type":"ContainerStarted","Data":"13e5414e3f8779585f43fa3c0b6d25cfa6aa1ec9b07be5bbda43849aa4da3639"} Jul 09 19:04:53.174621 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:53.174596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" event={"ID":"20b54ef1-0b20-4956-9821-fba26ddab0c9","Type":"ContainerStarted","Data":"1b2f6404ab1550c3ce781c4f3ed0d70b98b34a6dd1d8d4b24363bfdcca0b00a0"} Jul 09 19:04:53.174796 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:53.174756 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:53.176543 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:53.176516 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-jglcd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 19:04:53.176661 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:53.176573 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" podUID="20b54ef1-0b20-4956-9821-fba26ddab0c9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 19:04:53.242523 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:53.242458 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" podStartSLOduration=1.2690922470000001 podStartE2EDuration="5.242439378s" totalImagesPullingTime="3.973347131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:04:53.239235221 +0000 UTC m=+337.022643015" watchObservedRunningTime="2026-07-09 19:04:53.242439378 +0000 UTC m=+337.025847143" Jul 09 19:04:53.278932 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:53.278871 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" podStartSLOduration=1.9106431750000001 podStartE2EDuration="5.278847321s" totalImagesPullingTime="3.368204146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:04:53.276226575 +0000 UTC m=+337.059634342" watchObservedRunningTime="2026-07-09 19:04:53.278847321 +0000 UTC m=+337.062255088" Jul 09 19:04:53.615992 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:53.615963 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:53.620444 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:53.620419 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:54.181476 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:54.181439 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:04:54.182088 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:54.182072 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jglcd" Jul 09 19:04:54.182376 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:04:54.182362 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4th8cr" Jul 09 19:07:18.086147 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.086112 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m"] Jul 09 19:07:18.093697 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.093675 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.096794 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.096771 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lcb2r\"" Jul 09 19:07:18.102655 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.102631 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m"] Jul 09 19:07:18.179619 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.179587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.179746 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.179636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.179746 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.179689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.179834 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.179787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.179834 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.179812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.179834 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.179828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95std\" (UniqueName: \"kubernetes.io/projected/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-kube-api-access-95std\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.179945 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.179856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.179945 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.179892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.179945 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.179922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.280439 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.280598 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.280598 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.280598 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.280598 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.280598 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95std\" (UniqueName: \"kubernetes.io/projected/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-kube-api-access-95std\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.280882 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.281008 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280892 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.281008 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.281008 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.281008 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.280986 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.281223 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.281079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.281282 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.281244 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.281282 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.281251 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.283015 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.282996 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.283343 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.283312 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.289102 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.289082 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.289191 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.289137 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95std\" (UniqueName: \"kubernetes.io/projected/c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da-kube-api-access-95std\") pod \"maas-default-gateway-openshift-default-56654dcf7-8wl8m\" (UID: \"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.407482 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.407425 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:18.539186 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.539154 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m"] Jul 09 19:07:18.541835 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:07:18.541809 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40c5c9c_aed6_40b3_9b3e_2cc3d25d71da.slice/crio-098f76e2ec0ee96b0ce6a1157bb1a032b32589511a38f94d5ef9b3378a36010b WatchSource:0}: Error finding container 098f76e2ec0ee96b0ce6a1157bb1a032b32589511a38f94d5ef9b3378a36010b: Status 404 returned error can't find the container with id 098f76e2ec0ee96b0ce6a1157bb1a032b32589511a38f94d5ef9b3378a36010b Jul 09 19:07:18.544018 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.543978 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:07:18.544104 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.544048 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:07:18.544104 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.544081 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:07:18.731084 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.731047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" event={"ID":"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da","Type":"ContainerStarted","Data":"3cb6279371c40d56234c51deee88ca380073a81d481ff86595f62037739826ee"} Jul 09 19:07:18.731272 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.731108 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" event={"ID":"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da","Type":"ContainerStarted","Data":"098f76e2ec0ee96b0ce6a1157bb1a032b32589511a38f94d5ef9b3378a36010b"} Jul 09 19:07:18.752563 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:18.752493 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" podStartSLOduration=0.752473989 podStartE2EDuration="752.473989ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:18.752328523 +0000 UTC m=+482.535736289" watchObservedRunningTime="2026-07-09 19:07:18.752473989 +0000 UTC m=+482.535881755" Jul 09 19:07:19.408163 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:19.408140 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:19.412708 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:19.412684 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:19.735414 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:19.735383 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:07:19.736340 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:07:19.736319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:08:47.072473 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:47.072442 2576 generic.go:356] "Generic (PLEG): container finished" podID="c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da" containerID="3cb6279371c40d56234c51deee88ca380073a81d481ff86595f62037739826ee" exitCode=0 Jul 09 19:08:47.072891 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:47.072528 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" event={"ID":"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da","Type":"ContainerDied","Data":"3cb6279371c40d56234c51deee88ca380073a81d481ff86595f62037739826ee"} Jul 09 19:08:47.072891 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:47.072872 2576 scope.go:117] "RemoveContainer" containerID="3cb6279371c40d56234c51deee88ca380073a81d481ff86595f62037739826ee" Jul 09 19:08:47.073711 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:47.073686 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:08:47.073762 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:47.073745 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:08:47.073796 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:47.073774 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:08:48.081309 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:48.081262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" event={"ID":"c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da","Type":"ContainerStarted","Data":"c8f0f749be38d5674029f5d9f3a9d5c4f62bd45a0bd53159fdb7eab0b6f78086"} Jul 09 19:08:48.408127 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:48.408042 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:08:48.409136 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:48.409111 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8wl8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" start-of-body= Jul 09 19:08:48.409186 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:48.409160 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" podUID="c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" Jul 09 19:08:49.408123 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:49.408085 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8wl8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" start-of-body= Jul 09 19:08:49.408540 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:49.408140 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" podUID="c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" Jul 09 19:08:49.735658 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:49.735624 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:08:50.408160 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:50.408121 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8wl8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" start-of-body= Jul 09 19:08:50.408534 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:50.408182 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" podUID="c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" Jul 09 19:08:51.408747 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:51.408709 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8wl8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" start-of-body= Jul 09 19:08:51.409106 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:51.408769 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" podUID="c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" Jul 09 19:08:52.411253 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:52.411221 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:08:52.412348 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:52.412329 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8wl8m" Jul 09 19:08:55.149324 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.149297 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql"] Jul 09 19:08:55.152929 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.152910 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.156270 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.156251 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 09 19:08:55.157447 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.157424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tt5pt\"" Jul 09 19:08:55.157525 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.157429 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 19:08:55.157525 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.157474 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 19:08:55.164868 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.164848 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql"] Jul 09 19:08:55.261192 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.261168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.261308 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.261205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.261308 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.261224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc32820-4298-48a5-b229-3e9ce379cc1b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.261421 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.261311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.261421 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.261376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rgww\" (UniqueName: \"kubernetes.io/projected/fdc32820-4298-48a5-b229-3e9ce379cc1b-kube-api-access-4rgww\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.261421 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.261407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.362117 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.362089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rgww\" (UniqueName: \"kubernetes.io/projected/fdc32820-4298-48a5-b229-3e9ce379cc1b-kube-api-access-4rgww\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.362245 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.362120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.362245 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.362149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.362245 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.362185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.362245 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.362204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc32820-4298-48a5-b229-3e9ce379cc1b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.362245 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.362229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.362630 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.362604 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.362729 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.362630 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.362783 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.362736 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.364457 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.364433 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc32820-4298-48a5-b229-3e9ce379cc1b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.364714 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.364700 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc32820-4298-48a5-b229-3e9ce379cc1b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.370535 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.370476 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rgww\" (UniqueName: \"kubernetes.io/projected/fdc32820-4298-48a5-b229-3e9ce379cc1b-kube-api-access-4rgww\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql\" (UID: \"fdc32820-4298-48a5-b229-3e9ce379cc1b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.463008 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.462976 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:08:55.587074 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:55.587052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql"] Jul 09 19:08:55.589173 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:08:55.589144 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc32820_4298_48a5_b229_3e9ce379cc1b.slice/crio-1065eb3bcfa170b32412a4e1b199f06c76e50be0c08b63b188247813efaee38d WatchSource:0}: Error finding container 1065eb3bcfa170b32412a4e1b199f06c76e50be0c08b63b188247813efaee38d: Status 404 returned error can't find the container with id 1065eb3bcfa170b32412a4e1b199f06c76e50be0c08b63b188247813efaee38d Jul 09 19:08:56.115185 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:56.115144 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" event={"ID":"fdc32820-4298-48a5-b229-3e9ce379cc1b","Type":"ContainerStarted","Data":"1065eb3bcfa170b32412a4e1b199f06c76e50be0c08b63b188247813efaee38d"} Jul 09 19:08:57.120946 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:57.120865 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" event={"ID":"fdc32820-4298-48a5-b229-3e9ce379cc1b","Type":"ContainerStarted","Data":"78285915c55990ee2e335ece88fa9a6bd1fefca29c0305a73ff315d75b6e8597"} Jul 09 19:08:57.143151 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:08:57.143109 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" podStartSLOduration=0.942589978 podStartE2EDuration="2.143094316s" totalImagesPullingTime="1.200504338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:08:57.142354246 +0000 UTC m=+580.925762011" watchObservedRunningTime="2026-07-09 19:08:57.143094316 +0000 UTC m=+580.926502106" Jul 09 19:09:05.463265 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:05.463231 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:09:05.463669 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:05.463308 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:09:05.475743 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:05.475724 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:09:06.167016 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:06.166980 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql" Jul 09 19:09:17.837006 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:17.836980 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:09:17.837798 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:17.837780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:09:17.842329 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:17.842310 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:09:17.843255 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:17.843236 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:09:20.052907 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.052878 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57"] Jul 09 19:09:20.056074 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.056054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.059196 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.059176 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 19:09:20.067159 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.067139 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57"] Jul 09 19:09:20.148605 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.148578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.148710 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.148623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.148710 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.148693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.148829 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.148716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d55111a4-656b-455f-bf08-3296abb9bc7c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.148829 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.148759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.148829 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.148793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6qcx\" (UniqueName: \"kubernetes.io/projected/d55111a4-656b-455f-bf08-3296abb9bc7c-kube-api-access-s6qcx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.249884 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.249853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.250061 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.249894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.250061 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.250011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.250186 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.250106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d55111a4-656b-455f-bf08-3296abb9bc7c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.250186 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.250159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.250292 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.250201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qcx\" (UniqueName: \"kubernetes.io/projected/d55111a4-656b-455f-bf08-3296abb9bc7c-kube-api-access-s6qcx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.250348 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.250305 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.250397 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.250378 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.250484 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.250463 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.252176 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.252156 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d55111a4-656b-455f-bf08-3296abb9bc7c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.252407 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.252390 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d55111a4-656b-455f-bf08-3296abb9bc7c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.258917 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.258898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qcx\" (UniqueName: \"kubernetes.io/projected/d55111a4-656b-455f-bf08-3296abb9bc7c-kube-api-access-s6qcx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t9q57\" (UID: \"d55111a4-656b-455f-bf08-3296abb9bc7c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.367030 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.366972 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:20.494231 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.494207 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57"] Jul 09 19:09:20.495714 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:09:20.495687 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55111a4_656b_455f_bf08_3296abb9bc7c.slice/crio-9ddefb5fefb18100de3375e42a70f0c73f0505b28e859e3aa0d93c0047cf0768 WatchSource:0}: Error finding container 9ddefb5fefb18100de3375e42a70f0c73f0505b28e859e3aa0d93c0047cf0768: Status 404 returned error can't find the container with id 9ddefb5fefb18100de3375e42a70f0c73f0505b28e859e3aa0d93c0047cf0768 Jul 09 19:09:20.497111 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:20.497093 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 19:09:21.219697 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:21.219657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" event={"ID":"d55111a4-656b-455f-bf08-3296abb9bc7c","Type":"ContainerStarted","Data":"69decdc2b4a761f2660cbb8254095d88340e17bc10c2835a0ad2cee8fcc7f801"} Jul 09 19:09:21.220085 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:21.219731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" event={"ID":"d55111a4-656b-455f-bf08-3296abb9bc7c","Type":"ContainerStarted","Data":"9ddefb5fefb18100de3375e42a70f0c73f0505b28e859e3aa0d93c0047cf0768"} Jul 09 19:09:21.238387 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:21.238344 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" podStartSLOduration=1.021933884 podStartE2EDuration="1.238328352s" totalImagesPullingTime="216.394468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:09:21.23683339 +0000 UTC m=+605.020241167" watchObservedRunningTime="2026-07-09 19:09:21.238328352 +0000 UTC m=+605.021736117" Jul 09 19:09:30.367073 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:30.367040 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:30.367578 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:30.367106 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:30.379246 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:30.379224 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:09:31.270014 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:09:31.269984 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t9q57" Jul 09 19:14:17.859788 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:14:17.859761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:14:17.862027 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:14:17.862005 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:14:17.865463 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:14:17.865442 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:14:17.867436 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:14:17.867419 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:19:17.883259 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:19:17.883231 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:19:17.888810 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:19:17.888789 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:19:17.891221 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:19:17.891199 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:19:17.896298 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:19:17.896281 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:24:17.907336 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:17.907219 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:24:17.912329 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:17.912307 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:24:17.914443 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:17.914426 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:24:17.919471 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:17.919456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:24:42.912647 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:42.912568 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9"] Jul 09 19:24:42.916200 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:42.916182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:42.919082 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:42.919063 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6645f2ee-openshift-default-dockercfg-hlhlg\"" Jul 09 19:24:42.933414 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:42.933395 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9"] Jul 09 19:24:43.050915 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.050887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-certs\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.051062 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.050936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-socket\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.051062 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.051000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-envoy\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.051062 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.051043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n54r\" (UniqueName: \"kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-kube-api-access-5n54r\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.051171 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.051064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-podinfo\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.051171 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.051127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-data\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.051171 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.051146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-credential-socket\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.051260 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.051170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/974fd761-33fe-436e-ac10-e9b84ef0daa9-istiod-ca-cert\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.051260 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.051202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-token\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.151771 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.151743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-socket\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.151880 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.151778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-envoy\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.151880 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.151804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n54r\" (UniqueName: \"kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-kube-api-access-5n54r\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.151880 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.151831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-podinfo\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.151996 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.151961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-data\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.152046 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.152003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-credential-socket\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.152046 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.152035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/974fd761-33fe-436e-ac10-e9b84ef0daa9-istiod-ca-cert\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.152142 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.152083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-token\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.152142 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.152116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-certs\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.152246 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.152232 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-socket\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.152355 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.152336 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-data\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.152449 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.152425 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-credential-socket\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.152520 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.152477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-certs\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.152850 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.152828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/974fd761-33fe-436e-ac10-e9b84ef0daa9-istiod-ca-cert\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.154091 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.154074 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-envoy\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.154227 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.154211 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-podinfo\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.160686 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.160663 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-token\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.160784 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.160729 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n54r\" (UniqueName: \"kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-kube-api-access-5n54r\") pod \"e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.226693 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.226672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:43.356026 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.355835 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9"] Jul 09 19:24:43.360073 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.360038 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:24:43.360162 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.360099 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:24:43.360162 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.360137 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:24:43.878909 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.878876 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" event={"ID":"974fd761-33fe-436e-ac10-e9b84ef0daa9","Type":"ContainerStarted","Data":"0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2"} Jul 09 19:24:43.879067 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.878924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" event={"ID":"974fd761-33fe-436e-ac10-e9b84ef0daa9","Type":"ContainerStarted","Data":"b533b355c7fbf52bc4448a6af3c5b50bb35ef8ac7a75d3197987c6ff710a82c7"} Jul 09 19:24:43.902230 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:43.902181 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" podStartSLOduration=1.902167358 podStartE2EDuration="1.902167358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:24:43.899469538 +0000 UTC m=+1527.682877316" watchObservedRunningTime="2026-07-09 19:24:43.902167358 +0000 UTC m=+1527.685575124" Jul 09 19:24:44.227841 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:44.227814 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:44.232664 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:44.232643 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:44.883363 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:44.883337 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:44.884204 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:44.884186 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:49.386933 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:49.386896 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9"] Jul 09 19:24:49.387380 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:49.387112 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" podUID="974fd761-33fe-436e-ac10-e9b84ef0daa9" containerName="istio-proxy" containerID="cri-o://0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2" gracePeriod=30 Jul 09 19:24:55.504582 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.504551 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h"] Jul 09 19:24:55.508484 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.508462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.511438 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.511414 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-525b3638-openshift-default-dockercfg-vflx8\"" Jul 09 19:24:55.525666 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.525641 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h"] Jul 09 19:24:55.659038 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.659003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhmnq\" (UniqueName: \"kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-kube-api-access-fhmnq\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.659196 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.659045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-data\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.659196 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.659081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-istio-token\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.659196 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.659167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4b52a0b-be9e-47fe-888b-f19945152390-istio-podinfo\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.659303 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.659202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-envoy\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.659303 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.659234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-certs\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.659303 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.659249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4b52a0b-be9e-47fe-888b-f19945152390-istiod-ca-cert\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.659303 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.659280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-socket\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.659303 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.659294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-credential-socket\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.759844 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.759763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-envoy\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.759844 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.759813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-certs\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.759844 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.759836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4b52a0b-be9e-47fe-888b-f19945152390-istiod-ca-cert\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760099 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.759873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-socket\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760099 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.759893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-credential-socket\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760099 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.759951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhmnq\" (UniqueName: \"kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-kube-api-access-fhmnq\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760099 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.759980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-data\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760099 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.760021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-istio-token\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760099 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.760067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4b52a0b-be9e-47fe-888b-f19945152390-istio-podinfo\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760379 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.760221 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-certs\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760379 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.760313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-data\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760379 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.760353 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-credential-socket\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760618 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.760602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-socket\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.760822 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.760797 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4b52a0b-be9e-47fe-888b-f19945152390-istiod-ca-cert\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.762368 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.762346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-envoy\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.762736 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.762710 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4b52a0b-be9e-47fe-888b-f19945152390-istio-podinfo\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.775490 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.775460 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-istio-token\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.775678 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.775662 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhmnq\" (UniqueName: \"kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-kube-api-access-fhmnq\") pod \"e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.820553 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.820527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:55.959381 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.959348 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h"] Jul 09 19:24:55.962385 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:24:55.962354 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b52a0b_be9e_47fe_888b_f19945152390.slice/crio-9cab60d2e076b52ea9ada3f7af3d8836c9c658f2aa38996e391de5ef0565ae61 WatchSource:0}: Error finding container 9cab60d2e076b52ea9ada3f7af3d8836c9c658f2aa38996e391de5ef0565ae61: Status 404 returned error can't find the container with id 9cab60d2e076b52ea9ada3f7af3d8836c9c658f2aa38996e391de5ef0565ae61 Jul 09 19:24:55.964292 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.964259 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:24:55.964379 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.964334 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:24:55.964442 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:55.964381 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:24:56.422435 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.422412 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:56.568982 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.568913 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-certs\") pod \"974fd761-33fe-436e-ac10-e9b84ef0daa9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " Jul 09 19:24:56.568982 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.568955 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-podinfo\") pod \"974fd761-33fe-436e-ac10-e9b84ef0daa9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " Jul 09 19:24:56.568982 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.568975 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-credential-socket\") pod \"974fd761-33fe-436e-ac10-e9b84ef0daa9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.568993 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/974fd761-33fe-436e-ac10-e9b84ef0daa9-istiod-ca-cert\") pod \"974fd761-33fe-436e-ac10-e9b84ef0daa9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569020 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-socket\") pod \"974fd761-33fe-436e-ac10-e9b84ef0daa9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569036 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-token\") pod \"974fd761-33fe-436e-ac10-e9b84ef0daa9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569078 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-envoy\") pod \"974fd761-33fe-436e-ac10-e9b84ef0daa9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569094 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n54r\" (UniqueName: \"kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-kube-api-access-5n54r\") pod \"974fd761-33fe-436e-ac10-e9b84ef0daa9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569131 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-data\") pod \"974fd761-33fe-436e-ac10-e9b84ef0daa9\" (UID: \"974fd761-33fe-436e-ac10-e9b84ef0daa9\") " Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569240 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "974fd761-33fe-436e-ac10-e9b84ef0daa9" (UID: "974fd761-33fe-436e-ac10-e9b84ef0daa9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569259 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "974fd761-33fe-436e-ac10-e9b84ef0daa9" (UID: "974fd761-33fe-436e-ac10-e9b84ef0daa9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569298 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "974fd761-33fe-436e-ac10-e9b84ef0daa9" (UID: "974fd761-33fe-436e-ac10-e9b84ef0daa9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569344 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/974fd761-33fe-436e-ac10-e9b84ef0daa9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "974fd761-33fe-436e-ac10-e9b84ef0daa9" (UID: "974fd761-33fe-436e-ac10-e9b84ef0daa9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569425 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569443 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569456 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/974fd761-33fe-436e-ac10-e9b84ef0daa9-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:24:56.569548 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.569470 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:24:56.570323 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.570295 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-data" (OuterVolumeSpecName: "istio-data") pod "974fd761-33fe-436e-ac10-e9b84ef0daa9" (UID: "974fd761-33fe-436e-ac10-e9b84ef0daa9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:24:56.571384 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.571357 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "974fd761-33fe-436e-ac10-e9b84ef0daa9" (UID: "974fd761-33fe-436e-ac10-e9b84ef0daa9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:24:56.571384 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.571371 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-kube-api-access-5n54r" (OuterVolumeSpecName: "kube-api-access-5n54r") pod "974fd761-33fe-436e-ac10-e9b84ef0daa9" (UID: "974fd761-33fe-436e-ac10-e9b84ef0daa9"). InnerVolumeSpecName "kube-api-access-5n54r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:24:56.571574 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.571403 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-token" (OuterVolumeSpecName: "istio-token") pod "974fd761-33fe-436e-ac10-e9b84ef0daa9" (UID: "974fd761-33fe-436e-ac10-e9b84ef0daa9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:24:56.571574 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.571531 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "974fd761-33fe-436e-ac10-e9b84ef0daa9" (UID: "974fd761-33fe-436e-ac10-e9b84ef0daa9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:24:56.670410 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.670388 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:24:56.670410 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.670409 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n54r\" (UniqueName: \"kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-kube-api-access-5n54r\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:24:56.670551 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.670419 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:24:56.670551 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.670427 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:24:56.670551 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.670435 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/974fd761-33fe-436e-ac10-e9b84ef0daa9-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:24:56.941149 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.941116 2576 generic.go:356] "Generic (PLEG): container finished" podID="974fd761-33fe-436e-ac10-e9b84ef0daa9" containerID="0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2" exitCode=0 Jul 09 19:24:56.941338 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.941157 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" Jul 09 19:24:56.941338 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.941196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" event={"ID":"974fd761-33fe-436e-ac10-e9b84ef0daa9","Type":"ContainerDied","Data":"0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2"} Jul 09 19:24:56.941338 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.941244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9" event={"ID":"974fd761-33fe-436e-ac10-e9b84ef0daa9","Type":"ContainerDied","Data":"b533b355c7fbf52bc4448a6af3c5b50bb35ef8ac7a75d3197987c6ff710a82c7"} Jul 09 19:24:56.941338 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.941274 2576 scope.go:117] "RemoveContainer" containerID="0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2" Jul 09 19:24:56.943031 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.943001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" event={"ID":"c4b52a0b-be9e-47fe-888b-f19945152390","Type":"ContainerStarted","Data":"875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50"} Jul 09 19:24:56.943139 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.943058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" event={"ID":"c4b52a0b-be9e-47fe-888b-f19945152390","Type":"ContainerStarted","Data":"9cab60d2e076b52ea9ada3f7af3d8836c9c658f2aa38996e391de5ef0565ae61"} Jul 09 19:24:56.949646 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.949624 2576 scope.go:117] "RemoveContainer" containerID="0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2" Jul 09 19:24:56.949883 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:24:56.949859 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2\": container with ID starting with 0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2 not found: ID does not exist" containerID="0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2" Jul 09 19:24:56.949944 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.949895 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2"} err="failed to get container status \"0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2\": rpc error: code = NotFound desc = could not find container \"0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2\": container with ID starting with 0d4a514983d6d5375d8e45378ba758674e93bdf9e06e46549f6debac92edcbf2 not found: ID does not exist" Jul 09 19:24:56.971920 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.971871 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" podStartSLOduration=1.971853525 podStartE2EDuration="1.971853525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:24:56.971070875 +0000 UTC m=+1540.754478679" watchObservedRunningTime="2026-07-09 19:24:56.971853525 +0000 UTC m=+1540.755261288" Jul 09 19:24:56.997332 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:56.997311 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9"] Jul 09 19:24:57.003376 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:57.003351 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6645f2ee-openshift-default-54f8c6fd4f-g55d9"] Jul 09 19:24:57.821655 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:57.821624 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:57.826363 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:57.826343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:57.948406 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:57.948371 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:57.949101 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:57.949086 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:24:58.734144 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:24:58.734111 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="974fd761-33fe-436e-ac10-e9b84ef0daa9" path="/var/lib/kubelet/pods/974fd761-33fe-436e-ac10-e9b84ef0daa9/volumes" Jul 09 19:25:07.784661 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:07.784626 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h"] Jul 09 19:25:07.785078 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:07.784857 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" podUID="c4b52a0b-be9e-47fe-888b-f19945152390" containerName="istio-proxy" containerID="cri-o://875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50" gracePeriod=30 Jul 09 19:25:07.923922 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:07.923902 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:25:07.992131 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:07.992107 2576 generic.go:356] "Generic (PLEG): container finished" podID="c4b52a0b-be9e-47fe-888b-f19945152390" containerID="875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50" exitCode=0 Jul 09 19:25:07.992262 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:07.992160 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" Jul 09 19:25:07.992262 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:07.992189 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" event={"ID":"c4b52a0b-be9e-47fe-888b-f19945152390","Type":"ContainerDied","Data":"875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50"} Jul 09 19:25:07.992262 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:07.992241 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h" event={"ID":"c4b52a0b-be9e-47fe-888b-f19945152390","Type":"ContainerDied","Data":"9cab60d2e076b52ea9ada3f7af3d8836c9c658f2aa38996e391de5ef0565ae61"} Jul 09 19:25:07.992262 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:07.992263 2576 scope.go:117] "RemoveContainer" containerID="875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50" Jul 09 19:25:08.000268 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.000241 2576 scope.go:117] "RemoveContainer" containerID="875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50" Jul 09 19:25:08.000552 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:25:08.000533 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50\": container with ID starting with 875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50 not found: ID does not exist" containerID="875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50" Jul 09 19:25:08.000626 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.000560 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50"} err="failed to get container status \"875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50\": rpc error: code = NotFound desc = could not find container \"875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50\": container with ID starting with 875e8e9f931616d34744372828b82f2027216ff6959b3754b55ad5ee27111a50 not found: ID does not exist" Jul 09 19:25:08.064342 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064285 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4b52a0b-be9e-47fe-888b-f19945152390-istiod-ca-cert\") pod \"c4b52a0b-be9e-47fe-888b-f19945152390\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " Jul 09 19:25:08.064342 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064313 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-credential-socket\") pod \"c4b52a0b-be9e-47fe-888b-f19945152390\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " Jul 09 19:25:08.064479 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064348 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-envoy\") pod \"c4b52a0b-be9e-47fe-888b-f19945152390\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " Jul 09 19:25:08.064479 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064377 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-certs\") pod \"c4b52a0b-be9e-47fe-888b-f19945152390\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " Jul 09 19:25:08.064479 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064436 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhmnq\" (UniqueName: \"kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-kube-api-access-fhmnq\") pod \"c4b52a0b-be9e-47fe-888b-f19945152390\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " Jul 09 19:25:08.064645 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064480 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4b52a0b-be9e-47fe-888b-f19945152390-istio-podinfo\") pod \"c4b52a0b-be9e-47fe-888b-f19945152390\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " Jul 09 19:25:08.064645 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064570 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-socket\") pod \"c4b52a0b-be9e-47fe-888b-f19945152390\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " Jul 09 19:25:08.064645 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064607 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-data\") pod \"c4b52a0b-be9e-47fe-888b-f19945152390\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " Jul 09 19:25:08.064798 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064646 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-istio-token\") pod \"c4b52a0b-be9e-47fe-888b-f19945152390\" (UID: \"c4b52a0b-be9e-47fe-888b-f19945152390\") " Jul 09 19:25:08.064798 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064651 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c4b52a0b-be9e-47fe-888b-f19945152390" (UID: "c4b52a0b-be9e-47fe-888b-f19945152390"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:25:08.064798 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064685 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b52a0b-be9e-47fe-888b-f19945152390-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c4b52a0b-be9e-47fe-888b-f19945152390" (UID: "c4b52a0b-be9e-47fe-888b-f19945152390"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:25:08.064951 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064807 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c4b52a0b-be9e-47fe-888b-f19945152390" (UID: "c4b52a0b-be9e-47fe-888b-f19945152390"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:25:08.064951 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064827 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c4b52a0b-be9e-47fe-888b-f19945152390" (UID: "c4b52a0b-be9e-47fe-888b-f19945152390"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:25:08.065052 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064969 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4b52a0b-be9e-47fe-888b-f19945152390-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:08.065052 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.064988 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:08.065052 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.065002 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:08.065052 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.065015 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:08.065638 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.065612 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-data" (OuterVolumeSpecName: "istio-data") pod "c4b52a0b-be9e-47fe-888b-f19945152390" (UID: "c4b52a0b-be9e-47fe-888b-f19945152390"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:25:08.066636 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.066617 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c4b52a0b-be9e-47fe-888b-f19945152390" (UID: "c4b52a0b-be9e-47fe-888b-f19945152390"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:25:08.066707 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.066684 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-istio-token" (OuterVolumeSpecName: "istio-token") pod "c4b52a0b-be9e-47fe-888b-f19945152390" (UID: "c4b52a0b-be9e-47fe-888b-f19945152390"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:25:08.066832 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.066804 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-kube-api-access-fhmnq" (OuterVolumeSpecName: "kube-api-access-fhmnq") pod "c4b52a0b-be9e-47fe-888b-f19945152390" (UID: "c4b52a0b-be9e-47fe-888b-f19945152390"). InnerVolumeSpecName "kube-api-access-fhmnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:25:08.067179 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.067152 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c4b52a0b-be9e-47fe-888b-f19945152390-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c4b52a0b-be9e-47fe-888b-f19945152390" (UID: "c4b52a0b-be9e-47fe-888b-f19945152390"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:25:08.165838 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.165814 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4b52a0b-be9e-47fe-888b-f19945152390-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:08.165838 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.165836 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:08.165980 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.165845 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:08.165980 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.165854 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4b52a0b-be9e-47fe-888b-f19945152390-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:08.165980 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.165863 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhmnq\" (UniqueName: \"kubernetes.io/projected/c4b52a0b-be9e-47fe-888b-f19945152390-kube-api-access-fhmnq\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:08.315925 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.315874 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h"] Jul 09 19:25:08.319529 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.319492 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-525b3638-openshift-default-7fddb59547-dnh8h"] Jul 09 19:25:08.728933 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:08.728904 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4b52a0b-be9e-47fe-888b-f19945152390" path="/var/lib/kubelet/pods/c4b52a0b-be9e-47fe-888b-f19945152390/volumes" Jul 09 19:25:14.077385 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.077356 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr"] Jul 09 19:25:14.077869 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.077674 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b52a0b-be9e-47fe-888b-f19945152390" containerName="istio-proxy" Jul 09 19:25:14.077869 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.077686 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b52a0b-be9e-47fe-888b-f19945152390" containerName="istio-proxy" Jul 09 19:25:14.077869 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.077696 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="974fd761-33fe-436e-ac10-e9b84ef0daa9" containerName="istio-proxy" Jul 09 19:25:14.077869 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.077703 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="974fd761-33fe-436e-ac10-e9b84ef0daa9" containerName="istio-proxy" Jul 09 19:25:14.077869 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.077756 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b52a0b-be9e-47fe-888b-f19945152390" containerName="istio-proxy" Jul 09 19:25:14.077869 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.077766 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="974fd761-33fe-436e-ac10-e9b84ef0daa9" containerName="istio-proxy" Jul 09 19:25:14.082015 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.081991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.084894 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.084877 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f5ef04a0-openshift-default-dockercfg-rnktj\"" Jul 09 19:25:14.092778 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.092760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr"] Jul 09 19:25:14.212477 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.212443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-socket\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.212477 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.212475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-istio-token\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.212737 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.212519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-data\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.212737 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.212633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-credential-socket\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.212737 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.212689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431dcc7e-0fd0-49af-b990-a31093446278-istiod-ca-cert\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.212737 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.212728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjqv2\" (UniqueName: \"kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-kube-api-access-zjqv2\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.212935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.212757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431dcc7e-0fd0-49af-b990-a31093446278-istio-podinfo\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.212935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.212839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-envoy\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.212935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.212872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-certs\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.313905 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.313878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjqv2\" (UniqueName: \"kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-kube-api-access-zjqv2\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.313905 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.313907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431dcc7e-0fd0-49af-b990-a31093446278-istio-podinfo\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314121 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-envoy\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314166 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-certs\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314202 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-socket\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314246 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-istio-token\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314296 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-data\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314347 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-credential-socket\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314484 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431dcc7e-0fd0-49af-b990-a31093446278-istiod-ca-cert\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314606 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314585 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-socket\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314757 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314728 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-data\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314757 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314748 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-certs\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.314935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.314799 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-credential-socket\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.315118 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.315099 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431dcc7e-0fd0-49af-b990-a31093446278-istiod-ca-cert\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.316280 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.316261 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-envoy\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.316371 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.316355 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431dcc7e-0fd0-49af-b990-a31093446278-istio-podinfo\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.322599 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.322576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-istio-token\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.322867 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.322847 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjqv2\" (UniqueName: \"kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-kube-api-access-zjqv2\") pod \"e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.392689 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.392631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:14.545098 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.545075 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr"] Jul 09 19:25:14.547590 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:25:14.547564 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431dcc7e_0fd0_49af_b990_a31093446278.slice/crio-ee49a4f5eca00ce89026567855313351c3ec5b23bb2b29dc75445bab1409db0e WatchSource:0}: Error finding container ee49a4f5eca00ce89026567855313351c3ec5b23bb2b29dc75445bab1409db0e: Status 404 returned error can't find the container with id ee49a4f5eca00ce89026567855313351c3ec5b23bb2b29dc75445bab1409db0e Jul 09 19:25:14.550148 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.550112 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:25:14.550213 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.550177 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:25:14.550247 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:14.550218 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:25:15.023514 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:15.023476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" event={"ID":"431dcc7e-0fd0-49af-b990-a31093446278","Type":"ContainerStarted","Data":"247cef47436a813b1a1d8f4b6191e05f6fdf478d4dfb3a35d7c3bd3f0b3f230a"} Jul 09 19:25:15.023676 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:15.023546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" event={"ID":"431dcc7e-0fd0-49af-b990-a31093446278","Type":"ContainerStarted","Data":"ee49a4f5eca00ce89026567855313351c3ec5b23bb2b29dc75445bab1409db0e"} Jul 09 19:25:15.048727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:15.048684 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" podStartSLOduration=1.048668593 podStartE2EDuration="1.048668593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:25:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:25:15.046851335 +0000 UTC m=+1558.830259134" watchObservedRunningTime="2026-07-09 19:25:15.048668593 +0000 UTC m=+1558.832076358" Jul 09 19:25:15.393166 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:15.393099 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:15.397631 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:15.397612 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:16.028887 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:16.028851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:16.029719 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:16.029701 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:19.851428 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:19.851398 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr"] Jul 09 19:25:19.851838 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:19.851589 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" podUID="431dcc7e-0fd0-49af-b990-a31093446278" containerName="istio-proxy" containerID="cri-o://247cef47436a813b1a1d8f4b6191e05f6fdf478d4dfb3a35d7c3bd3f0b3f230a" gracePeriod=30 Jul 09 19:25:25.064320 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.064292 2576 generic.go:356] "Generic (PLEG): container finished" podID="431dcc7e-0fd0-49af-b990-a31093446278" containerID="247cef47436a813b1a1d8f4b6191e05f6fdf478d4dfb3a35d7c3bd3f0b3f230a" exitCode=0 Jul 09 19:25:25.064655 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.064328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" event={"ID":"431dcc7e-0fd0-49af-b990-a31093446278","Type":"ContainerDied","Data":"247cef47436a813b1a1d8f4b6191e05f6fdf478d4dfb3a35d7c3bd3f0b3f230a"} Jul 09 19:25:25.095701 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.095681 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:25.197118 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197094 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-envoy\") pod \"431dcc7e-0fd0-49af-b990-a31093446278\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " Jul 09 19:25:25.197250 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197129 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-data\") pod \"431dcc7e-0fd0-49af-b990-a31093446278\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " Jul 09 19:25:25.197250 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197157 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjqv2\" (UniqueName: \"kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-kube-api-access-zjqv2\") pod \"431dcc7e-0fd0-49af-b990-a31093446278\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " Jul 09 19:25:25.197250 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197195 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-istio-token\") pod \"431dcc7e-0fd0-49af-b990-a31093446278\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " Jul 09 19:25:25.197415 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197251 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431dcc7e-0fd0-49af-b990-a31093446278-istio-podinfo\") pod \"431dcc7e-0fd0-49af-b990-a31093446278\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " Jul 09 19:25:25.197415 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197284 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431dcc7e-0fd0-49af-b990-a31093446278-istiod-ca-cert\") pod \"431dcc7e-0fd0-49af-b990-a31093446278\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " Jul 09 19:25:25.197415 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197343 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-socket\") pod \"431dcc7e-0fd0-49af-b990-a31093446278\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " Jul 09 19:25:25.197415 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197400 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-data" (OuterVolumeSpecName: "istio-data") pod "431dcc7e-0fd0-49af-b990-a31093446278" (UID: "431dcc7e-0fd0-49af-b990-a31093446278"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:25:25.197633 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197457 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-credential-socket\") pod \"431dcc7e-0fd0-49af-b990-a31093446278\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " Jul 09 19:25:25.197633 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197495 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-certs\") pod \"431dcc7e-0fd0-49af-b990-a31093446278\" (UID: \"431dcc7e-0fd0-49af-b990-a31093446278\") " Jul 09 19:25:25.197729 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197625 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "431dcc7e-0fd0-49af-b990-a31093446278" (UID: "431dcc7e-0fd0-49af-b990-a31093446278"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:25:25.197839 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197823 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:25.197894 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197836 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "431dcc7e-0fd0-49af-b990-a31093446278" (UID: "431dcc7e-0fd0-49af-b990-a31093446278"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:25:25.197894 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197844 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:25.197894 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.197755 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/431dcc7e-0fd0-49af-b990-a31093446278-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "431dcc7e-0fd0-49af-b990-a31093446278" (UID: "431dcc7e-0fd0-49af-b990-a31093446278"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:25:25.198077 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.198058 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "431dcc7e-0fd0-49af-b990-a31093446278" (UID: "431dcc7e-0fd0-49af-b990-a31093446278"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:25:25.199445 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.199422 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "431dcc7e-0fd0-49af-b990-a31093446278" (UID: "431dcc7e-0fd0-49af-b990-a31093446278"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:25:25.199541 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.199422 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-istio-token" (OuterVolumeSpecName: "istio-token") pod "431dcc7e-0fd0-49af-b990-a31093446278" (UID: "431dcc7e-0fd0-49af-b990-a31093446278"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:25:25.199744 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.199717 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/431dcc7e-0fd0-49af-b990-a31093446278-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "431dcc7e-0fd0-49af-b990-a31093446278" (UID: "431dcc7e-0fd0-49af-b990-a31093446278"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:25:25.199744 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.199733 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-kube-api-access-zjqv2" (OuterVolumeSpecName: "kube-api-access-zjqv2") pod "431dcc7e-0fd0-49af-b990-a31093446278" (UID: "431dcc7e-0fd0-49af-b990-a31093446278"). InnerVolumeSpecName "kube-api-access-zjqv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:25:25.298387 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.298364 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431dcc7e-0fd0-49af-b990-a31093446278-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:25.298387 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.298382 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431dcc7e-0fd0-49af-b990-a31093446278-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:25.298585 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.298392 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:25.298585 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.298401 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:25.298585 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.298409 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431dcc7e-0fd0-49af-b990-a31093446278-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:25.298585 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.298417 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjqv2\" (UniqueName: \"kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-kube-api-access-zjqv2\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:25.298585 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:25.298425 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431dcc7e-0fd0-49af-b990-a31093446278-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:25:26.069935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:26.069902 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" event={"ID":"431dcc7e-0fd0-49af-b990-a31093446278","Type":"ContainerDied","Data":"ee49a4f5eca00ce89026567855313351c3ec5b23bb2b29dc75445bab1409db0e"} Jul 09 19:25:26.069935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:26.069930 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr" Jul 09 19:25:26.070414 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:26.069972 2576 scope.go:117] "RemoveContainer" containerID="247cef47436a813b1a1d8f4b6191e05f6fdf478d4dfb3a35d7c3bd3f0b3f230a" Jul 09 19:25:26.095131 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:26.095103 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr"] Jul 09 19:25:26.099758 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:26.099737 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f5ef04a0-openshift-default-6dbbfbddc9-sdqrr"] Jul 09 19:25:26.729104 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:25:26.729071 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="431dcc7e-0fd0-49af-b990-a31093446278" path="/var/lib/kubelet/pods/431dcc7e-0fd0-49af-b990-a31093446278/volumes" Jul 09 19:27:01.803247 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.803213 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr"] Jul 09 19:27:01.803707 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.803632 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="431dcc7e-0fd0-49af-b990-a31093446278" containerName="istio-proxy" Jul 09 19:27:01.803707 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.803647 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="431dcc7e-0fd0-49af-b990-a31093446278" containerName="istio-proxy" Jul 09 19:27:01.803781 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.803739 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="431dcc7e-0fd0-49af-b990-a31093446278" containerName="istio-proxy" Jul 09 19:27:01.806848 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.806831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:01.810383 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.810358 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-35930880-openshift-default-dockercfg-kzr26\"" Jul 09 19:27:01.840464 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.840441 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr"] Jul 09 19:27:01.920116 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.920081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-socket\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:01.920293 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.920132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-podinfo\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:01.920293 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.920207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-data\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:01.920293 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.920263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e19d2f2-67fa-4a84-9f75-48d302afe529-istiod-ca-cert\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:01.920426 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.920290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-envoy\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:01.920426 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.920314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-token\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:01.920426 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.920342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69dfz\" (UniqueName: \"kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-kube-api-access-69dfz\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:01.920426 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.920371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-credential-socket\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:01.920617 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:01.920451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-certs\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.021798 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.021767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-podinfo\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.021798 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.021800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-data\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022096 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.021823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e19d2f2-67fa-4a84-9f75-48d302afe529-istiod-ca-cert\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022096 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.021847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-envoy\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022096 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.021869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-token\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022096 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.021894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69dfz\" (UniqueName: \"kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-kube-api-access-69dfz\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022096 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.021922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-credential-socket\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022096 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.021981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-certs\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022407 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.022100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-socket\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022407 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.022230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-data\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022407 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.022290 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-credential-socket\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022577 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.022435 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-socket\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022577 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.022488 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-certs\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.022931 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.022909 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e19d2f2-67fa-4a84-9f75-48d302afe529-istiod-ca-cert\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.024117 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.024098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-envoy\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.024320 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.024304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-podinfo\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.032277 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.032258 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-token\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.036100 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.036077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69dfz\" (UniqueName: \"kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-kube-api-access-69dfz\") pod \"e2e-mt-35930880-openshift-default-7765544dc9-pb5lr\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.117181 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.117112 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:02.250882 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.250856 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr"] Jul 09 19:27:02.251831 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:27:02.251796 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e19d2f2_67fa_4a84_9f75_48d302afe529.slice/crio-9c16a051fc27ff6bd73cd4f01533f620633374e238f3ade0c0347f06cae5389e WatchSource:0}: Error finding container 9c16a051fc27ff6bd73cd4f01533f620633374e238f3ade0c0347f06cae5389e: Status 404 returned error can't find the container with id 9c16a051fc27ff6bd73cd4f01533f620633374e238f3ade0c0347f06cae5389e Jul 09 19:27:02.255947 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.255912 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:27:02.256062 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.255991 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:27:02.256062 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.256034 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:27:02.457720 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.457688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" event={"ID":"9e19d2f2-67fa-4a84-9f75-48d302afe529","Type":"ContainerStarted","Data":"b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec"} Jul 09 19:27:02.457905 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.457749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" event={"ID":"9e19d2f2-67fa-4a84-9f75-48d302afe529","Type":"ContainerStarted","Data":"9c16a051fc27ff6bd73cd4f01533f620633374e238f3ade0c0347f06cae5389e"} Jul 09 19:27:02.507630 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:02.507580 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" podStartSLOduration=1.507564715 podStartE2EDuration="1.507564715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:27:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:27:02.506041107 +0000 UTC m=+1666.289448893" watchObservedRunningTime="2026-07-09 19:27:02.507564715 +0000 UTC m=+1666.290972525" Jul 09 19:27:03.117646 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:03.117619 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:03.122580 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:03.122556 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:03.462138 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:03.462108 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:03.463161 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:03.463141 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:17.523389 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:17.523323 2576 generic.go:356] "Generic (PLEG): container finished" podID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerID="b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec" exitCode=0 Jul 09 19:27:17.523779 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:17.523396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" event={"ID":"9e19d2f2-67fa-4a84-9f75-48d302afe529","Type":"ContainerDied","Data":"b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec"} Jul 09 19:27:17.523779 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:17.523748 2576 scope.go:117] "RemoveContainer" containerID="b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec" Jul 09 19:27:17.524685 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:17.524656 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:27:17.524795 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:17.524736 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:27:17.524795 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:17.524785 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:27:18.462689 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:18.462650 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:18.529642 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:18.529612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" event={"ID":"9e19d2f2-67fa-4a84-9f75-48d302afe529","Type":"ContainerStarted","Data":"9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9"} Jul 09 19:27:19.117555 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:19.117522 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:19.118406 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:19.118377 2576 patch_prober.go:28] interesting pod/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jul 09 19:27:19.118516 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:19.118425 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jul 09 19:27:20.118081 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:20.118044 2576 patch_prober.go:28] interesting pod/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jul 09 19:27:20.118442 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:20.118102 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jul 09 19:27:21.117672 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:21.117638 2576 patch_prober.go:28] interesting pod/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jul 09 19:27:21.117830 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:21.117696 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jul 09 19:27:22.118041 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:22.118004 2576 patch_prober.go:28] interesting pod/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body= Jul 09 19:27:22.118409 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:22.118073 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" Jul 09 19:27:23.115885 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:23.115855 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr"] Jul 09 19:27:23.116050 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:23.116030 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" containerID="cri-o://9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9" gracePeriod=30 Jul 09 19:27:28.364208 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.364177 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:28.533464 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533441 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-podinfo\") pod \"9e19d2f2-67fa-4a84-9f75-48d302afe529\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " Jul 09 19:27:28.533649 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533486 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e19d2f2-67fa-4a84-9f75-48d302afe529-istiod-ca-cert\") pod \"9e19d2f2-67fa-4a84-9f75-48d302afe529\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " Jul 09 19:27:28.533649 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533548 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-credential-socket\") pod \"9e19d2f2-67fa-4a84-9f75-48d302afe529\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " Jul 09 19:27:28.533649 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533574 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-socket\") pod \"9e19d2f2-67fa-4a84-9f75-48d302afe529\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " Jul 09 19:27:28.533649 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533595 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-token\") pod \"9e19d2f2-67fa-4a84-9f75-48d302afe529\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " Jul 09 19:27:28.533649 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533623 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-envoy\") pod \"9e19d2f2-67fa-4a84-9f75-48d302afe529\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " Jul 09 19:27:28.533905 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533651 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-certs\") pod \"9e19d2f2-67fa-4a84-9f75-48d302afe529\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " Jul 09 19:27:28.533905 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533675 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-data\") pod \"9e19d2f2-67fa-4a84-9f75-48d302afe529\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " Jul 09 19:27:28.533905 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533731 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69dfz\" (UniqueName: \"kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-kube-api-access-69dfz\") pod \"9e19d2f2-67fa-4a84-9f75-48d302afe529\" (UID: \"9e19d2f2-67fa-4a84-9f75-48d302afe529\") " Jul 09 19:27:28.533905 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533893 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e19d2f2-67fa-4a84-9f75-48d302afe529" (UID: "9e19d2f2-67fa-4a84-9f75-48d302afe529"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:27:28.534093 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.533907 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e19d2f2-67fa-4a84-9f75-48d302afe529" (UID: "9e19d2f2-67fa-4a84-9f75-48d302afe529"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:27:28.534093 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.534080 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e19d2f2-67fa-4a84-9f75-48d302afe529-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e19d2f2-67fa-4a84-9f75-48d302afe529" (UID: "9e19d2f2-67fa-4a84-9f75-48d302afe529"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:27:28.534200 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.534089 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e19d2f2-67fa-4a84-9f75-48d302afe529" (UID: "9e19d2f2-67fa-4a84-9f75-48d302afe529"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:27:28.534817 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.534789 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e19d2f2-67fa-4a84-9f75-48d302afe529" (UID: "9e19d2f2-67fa-4a84-9f75-48d302afe529"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:27:28.535787 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.535759 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e19d2f2-67fa-4a84-9f75-48d302afe529" (UID: "9e19d2f2-67fa-4a84-9f75-48d302afe529"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:27:28.535787 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.535769 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e19d2f2-67fa-4a84-9f75-48d302afe529" (UID: "9e19d2f2-67fa-4a84-9f75-48d302afe529"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:27:28.535908 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.535858 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-kube-api-access-69dfz" (OuterVolumeSpecName: "kube-api-access-69dfz") pod "9e19d2f2-67fa-4a84-9f75-48d302afe529" (UID: "9e19d2f2-67fa-4a84-9f75-48d302afe529"). InnerVolumeSpecName "kube-api-access-69dfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:27:28.535908 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.535858 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e19d2f2-67fa-4a84-9f75-48d302afe529" (UID: "9e19d2f2-67fa-4a84-9f75-48d302afe529"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:27:28.571788 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.571768 2576 generic.go:356] "Generic (PLEG): container finished" podID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerID="9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9" exitCode=0 Jul 09 19:27:28.571868 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.571812 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" Jul 09 19:27:28.571868 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.571818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" event={"ID":"9e19d2f2-67fa-4a84-9f75-48d302afe529","Type":"ContainerDied","Data":"9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9"} Jul 09 19:27:28.571868 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.571860 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr" event={"ID":"9e19d2f2-67fa-4a84-9f75-48d302afe529","Type":"ContainerDied","Data":"9c16a051fc27ff6bd73cd4f01533f620633374e238f3ade0c0347f06cae5389e"} Jul 09 19:27:28.571969 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.571887 2576 scope.go:117] "RemoveContainer" containerID="9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9" Jul 09 19:27:28.580487 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.580468 2576 scope.go:117] "RemoveContainer" containerID="b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec" Jul 09 19:27:28.587486 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.587469 2576 scope.go:117] "RemoveContainer" containerID="9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9" Jul 09 19:27:28.587743 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:27:28.587721 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9\": container with ID starting with 9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9 not found: ID does not exist" containerID="9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9" Jul 09 19:27:28.587787 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.587749 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9"} err="failed to get container status \"9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9\": rpc error: code = NotFound desc = could not find container \"9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9\": container with ID starting with 9ebf732341e404c0ed8222e4632f165e06eddda4d9cf17378e500992366b91d9 not found: ID does not exist" Jul 09 19:27:28.587787 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.587766 2576 scope.go:117] "RemoveContainer" containerID="b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec" Jul 09 19:27:28.588002 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:27:28.587986 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec\": container with ID starting with b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec not found: ID does not exist" containerID="b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec" Jul 09 19:27:28.588053 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.588007 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec"} err="failed to get container status \"b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec\": rpc error: code = NotFound desc = could not find container \"b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec\": container with ID starting with b8902fabe3928d65479ee0e0e472af841e0534c9e1d820cf0b3293700d87f0ec not found: ID does not exist" Jul 09 19:27:28.594608 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.594588 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr"] Jul 09 19:27:28.598147 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.598128 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-35930880-openshift-default-7765544dc9-pb5lr"] Jul 09 19:27:28.634861 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.634837 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69dfz\" (UniqueName: \"kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-kube-api-access-69dfz\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:27:28.634861 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.634859 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:27:28.634990 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.634873 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e19d2f2-67fa-4a84-9f75-48d302afe529-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:27:28.634990 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.634884 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:27:28.634990 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.634897 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:27:28.634990 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.634909 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:27:28.634990 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.634921 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:27:28.634990 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.634933 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:27:28.634990 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.634944 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e19d2f2-67fa-4a84-9f75-48d302afe529-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:27:28.728184 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:28.728162 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" path="/var/lib/kubelet/pods/9e19d2f2-67fa-4a84-9f75-48d302afe529/volumes" Jul 09 19:27:43.182056 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.181964 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn"] Jul 09 19:27:43.182556 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.182341 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" Jul 09 19:27:43.182556 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.182358 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" Jul 09 19:27:43.182556 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.182373 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" Jul 09 19:27:43.182556 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.182378 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" Jul 09 19:27:43.182556 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.182426 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" Jul 09 19:27:43.186647 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.186629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.189713 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.189691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-21ee0800-openshift-default-dockercfg-rgsx2\"" Jul 09 19:27:43.197008 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.196988 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn"] Jul 09 19:27:43.343154 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.343118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-certs\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.343315 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.343181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istiod-ca-cert\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.343315 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.343278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-socket\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.343403 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.343314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-token\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.343403 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.343360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-envoy\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.343403 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.343389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsgm8\" (UniqueName: \"kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-kube-api-access-jsgm8\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.343552 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.343467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-credential-socket\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.343552 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.343490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-data\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.343552 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.343538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-podinfo\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.444574 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.444510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-socket\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.444574 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.444553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-token\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.444747 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.444591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-envoy\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.444747 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.444621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsgm8\" (UniqueName: \"kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-kube-api-access-jsgm8\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.444747 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.444666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-credential-socket\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.444747 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.444690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-data\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.444747 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.444730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-podinfo\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.444995 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.444769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-certs\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.444995 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.444824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istiod-ca-cert\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.444995 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.444873 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-socket\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.445459 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.445417 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istiod-ca-cert\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.445459 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.445436 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-credential-socket\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.445609 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.445468 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-certs\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.445609 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.445522 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-data\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.447552 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.447530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-envoy\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.447767 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.447737 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-podinfo\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.453643 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.453605 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-token\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.453755 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.453702 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsgm8\" (UniqueName: \"kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-kube-api-access-jsgm8\") pod \"e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.497189 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.497172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:43.634912 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.634889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn"] Jul 09 19:27:43.637042 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:27:43.637011 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98020e40_8d67_4f78_8a8d_8ffa0f0ee29a.slice/crio-a0be263a22a4d43bb417663bc2e9488ff92fab3daf27623e46589ec7f381b214 WatchSource:0}: Error finding container a0be263a22a4d43bb417663bc2e9488ff92fab3daf27623e46589ec7f381b214: Status 404 returned error can't find the container with id a0be263a22a4d43bb417663bc2e9488ff92fab3daf27623e46589ec7f381b214 Jul 09 19:27:43.639013 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.638982 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:27:43.639127 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.639062 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:27:43.639127 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:43.639106 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:27:44.640698 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:44.640662 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" event={"ID":"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a","Type":"ContainerStarted","Data":"1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a"} Jul 09 19:27:44.641065 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:44.640710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" event={"ID":"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a","Type":"ContainerStarted","Data":"a0be263a22a4d43bb417663bc2e9488ff92fab3daf27623e46589ec7f381b214"} Jul 09 19:27:44.664587 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:44.664527 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" podStartSLOduration=1.664490898 podStartE2EDuration="1.664490898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:27:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:27:44.663362219 +0000 UTC m=+1708.446769985" watchObservedRunningTime="2026-07-09 19:27:44.664490898 +0000 UTC m=+1708.447898663" Jul 09 19:27:45.497935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:45.497903 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:45.502522 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:45.502476 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:45.644736 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:45.644709 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:27:45.645470 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:27:45.645454 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:28:00.966450 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:00.965602 2576 patch_prober.go:28] interesting pod/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": read tcp 10.132.0.2:55896->10.132.0.28:15021: read: connection reset by peer" start-of-body= Jul 09 19:28:00.966450 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:00.965668 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": read tcp 10.132.0.2:55896->10.132.0.28:15021: read: connection reset by peer" Jul 09 19:28:01.719019 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:01.718988 2576 generic.go:356] "Generic (PLEG): container finished" podID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerID="1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a" exitCode=0 Jul 09 19:28:01.719153 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:01.719037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" event={"ID":"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a","Type":"ContainerDied","Data":"1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a"} Jul 09 19:28:01.719464 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:01.719447 2576 scope.go:117] "RemoveContainer" containerID="1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a" Jul 09 19:28:01.720524 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:01.720476 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:28:01.720632 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:01.720577 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:28:01.720675 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:01.720626 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:28:02.728297 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:02.728263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" event={"ID":"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a","Type":"ContainerStarted","Data":"ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422"} Jul 09 19:28:03.497721 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:03.497678 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:28:03.497906 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:03.497874 2576 patch_prober.go:28] interesting pod/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jul 09 19:28:03.497951 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:03.497915 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jul 09 19:28:04.498412 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:04.498377 2576 patch_prober.go:28] interesting pod/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jul 09 19:28:04.498817 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:04.498437 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jul 09 19:28:05.498569 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:05.498535 2576 patch_prober.go:28] interesting pod/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jul 09 19:28:05.498967 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:05.498590 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jul 09 19:28:06.498187 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:06.498149 2576 patch_prober.go:28] interesting pod/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jul 09 19:28:06.498366 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:06.498230 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jul 09 19:28:07.501492 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:07.501462 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:28:07.502001 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:07.501984 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:28:07.502597 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:28:07.502576 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:29:17.929690 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:17.929656 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:29:17.934599 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:17.934576 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:29:17.937754 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:17.937739 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:29:17.942104 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:17.942091 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:29:48.178586 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:48.178553 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn"] Jul 09 19:29:48.179117 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:48.178752 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" containerID="cri-o://ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422" gracePeriod=30 Jul 09 19:29:52.503433 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:52.503399 2576 patch_prober.go:28] interesting pod/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 19:29:52.503842 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:52.503460 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 19:29:53.428523 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.428488 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:29:53.549731 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.549652 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-socket\") pod \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " Jul 09 19:29:53.549731 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.549684 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-data\") pod \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " Jul 09 19:29:53.549731 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.549715 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-credential-socket\") pod \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " Jul 09 19:29:53.550256 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.549745 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsgm8\" (UniqueName: \"kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-kube-api-access-jsgm8\") pod \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " Jul 09 19:29:53.550256 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.549789 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-token\") pod \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " Jul 09 19:29:53.550256 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.549809 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istiod-ca-cert\") pod \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " Jul 09 19:29:53.550256 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.549833 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-envoy\") pod \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " Jul 09 19:29:53.550256 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.549868 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-podinfo\") pod \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " Jul 09 19:29:53.550256 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.549932 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" (UID: "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:29:53.550256 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.549985 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-certs\") pod \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\" (UID: \"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a\") " Jul 09 19:29:53.550256 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.550229 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:29:53.550256 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.550227 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" (UID: "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:29:53.550763 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.550272 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" (UID: "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:29:53.550763 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.550411 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" (UID: "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:29:53.550763 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.550649 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-data" (OuterVolumeSpecName: "istio-data") pod "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" (UID: "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:29:53.552075 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.552052 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" (UID: "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:29:53.552168 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.552099 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-token" (OuterVolumeSpecName: "istio-token") pod "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" (UID: "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:29:53.552321 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.552305 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" (UID: "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:29:53.552361 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.552349 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-kube-api-access-jsgm8" (OuterVolumeSpecName: "kube-api-access-jsgm8") pod "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" (UID: "98020e40-8d67-4f78-8a8d-8ffa0f0ee29a"). InnerVolumeSpecName "kube-api-access-jsgm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:29:53.651082 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.651052 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsgm8\" (UniqueName: \"kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-kube-api-access-jsgm8\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:29:53.651082 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.651082 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:29:53.651082 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.651092 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:29:53.651240 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.651100 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:29:53.651240 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.651107 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:29:53.651240 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.651115 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:29:53.651240 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.651122 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:29:53.651240 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:53.651130 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:29:54.182447 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.182414 2576 generic.go:356] "Generic (PLEG): container finished" podID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerID="ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422" exitCode=0 Jul 09 19:29:54.182647 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.182471 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" Jul 09 19:29:54.182647 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.182531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" event={"ID":"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a","Type":"ContainerDied","Data":"ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422"} Jul 09 19:29:54.182647 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.182604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn" event={"ID":"98020e40-8d67-4f78-8a8d-8ffa0f0ee29a","Type":"ContainerDied","Data":"a0be263a22a4d43bb417663bc2e9488ff92fab3daf27623e46589ec7f381b214"} Jul 09 19:29:54.182647 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.182626 2576 scope.go:117] "RemoveContainer" containerID="ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422" Jul 09 19:29:54.191914 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.191898 2576 scope.go:117] "RemoveContainer" containerID="1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a" Jul 09 19:29:54.199070 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.199057 2576 scope.go:117] "RemoveContainer" containerID="ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422" Jul 09 19:29:54.199317 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:29:54.199301 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422\": container with ID starting with ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422 not found: ID does not exist" containerID="ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422" Jul 09 19:29:54.199357 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.199326 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422"} err="failed to get container status \"ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422\": rpc error: code = NotFound desc = could not find container \"ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422\": container with ID starting with ba62cd0bd73f6fb7e3ae273c8ce2414195036f3665c0ffedf63c0da658acd422 not found: ID does not exist" Jul 09 19:29:54.199357 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.199341 2576 scope.go:117] "RemoveContainer" containerID="1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a" Jul 09 19:29:54.199575 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:29:54.199559 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a\": container with ID starting with 1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a not found: ID does not exist" containerID="1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a" Jul 09 19:29:54.199618 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.199581 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a"} err="failed to get container status \"1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a\": rpc error: code = NotFound desc = could not find container \"1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a\": container with ID starting with 1fc94980da075afba9ebe1577f8a750d6e5c5bdb272fa7f3b44f5f6bc795104a not found: ID does not exist" Jul 09 19:29:54.205157 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.205138 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn"] Jul 09 19:29:54.212341 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.212321 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-21ee0800-openshift-default-7dd99b8cf-kqwpn"] Jul 09 19:29:54.729343 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:29:54.729311 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" path="/var/lib/kubelet/pods/98020e40-8d67-4f78-8a8d-8ffa0f0ee29a/volumes" Jul 09 19:30:42.936142 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:42.936070 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw"] Jul 09 19:30:42.936606 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:42.936380 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" Jul 09 19:30:42.936606 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:42.936391 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" Jul 09 19:30:42.936606 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:42.936451 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" Jul 09 19:30:42.936606 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:42.936462 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e19d2f2-67fa-4a84-9f75-48d302afe529" containerName="istio-proxy" Jul 09 19:30:42.939246 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:42.939230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:42.942560 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:42.942535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-84e6af-openshift-default-dockercfg-dhmz6\"" Jul 09 19:30:42.955656 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:42.955635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw"] Jul 09 19:30:43.013617 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.013585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-certs\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.013617 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.013616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-token\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.013771 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.013640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-data\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.013771 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.013735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-envoy\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.013771 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.013767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-socket\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.013869 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.013791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-credential-socket\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.013869 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.013837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istiod-ca-cert\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.013931 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.013867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln2j2\" (UniqueName: \"kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-kube-api-access-ln2j2\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.013931 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.013896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-podinfo\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115029 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.114981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-envoy\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115216 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-socket\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115216 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-credential-socket\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115216 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istiod-ca-cert\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115216 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln2j2\" (UniqueName: \"kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-kube-api-access-ln2j2\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115216 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-podinfo\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115549 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-certs\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115549 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-token\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115549 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-data\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115549 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115493 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-socket\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.115549 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115538 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-credential-socket\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.116360 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.115948 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-data\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.116522 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.116430 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-certs\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.116953 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.116927 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istiod-ca-cert\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.117810 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.117788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-envoy\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.118333 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.118314 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-podinfo\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.124701 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.124683 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-token\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.125079 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.125059 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln2j2\" (UniqueName: \"kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-kube-api-access-ln2j2\") pod \"e2e-inf-a-84e6af-openshift-default-5f494657-6sznw\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.255220 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.255158 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:43.387032 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.387010 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw"] Jul 09 19:30:43.389176 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:30:43.389148 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9162b69_68e3_4026_a82b_7249ed7e5e6a.slice/crio-3739a128dd9a36d917c35c2e994a154556a29c88e2118bad858d544bc7840bfd WatchSource:0}: Error finding container 3739a128dd9a36d917c35c2e994a154556a29c88e2118bad858d544bc7840bfd: Status 404 returned error can't find the container with id 3739a128dd9a36d917c35c2e994a154556a29c88e2118bad858d544bc7840bfd Jul 09 19:30:43.391352 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.391319 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:30:43.391445 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.391394 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:30:43.391532 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:43.391441 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:30:44.378568 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:44.378530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" event={"ID":"b9162b69-68e3-4026-a82b-7249ed7e5e6a","Type":"ContainerStarted","Data":"c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932"} Jul 09 19:30:44.378935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:44.378592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" event={"ID":"b9162b69-68e3-4026-a82b-7249ed7e5e6a","Type":"ContainerStarted","Data":"3739a128dd9a36d917c35c2e994a154556a29c88e2118bad858d544bc7840bfd"} Jul 09 19:30:44.461142 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:44.461070 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" podStartSLOduration=2.461054621 podStartE2EDuration="2.461054621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:30:44.45846996 +0000 UTC m=+1888.241877728" watchObservedRunningTime="2026-07-09 19:30:44.461054621 +0000 UTC m=+1888.244462385" Jul 09 19:30:45.255877 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:45.255842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:45.260626 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:45.260604 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:45.382294 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:45.382270 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:45.383062 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:45.383043 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:30:51.477149 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.477120 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt"] Jul 09 19:30:51.478055 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.477563 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" Jul 09 19:30:51.478055 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.477578 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" Jul 09 19:30:51.478055 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.477645 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="98020e40-8d67-4f78-8a8d-8ffa0f0ee29a" containerName="istio-proxy" Jul 09 19:30:51.480716 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.480694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.484052 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.484031 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4038d9-openshift-default-dockercfg-q82fp\"" Jul 09 19:30:51.492304 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.492284 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt"] Jul 09 19:30:51.580487 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.580450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istiod-ca-cert\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.580804 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.580781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-credential-socket\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.580986 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.580968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-certs\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.581152 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.581136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-envoy\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.581292 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.581268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-token\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.581428 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.581345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-socket\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.581428 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.581371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dz6f\" (UniqueName: \"kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-kube-api-access-4dz6f\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.581642 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.581433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-data\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.581642 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.581457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-podinfo\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682029 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-credential-socket\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682029 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-certs\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682231 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-envoy\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682231 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-token\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682316 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-socket\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682316 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dz6f\" (UniqueName: \"kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-kube-api-access-4dz6f\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682459 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-data\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682551 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-podinfo\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682551 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682535 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-certs\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682663 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istiod-ca-cert\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682663 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682570 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-credential-socket\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682663 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682620 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-socket\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.682816 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.682790 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-data\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.683175 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.683154 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istiod-ca-cert\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.684573 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.684555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-envoy\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.684909 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.684893 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-podinfo\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.690846 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.690821 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dz6f\" (UniqueName: \"kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-kube-api-access-4dz6f\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.691460 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.691441 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-token\") pod \"e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.794072 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.794003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:51.920756 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.920734 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt"] Jul 09 19:30:51.922878 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:30:51.922849 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce886ec4_2739_4167_9cb0_81a0b001c7f6.slice/crio-e52ce95e1e6f8e3f88e06e886222ed3e91b086d49446fa022e109f1e32d6e232 WatchSource:0}: Error finding container e52ce95e1e6f8e3f88e06e886222ed3e91b086d49446fa022e109f1e32d6e232: Status 404 returned error can't find the container with id e52ce95e1e6f8e3f88e06e886222ed3e91b086d49446fa022e109f1e32d6e232 Jul 09 19:30:51.925078 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.925049 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:30:51.925160 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.925114 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:30:51.925160 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:51.925144 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:30:52.417510 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:52.417475 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" event={"ID":"ce886ec4-2739-4167-9cb0-81a0b001c7f6","Type":"ContainerStarted","Data":"e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4"} Jul 09 19:30:52.417675 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:52.417575 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" event={"ID":"ce886ec4-2739-4167-9cb0-81a0b001c7f6","Type":"ContainerStarted","Data":"e52ce95e1e6f8e3f88e06e886222ed3e91b086d49446fa022e109f1e32d6e232"} Jul 09 19:30:52.441849 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:52.441806 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" podStartSLOduration=1.44179204 podStartE2EDuration="1.44179204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:30:52.439653089 +0000 UTC m=+1896.223060855" watchObservedRunningTime="2026-07-09 19:30:52.44179204 +0000 UTC m=+1896.225199885" Jul 09 19:30:52.794670 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:52.794640 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:52.799271 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:52.799250 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:53.421291 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:53.421261 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:30:53.422064 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:30:53.422044 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:31:01.425643 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:01.425608 2576 patch_prober.go:28] interesting pod/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 19:31:01.426002 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:01.425673 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 19:31:02.460737 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:02.460705 2576 generic.go:356] "Generic (PLEG): container finished" podID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerID="c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932" exitCode=0 Jul 09 19:31:02.461255 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:02.460746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" event={"ID":"b9162b69-68e3-4026-a82b-7249ed7e5e6a","Type":"ContainerDied","Data":"c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932"} Jul 09 19:31:02.461255 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:02.461216 2576 scope.go:117] "RemoveContainer" containerID="c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932" Jul 09 19:31:02.462232 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:02.462203 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:31:02.462286 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:02.462271 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:31:02.462321 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:02.462299 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:31:03.471372 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:03.471327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" event={"ID":"b9162b69-68e3-4026-a82b-7249ed7e5e6a","Type":"ContainerStarted","Data":"45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658"} Jul 09 19:31:04.256149 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:04.256112 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:31:04.256344 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:04.256227 2576 patch_prober.go:28] interesting pod/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 09 19:31:04.256344 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:04.256271 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 09 19:31:05.255800 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:05.255770 2576 patch_prober.go:28] interesting pod/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 09 19:31:05.256248 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:05.256224 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 09 19:31:06.255994 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:06.255948 2576 patch_prober.go:28] interesting pod/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 09 19:31:06.256435 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:06.256015 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 09 19:31:07.255560 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:07.255519 2576 patch_prober.go:28] interesting pod/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 09 19:31:07.255738 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:07.255588 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 09 19:31:08.259224 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:08.259197 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:31:08.259635 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:08.259509 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:31:08.260057 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:08.260041 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:31:09.044324 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:09.043878 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": read tcp 10.132.0.2:53852->10.132.0.30:15021: read: connection reset by peer" start-of-body= Jul 09 19:31:09.044324 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:09.043956 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": read tcp 10.132.0.2:53852->10.132.0.30:15021: read: connection reset by peer" Jul 09 19:31:09.505620 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:09.505592 2576 generic.go:356] "Generic (PLEG): container finished" podID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerID="e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4" exitCode=0 Jul 09 19:31:09.506065 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:09.505662 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" event={"ID":"ce886ec4-2739-4167-9cb0-81a0b001c7f6","Type":"ContainerDied","Data":"e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4"} Jul 09 19:31:09.506195 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:09.506178 2576 scope.go:117] "RemoveContainer" containerID="e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4" Jul 09 19:31:09.507143 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:09.507116 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:31:09.507199 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:09.507186 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:31:09.507234 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:09.507225 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:31:10.512095 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:10.512059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" event={"ID":"ce886ec4-2739-4167-9cb0-81a0b001c7f6","Type":"ContainerStarted","Data":"eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8"} Jul 09 19:31:10.794651 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:10.794557 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:31:10.794809 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:10.794788 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 09 19:31:10.794852 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:10.794834 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 09 19:31:11.795375 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:11.795340 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 09 19:31:11.795744 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:11.795393 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 09 19:31:12.794326 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:12.794293 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 09 19:31:12.794541 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:12.794347 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 09 19:31:13.794770 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:13.794736 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 09 19:31:13.795178 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:13.794787 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 09 19:31:14.797938 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:14.797905 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:31:14.798368 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:14.798312 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:31:14.799075 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:31:14.799056 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:32:51.302487 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:51.302455 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw"] Jul 09 19:32:51.302985 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:51.302694 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" containerID="cri-o://45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658" gracePeriod=30 Jul 09 19:32:53.262300 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:53.262263 2576 patch_prober.go:28] interesting pod/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 19:32:53.262752 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:53.262347 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 19:32:56.550925 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.550895 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:32:56.679781 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.679760 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-envoy\") pod \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " Jul 09 19:32:56.679893 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.679789 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln2j2\" (UniqueName: \"kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-kube-api-access-ln2j2\") pod \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " Jul 09 19:32:56.679893 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.679822 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-token\") pod \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " Jul 09 19:32:56.679893 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.679849 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-socket\") pod \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " Jul 09 19:32:56.679893 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.679885 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-podinfo\") pod \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " Jul 09 19:32:56.680098 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.679912 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-data\") pod \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " Jul 09 19:32:56.680098 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.679930 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istiod-ca-cert\") pod \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " Jul 09 19:32:56.680098 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.679955 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-certs\") pod \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " Jul 09 19:32:56.680098 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.679987 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-credential-socket\") pod \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\" (UID: \"b9162b69-68e3-4026-a82b-7249ed7e5e6a\") " Jul 09 19:32:56.680315 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.680170 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9162b69-68e3-4026-a82b-7249ed7e5e6a" (UID: "b9162b69-68e3-4026-a82b-7249ed7e5e6a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:32:56.680936 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.680414 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9162b69-68e3-4026-a82b-7249ed7e5e6a" (UID: "b9162b69-68e3-4026-a82b-7249ed7e5e6a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:32:56.680936 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.680473 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9162b69-68e3-4026-a82b-7249ed7e5e6a" (UID: "b9162b69-68e3-4026-a82b-7249ed7e5e6a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:32:56.680936 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.680487 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9162b69-68e3-4026-a82b-7249ed7e5e6a" (UID: "b9162b69-68e3-4026-a82b-7249ed7e5e6a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:32:56.681285 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.681253 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9162b69-68e3-4026-a82b-7249ed7e5e6a" (UID: "b9162b69-68e3-4026-a82b-7249ed7e5e6a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:32:56.682161 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.682134 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9162b69-68e3-4026-a82b-7249ed7e5e6a" (UID: "b9162b69-68e3-4026-a82b-7249ed7e5e6a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:32:56.682161 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.682122 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9162b69-68e3-4026-a82b-7249ed7e5e6a" (UID: "b9162b69-68e3-4026-a82b-7249ed7e5e6a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:32:56.682353 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.682333 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-kube-api-access-ln2j2" (OuterVolumeSpecName: "kube-api-access-ln2j2") pod "b9162b69-68e3-4026-a82b-7249ed7e5e6a" (UID: "b9162b69-68e3-4026-a82b-7249ed7e5e6a"). InnerVolumeSpecName "kube-api-access-ln2j2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:32:56.682398 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.682335 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9162b69-68e3-4026-a82b-7249ed7e5e6a" (UID: "b9162b69-68e3-4026-a82b-7249ed7e5e6a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:32:56.781171 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.781147 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:32:56.781171 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.781171 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:32:56.781321 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.781185 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:32:56.781321 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.781196 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:32:56.781321 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.781207 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:32:56.781321 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.781220 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:32:56.781321 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.781232 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln2j2\" (UniqueName: \"kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-kube-api-access-ln2j2\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:32:56.781321 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.781245 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9162b69-68e3-4026-a82b-7249ed7e5e6a-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:32:56.781321 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.781259 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9162b69-68e3-4026-a82b-7249ed7e5e6a-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:32:56.961285 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.961230 2576 generic.go:356] "Generic (PLEG): container finished" podID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerID="45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658" exitCode=0 Jul 09 19:32:56.961285 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.961273 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" Jul 09 19:32:56.961488 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.961297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" event={"ID":"b9162b69-68e3-4026-a82b-7249ed7e5e6a","Type":"ContainerDied","Data":"45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658"} Jul 09 19:32:56.961488 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.961334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw" event={"ID":"b9162b69-68e3-4026-a82b-7249ed7e5e6a","Type":"ContainerDied","Data":"3739a128dd9a36d917c35c2e994a154556a29c88e2118bad858d544bc7840bfd"} Jul 09 19:32:56.961488 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.961356 2576 scope.go:117] "RemoveContainer" containerID="45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658" Jul 09 19:32:56.972559 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.970040 2576 scope.go:117] "RemoveContainer" containerID="c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932" Jul 09 19:32:56.981418 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.981394 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw"] Jul 09 19:32:56.984255 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.984240 2576 scope.go:117] "RemoveContainer" containerID="45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658" Jul 09 19:32:56.984560 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:32:56.984540 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658\": container with ID starting with 45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658 not found: ID does not exist" containerID="45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658" Jul 09 19:32:56.984640 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.984571 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658"} err="failed to get container status \"45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658\": rpc error: code = NotFound desc = could not find container \"45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658\": container with ID starting with 45b33fd93a4645ba470895f002c21725174fa47a45a051fe4052d961cc718658 not found: ID does not exist" Jul 09 19:32:56.984640 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.984593 2576 scope.go:117] "RemoveContainer" containerID="c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932" Jul 09 19:32:56.984843 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:32:56.984825 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932\": container with ID starting with c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932 not found: ID does not exist" containerID="c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932" Jul 09 19:32:56.984881 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.984838 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-84e6af-openshift-default-5f494657-6sznw"] Jul 09 19:32:56.984881 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:56.984848 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932"} err="failed to get container status \"c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932\": rpc error: code = NotFound desc = could not find container \"c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932\": container with ID starting with c0d45cc976d06d606367237395b24e09e3f353af7b4655c9a6ab33189039c932 not found: ID does not exist" Jul 09 19:32:58.230665 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:58.230633 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt"] Jul 09 19:32:58.231074 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:58.230926 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" containerID="cri-o://eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8" gracePeriod=30 Jul 09 19:32:58.729101 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:58.729072 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" path="/var/lib/kubelet/pods/b9162b69-68e3-4026-a82b-7249ed7e5e6a/volumes" Jul 09 19:32:59.148860 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.148788 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7"] Jul 09 19:32:59.149082 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.149070 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" Jul 09 19:32:59.149082 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.149082 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" Jul 09 19:32:59.149191 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.149090 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" Jul 09 19:32:59.149191 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.149096 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" Jul 09 19:32:59.149191 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.149148 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" Jul 09 19:32:59.149191 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.149157 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9162b69-68e3-4026-a82b-7249ed7e5e6a" containerName="istio-proxy" Jul 09 19:32:59.153417 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.153398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.157187 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.157169 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-96cd7e-openshift-default-dockercfg-m5vtc\"" Jul 09 19:32:59.167958 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.167934 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7"] Jul 09 19:32:59.300595 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.300557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-credential-socket\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.300955 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.300603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-envoy\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.300955 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.300622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-podinfo\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.300955 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.300682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaae450a-7899-4fce-8b25-93edbf70bb26-istiod-ca-cert\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.300955 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.300741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-data\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.300955 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.300772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-certs\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.300955 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.300816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nwp5\" (UniqueName: \"kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-kube-api-access-6nwp5\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.300955 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.300837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-socket\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.300955 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.300865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-token\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402000 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.401936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-credential-socket\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402000 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.401970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-envoy\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402000 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.401989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-podinfo\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402235 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaae450a-7899-4fce-8b25-93edbf70bb26-istiod-ca-cert\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402235 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-data\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402235 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-certs\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402235 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nwp5\" (UniqueName: \"kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-kube-api-access-6nwp5\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402436 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-socket\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402436 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-token\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402436 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402384 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-credential-socket\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402754 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402726 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-data\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402874 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402755 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-certs\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402874 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaae450a-7899-4fce-8b25-93edbf70bb26-istiod-ca-cert\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.402978 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.402954 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-socket\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.404467 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.404436 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-envoy\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.404786 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.404769 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-podinfo\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.412005 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.411978 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nwp5\" (UniqueName: \"kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-kube-api-access-6nwp5\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.412218 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.412199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-token\") pod \"e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.464188 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.464167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:32:59.607607 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.607584 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7"] Jul 09 19:32:59.609592 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:32:59.609563 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaae450a_7899_4fce_8b25_93edbf70bb26.slice/crio-81a97bcd16f5b25b3900a201ea0d76cb61b72cc968cb6ab38607e926adb92e18 WatchSource:0}: Error finding container 81a97bcd16f5b25b3900a201ea0d76cb61b72cc968cb6ab38607e926adb92e18: Status 404 returned error can't find the container with id 81a97bcd16f5b25b3900a201ea0d76cb61b72cc968cb6ab38607e926adb92e18 Jul 09 19:32:59.611578 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.611550 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:32:59.611625 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.611617 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:32:59.611662 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.611646 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:32:59.800868 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.800828 2576 patch_prober.go:28] interesting pod/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 19:32:59.801017 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.800880 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 19:32:59.976176 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.976147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" event={"ID":"eaae450a-7899-4fce-8b25-93edbf70bb26","Type":"ContainerStarted","Data":"60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7"} Jul 09 19:32:59.976325 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:32:59.976196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" event={"ID":"eaae450a-7899-4fce-8b25-93edbf70bb26","Type":"ContainerStarted","Data":"81a97bcd16f5b25b3900a201ea0d76cb61b72cc968cb6ab38607e926adb92e18"} Jul 09 19:33:00.006304 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:00.006253 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" podStartSLOduration=1.006233167 podStartE2EDuration="1.006233167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:33:00.003581019 +0000 UTC m=+2023.786988783" watchObservedRunningTime="2026-07-09 19:33:00.006233167 +0000 UTC m=+2023.789640936" Jul 09 19:33:00.464614 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:00.464587 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:33:00.469414 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:00.469396 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:33:00.980239 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:00.980208 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:33:00.981028 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:00.981007 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:33:03.489699 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.489639 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:33:03.536315 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536290 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-credential-socket\") pod \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " Jul 09 19:33:03.536434 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536321 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-podinfo\") pod \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " Jul 09 19:33:03.536434 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536362 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istiod-ca-cert\") pod \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " Jul 09 19:33:03.536434 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536392 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-socket\") pod \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " Jul 09 19:33:03.536434 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536413 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-certs\") pod \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " Jul 09 19:33:03.536653 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536546 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dz6f\" (UniqueName: \"kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-kube-api-access-4dz6f\") pod \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " Jul 09 19:33:03.536653 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536564 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce886ec4-2739-4167-9cb0-81a0b001c7f6" (UID: "ce886ec4-2739-4167-9cb0-81a0b001c7f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:03.536653 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536604 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-token\") pod \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " Jul 09 19:33:03.536653 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536636 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-data\") pod \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " Jul 09 19:33:03.536837 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536664 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-envoy\") pod \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\" (UID: \"ce886ec4-2739-4167-9cb0-81a0b001c7f6\") " Jul 09 19:33:03.536837 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536698 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce886ec4-2739-4167-9cb0-81a0b001c7f6" (UID: "ce886ec4-2739-4167-9cb0-81a0b001c7f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:03.536837 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536715 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce886ec4-2739-4167-9cb0-81a0b001c7f6" (UID: "ce886ec4-2739-4167-9cb0-81a0b001c7f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:03.536986 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536889 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce886ec4-2739-4167-9cb0-81a0b001c7f6" (UID: "ce886ec4-2739-4167-9cb0-81a0b001c7f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:33:03.537056 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.536984 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:03.537056 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.537002 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:03.537056 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.537016 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:03.537056 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.537029 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:03.537428 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.537402 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce886ec4-2739-4167-9cb0-81a0b001c7f6" (UID: "ce886ec4-2739-4167-9cb0-81a0b001c7f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:03.538626 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.538598 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce886ec4-2739-4167-9cb0-81a0b001c7f6" (UID: "ce886ec4-2739-4167-9cb0-81a0b001c7f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:33:03.538743 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.538665 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-kube-api-access-4dz6f" (OuterVolumeSpecName: "kube-api-access-4dz6f") pod "ce886ec4-2739-4167-9cb0-81a0b001c7f6" (UID: "ce886ec4-2739-4167-9cb0-81a0b001c7f6"). InnerVolumeSpecName "kube-api-access-4dz6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:33:03.538743 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.538674 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce886ec4-2739-4167-9cb0-81a0b001c7f6" (UID: "ce886ec4-2739-4167-9cb0-81a0b001c7f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:03.538852 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.538790 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce886ec4-2739-4167-9cb0-81a0b001c7f6" (UID: "ce886ec4-2739-4167-9cb0-81a0b001c7f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:33:03.637480 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.637449 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:03.637480 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.637475 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dz6f\" (UniqueName: \"kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-kube-api-access-4dz6f\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:03.637480 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.637487 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:03.637735 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.637516 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:03.637735 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.637526 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce886ec4-2739-4167-9cb0-81a0b001c7f6-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:03.994907 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.994872 2576 generic.go:356] "Generic (PLEG): container finished" podID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerID="eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8" exitCode=0 Jul 09 19:33:03.995065 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.994927 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" Jul 09 19:33:03.995065 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.994946 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" event={"ID":"ce886ec4-2739-4167-9cb0-81a0b001c7f6","Type":"ContainerDied","Data":"eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8"} Jul 09 19:33:03.995065 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.994999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt" event={"ID":"ce886ec4-2739-4167-9cb0-81a0b001c7f6","Type":"ContainerDied","Data":"e52ce95e1e6f8e3f88e06e886222ed3e91b086d49446fa022e109f1e32d6e232"} Jul 09 19:33:03.995065 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:03.995029 2576 scope.go:117] "RemoveContainer" containerID="eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8" Jul 09 19:33:04.003406 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:04.003389 2576 scope.go:117] "RemoveContainer" containerID="e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4" Jul 09 19:33:04.010721 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:04.010706 2576 scope.go:117] "RemoveContainer" containerID="eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8" Jul 09 19:33:04.010961 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:33:04.010943 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8\": container with ID starting with eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8 not found: ID does not exist" containerID="eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8" Jul 09 19:33:04.011009 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:04.010970 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8"} err="failed to get container status \"eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8\": rpc error: code = NotFound desc = could not find container \"eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8\": container with ID starting with eeb55d054758149be50358515ceb228526518f806eb273b9e8d4f4b60668a4d8 not found: ID does not exist" Jul 09 19:33:04.011009 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:04.010986 2576 scope.go:117] "RemoveContainer" containerID="e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4" Jul 09 19:33:04.011198 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:33:04.011179 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4\": container with ID starting with e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4 not found: ID does not exist" containerID="e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4" Jul 09 19:33:04.011249 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:04.011207 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4"} err="failed to get container status \"e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4\": rpc error: code = NotFound desc = could not find container \"e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4\": container with ID starting with e6fbe810fbe2f239ec4869a183cdc711bf13e53b8c6ae67faf5c0870b4a71ae4 not found: ID does not exist" Jul 09 19:33:04.018340 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:04.018320 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt"] Jul 09 19:33:04.024824 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:04.024796 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4038d9-openshift-default-79455d467f-zcqpt"] Jul 09 19:33:04.729005 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:04.728972 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" path="/var/lib/kubelet/pods/ce886ec4-2739-4167-9cb0-81a0b001c7f6/volumes" Jul 09 19:33:07.175081 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.175049 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98"] Jul 09 19:33:07.175570 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.175554 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" Jul 09 19:33:07.175624 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.175573 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" Jul 09 19:33:07.175624 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.175599 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" Jul 09 19:33:07.175624 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.175608 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" Jul 09 19:33:07.175729 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.175676 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" Jul 09 19:33:07.175729 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.175691 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce886ec4-2739-4167-9cb0-81a0b001c7f6" containerName="istio-proxy" Jul 09 19:33:07.180235 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.180217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.183118 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.183100 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9694bb-openshift-default-dockercfg-jd8kr\"" Jul 09 19:33:07.189526 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.189484 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98"] Jul 09 19:33:07.263234 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.263194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-credential-socket\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.263234 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.263237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-certs\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.263234 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.263278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s8m9\" (UniqueName: \"kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-kube-api-access-9s8m9\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.263234 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.263315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-data\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.263234 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.263356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/475e23f4-aca8-444f-bd29-48af900a1736-istio-podinfo\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.263234 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.263393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-envoy\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.263234 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.263422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-istio-token\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.263234 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.263470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/475e23f4-aca8-444f-bd29-48af900a1736-istiod-ca-cert\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.263234 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.263529 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-socket\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.363974 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.363946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-credential-socket\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364161 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.363978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-certs\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364161 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8m9\" (UniqueName: \"kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-kube-api-access-9s8m9\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364161 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-data\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364161 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/475e23f4-aca8-444f-bd29-48af900a1736-istio-podinfo\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364161 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-envoy\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364433 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-istio-token\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364433 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/475e23f4-aca8-444f-bd29-48af900a1736-istiod-ca-cert\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364433 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-socket\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364433 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364401 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-credential-socket\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364679 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364430 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-certs\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364679 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364663 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-socket\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.364783 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.364719 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-data\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.365154 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.365125 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/475e23f4-aca8-444f-bd29-48af900a1736-istiod-ca-cert\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.366751 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.366720 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-envoy\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.366879 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.366862 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/475e23f4-aca8-444f-bd29-48af900a1736-istio-podinfo\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.372243 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.372224 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s8m9\" (UniqueName: \"kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-kube-api-access-9s8m9\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.372596 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.372577 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-istio-token\") pod \"e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.491512 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.491429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:07.621581 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.621559 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98"] Jul 09 19:33:07.623391 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:33:07.623363 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475e23f4_aca8_444f_bd29_48af900a1736.slice/crio-48dcbbc65a82fecb8f33b9bf0e3ac3837b53bfe1bb6568093d547d955000be8c WatchSource:0}: Error finding container 48dcbbc65a82fecb8f33b9bf0e3ac3837b53bfe1bb6568093d547d955000be8c: Status 404 returned error can't find the container with id 48dcbbc65a82fecb8f33b9bf0e3ac3837b53bfe1bb6568093d547d955000be8c Jul 09 19:33:07.625458 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.625422 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:07.625583 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.625486 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:07.625583 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:07.625529 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:08.020259 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:08.020229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" event={"ID":"475e23f4-aca8-444f-bd29-48af900a1736","Type":"ContainerStarted","Data":"fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61"} Jul 09 19:33:08.020422 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:08.020282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" event={"ID":"475e23f4-aca8-444f-bd29-48af900a1736","Type":"ContainerStarted","Data":"48dcbbc65a82fecb8f33b9bf0e3ac3837b53bfe1bb6568093d547d955000be8c"} Jul 09 19:33:08.041351 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:08.041303 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" podStartSLOduration=1.041288531 podStartE2EDuration="1.041288531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:33:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:33:08.039324382 +0000 UTC m=+2031.822732169" watchObservedRunningTime="2026-07-09 19:33:08.041288531 +0000 UTC m=+2031.824696295" Jul 09 19:33:08.492113 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:08.492087 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:08.496303 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:08.496285 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:09.024455 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:09.024427 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:09.025446 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:09.025428 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:17.021708 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:17.021613 2576 patch_prober.go:28] interesting pod/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 19:33:17.021708 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:17.021676 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 19:33:19.082184 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:19.082141 2576 generic.go:356] "Generic (PLEG): container finished" podID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerID="60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7" exitCode=0 Jul 09 19:33:19.082728 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:19.082241 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" event={"ID":"eaae450a-7899-4fce-8b25-93edbf70bb26","Type":"ContainerDied","Data":"60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7"} Jul 09 19:33:19.082795 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:19.082744 2576 scope.go:117] "RemoveContainer" containerID="60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7" Jul 09 19:33:19.084028 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:19.083987 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:19.084127 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:19.084080 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:19.084190 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:19.084136 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:20.095076 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:20.095032 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" event={"ID":"eaae450a-7899-4fce-8b25-93edbf70bb26","Type":"ContainerStarted","Data":"2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c"} Jul 09 19:33:20.465114 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:20.465082 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:33:20.465443 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:20.465422 2576 patch_prober.go:28] interesting pod/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 09 19:33:20.465694 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:20.465668 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 09 19:33:21.465229 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:21.464766 2576 patch_prober.go:28] interesting pod/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 09 19:33:21.465229 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:21.464833 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 09 19:33:22.465594 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:22.465556 2576 patch_prober.go:28] interesting pod/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 09 19:33:22.466048 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:22.465618 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 09 19:33:23.465250 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:23.465208 2576 patch_prober.go:28] interesting pod/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 09 19:33:23.465449 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:23.465279 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 09 19:33:24.468109 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:24.468079 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:33:24.468584 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:24.468460 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:33:24.469211 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:24.469194 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:33:25.065654 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:25.065614 2576 patch_prober.go:28] interesting pod/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 19:33:25.065817 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:25.065678 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 19:33:26.125707 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:26.125674 2576 generic.go:356] "Generic (PLEG): container finished" podID="475e23f4-aca8-444f-bd29-48af900a1736" containerID="fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61" exitCode=0 Jul 09 19:33:26.126225 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:26.125760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" event={"ID":"475e23f4-aca8-444f-bd29-48af900a1736","Type":"ContainerDied","Data":"fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61"} Jul 09 19:33:26.126225 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:26.126196 2576 scope.go:117] "RemoveContainer" containerID="fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61" Jul 09 19:33:26.127187 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:26.127162 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:26.127252 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:26.127232 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:26.127290 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:26.127267 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:27.132004 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:27.131973 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" event={"ID":"475e23f4-aca8-444f-bd29-48af900a1736","Type":"ContainerStarted","Data":"1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096"} Jul 09 19:33:27.492645 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:27.492611 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:27.492872 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:27.492848 2576 patch_prober.go:28] interesting pod/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 09 19:33:27.492935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:27.492917 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 09 19:33:28.492378 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:28.492336 2576 patch_prober.go:28] interesting pod/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 09 19:33:28.492851 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:28.492396 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 09 19:33:29.249818 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:29.249784 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7"] Jul 09 19:33:29.250031 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:29.250008 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" containerID="cri-o://2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c" gracePeriod=30 Jul 09 19:33:29.492843 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:29.492809 2576 patch_prober.go:28] interesting pod/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 09 19:33:29.493220 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:29.492864 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 09 19:33:30.493749 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:30.493712 2576 patch_prober.go:28] interesting pod/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 09 19:33:30.494293 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:30.494261 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 09 19:33:31.495401 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:31.495372 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:31.495782 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:31.495729 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:31.496425 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:31.496406 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:34.501673 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.501652 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:33:34.613196 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613139 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-envoy\") pod \"eaae450a-7899-4fce-8b25-93edbf70bb26\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " Jul 09 19:33:34.613196 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613169 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-token\") pod \"eaae450a-7899-4fce-8b25-93edbf70bb26\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " Jul 09 19:33:34.613196 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613193 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-podinfo\") pod \"eaae450a-7899-4fce-8b25-93edbf70bb26\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " Jul 09 19:33:34.613416 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613232 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-socket\") pod \"eaae450a-7899-4fce-8b25-93edbf70bb26\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " Jul 09 19:33:34.613416 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613366 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-credential-socket\") pod \"eaae450a-7899-4fce-8b25-93edbf70bb26\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " Jul 09 19:33:34.613547 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613453 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-certs\") pod \"eaae450a-7899-4fce-8b25-93edbf70bb26\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " Jul 09 19:33:34.613547 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613480 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eaae450a-7899-4fce-8b25-93edbf70bb26" (UID: "eaae450a-7899-4fce-8b25-93edbf70bb26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:34.613547 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613510 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-data\") pod \"eaae450a-7899-4fce-8b25-93edbf70bb26\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " Jul 09 19:33:34.613547 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613543 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaae450a-7899-4fce-8b25-93edbf70bb26-istiod-ca-cert\") pod \"eaae450a-7899-4fce-8b25-93edbf70bb26\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " Jul 09 19:33:34.613754 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613586 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nwp5\" (UniqueName: \"kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-kube-api-access-6nwp5\") pod \"eaae450a-7899-4fce-8b25-93edbf70bb26\" (UID: \"eaae450a-7899-4fce-8b25-93edbf70bb26\") " Jul 09 19:33:34.613754 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613655 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eaae450a-7899-4fce-8b25-93edbf70bb26" (UID: "eaae450a-7899-4fce-8b25-93edbf70bb26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:34.613754 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613731 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eaae450a-7899-4fce-8b25-93edbf70bb26" (UID: "eaae450a-7899-4fce-8b25-93edbf70bb26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:34.613943 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613925 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:34.614021 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613944 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:34.614021 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.613958 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:34.614128 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.614029 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaae450a-7899-4fce-8b25-93edbf70bb26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eaae450a-7899-4fce-8b25-93edbf70bb26" (UID: "eaae450a-7899-4fce-8b25-93edbf70bb26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:33:34.614397 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.614368 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-data" (OuterVolumeSpecName: "istio-data") pod "eaae450a-7899-4fce-8b25-93edbf70bb26" (UID: "eaae450a-7899-4fce-8b25-93edbf70bb26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:34.615416 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.615387 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eaae450a-7899-4fce-8b25-93edbf70bb26" (UID: "eaae450a-7899-4fce-8b25-93edbf70bb26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:34.615416 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.615387 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eaae450a-7899-4fce-8b25-93edbf70bb26" (UID: "eaae450a-7899-4fce-8b25-93edbf70bb26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:33:34.615593 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.615480 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-token" (OuterVolumeSpecName: "istio-token") pod "eaae450a-7899-4fce-8b25-93edbf70bb26" (UID: "eaae450a-7899-4fce-8b25-93edbf70bb26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:33:34.615718 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.615702 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-kube-api-access-6nwp5" (OuterVolumeSpecName: "kube-api-access-6nwp5") pod "eaae450a-7899-4fce-8b25-93edbf70bb26" (UID: "eaae450a-7899-4fce-8b25-93edbf70bb26"). InnerVolumeSpecName "kube-api-access-6nwp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:33:34.714552 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.714527 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:34.714552 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.714549 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaae450a-7899-4fce-8b25-93edbf70bb26-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:34.714729 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.714558 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nwp5\" (UniqueName: \"kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-kube-api-access-6nwp5\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:34.714729 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.714566 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:34.714729 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.714576 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:34.714729 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:34.714587 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaae450a-7899-4fce-8b25-93edbf70bb26-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:35.168458 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.168425 2576 generic.go:356] "Generic (PLEG): container finished" podID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerID="2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c" exitCode=0 Jul 09 19:33:35.168637 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.168470 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" Jul 09 19:33:35.168637 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.168526 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" event={"ID":"eaae450a-7899-4fce-8b25-93edbf70bb26","Type":"ContainerDied","Data":"2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c"} Jul 09 19:33:35.168637 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.168580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7" event={"ID":"eaae450a-7899-4fce-8b25-93edbf70bb26","Type":"ContainerDied","Data":"81a97bcd16f5b25b3900a201ea0d76cb61b72cc968cb6ab38607e926adb92e18"} Jul 09 19:33:35.168637 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.168609 2576 scope.go:117] "RemoveContainer" containerID="2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c" Jul 09 19:33:35.177014 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.176994 2576 scope.go:117] "RemoveContainer" containerID="60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7" Jul 09 19:33:35.184163 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.184147 2576 scope.go:117] "RemoveContainer" containerID="2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c" Jul 09 19:33:35.184432 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:33:35.184414 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c\": container with ID starting with 2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c not found: ID does not exist" containerID="2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c" Jul 09 19:33:35.184475 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.184440 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c"} err="failed to get container status \"2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c\": rpc error: code = NotFound desc = could not find container \"2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c\": container with ID starting with 2d9ef00e3fb70366f4a181f45e6e43efd78eb647e68d8d34ebc3f2dc0f55674c not found: ID does not exist" Jul 09 19:33:35.184475 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.184458 2576 scope.go:117] "RemoveContainer" containerID="60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7" Jul 09 19:33:35.184711 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:33:35.184693 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7\": container with ID starting with 60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7 not found: ID does not exist" containerID="60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7" Jul 09 19:33:35.184755 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.184717 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7"} err="failed to get container status \"60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7\": rpc error: code = NotFound desc = could not find container \"60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7\": container with ID starting with 60c9a1aa787bc4a31cd604d1aa184a1eadd328a2e6143d544837b66d7e5172c7 not found: ID does not exist" Jul 09 19:33:35.203705 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.203682 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7"] Jul 09 19:33:35.214727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:35.214705 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-96cd7e-openshift-default-5b5cb966f9-2fmj7"] Jul 09 19:33:36.539771 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:36.539740 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98"] Jul 09 19:33:36.540228 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:36.539960 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" containerID="cri-o://1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096" gracePeriod=30 Jul 09 19:33:36.730207 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:36.730176 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" path="/var/lib/kubelet/pods/eaae450a-7899-4fce-8b25-93edbf70bb26/volumes" Jul 09 19:33:37.391182 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.391151 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq"] Jul 09 19:33:37.391483 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.391461 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" Jul 09 19:33:37.391483 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.391478 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" Jul 09 19:33:37.391761 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.391513 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" Jul 09 19:33:37.391761 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.391522 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" Jul 09 19:33:37.391761 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.391584 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" Jul 09 19:33:37.396419 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.396401 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.401937 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.401921 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c8412b-openshift-default-dockercfg-5wjf8\"" Jul 09 19:33:37.411068 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.411045 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq"] Jul 09 19:33:37.535326 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.535292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-credential-socket\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.535530 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.535345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-envoy\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.535530 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.535419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-socket\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.535530 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.535448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e44f15b-1acb-4779-9d36-11061b9d92fd-istiod-ca-cert\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.535530 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.535475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-token\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.535530 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.535517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-data\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.535718 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.535559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5hr6\" (UniqueName: \"kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-kube-api-access-x5hr6\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.535718 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.535615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-certs\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.535718 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.535643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-podinfo\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.636564 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.636532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-socket\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.636991 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.636567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e44f15b-1acb-4779-9d36-11061b9d92fd-istiod-ca-cert\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.636991 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.636597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-token\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.636991 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.636628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-data\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.636991 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.636656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5hr6\" (UniqueName: \"kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-kube-api-access-x5hr6\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.636991 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.636710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-certs\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.636991 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.636839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-podinfo\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.636991 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.636896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-credential-socket\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.636991 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.636958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-envoy\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.637302 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.636988 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-socket\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.637302 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.637012 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-data\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.637302 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.637155 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-certs\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.637435 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.637423 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e44f15b-1acb-4779-9d36-11061b9d92fd-istiod-ca-cert\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.637482 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.637423 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-credential-socket\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.639136 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.639115 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-envoy\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.639283 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.639265 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-podinfo\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.645078 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.645020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-token\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.645162 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.645104 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5hr6\" (UniqueName: \"kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-kube-api-access-x5hr6\") pod \"e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.706853 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.706831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:37.838274 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.838249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq"] Jul 09 19:33:37.840136 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:33:37.840111 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e44f15b_1acb_4779_9d36_11061b9d92fd.slice/crio-6cc970b600bb8b4ab4e315382bea38351b972121838884bb86e6927a5bd09270 WatchSource:0}: Error finding container 6cc970b600bb8b4ab4e315382bea38351b972121838884bb86e6927a5bd09270: Status 404 returned error can't find the container with id 6cc970b600bb8b4ab4e315382bea38351b972121838884bb86e6927a5bd09270 Jul 09 19:33:37.842301 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.842268 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:37.842371 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.842328 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:37.842371 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:37.842353 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:38.183460 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:38.183426 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" event={"ID":"9e44f15b-1acb-4779-9d36-11061b9d92fd","Type":"ContainerStarted","Data":"e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033"} Jul 09 19:33:38.183921 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:38.183482 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" event={"ID":"9e44f15b-1acb-4779-9d36-11061b9d92fd","Type":"ContainerStarted","Data":"6cc970b600bb8b4ab4e315382bea38351b972121838884bb86e6927a5bd09270"} Jul 09 19:33:38.203245 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:38.203191 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" podStartSLOduration=1.203174847 podStartE2EDuration="1.203174847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:33:38.201799079 +0000 UTC m=+2061.985206908" watchObservedRunningTime="2026-07-09 19:33:38.203174847 +0000 UTC m=+2061.986582612" Jul 09 19:33:38.707838 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:38.707815 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:38.712550 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:38.712530 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:39.187393 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:39.187369 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:39.188219 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:39.188201 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:41.782327 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.782305 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:41.879024 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.878954 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s8m9\" (UniqueName: \"kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-kube-api-access-9s8m9\") pod \"475e23f4-aca8-444f-bd29-48af900a1736\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " Jul 09 19:33:41.879024 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.878994 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-certs\") pod \"475e23f4-aca8-444f-bd29-48af900a1736\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " Jul 09 19:33:41.879024 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.879017 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-data\") pod \"475e23f4-aca8-444f-bd29-48af900a1736\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " Jul 09 19:33:41.879249 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.879036 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-istio-token\") pod \"475e23f4-aca8-444f-bd29-48af900a1736\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " Jul 09 19:33:41.879249 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.879052 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/475e23f4-aca8-444f-bd29-48af900a1736-istiod-ca-cert\") pod \"475e23f4-aca8-444f-bd29-48af900a1736\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " Jul 09 19:33:41.879249 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.879081 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-envoy\") pod \"475e23f4-aca8-444f-bd29-48af900a1736\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " Jul 09 19:33:41.879249 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.879174 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/475e23f4-aca8-444f-bd29-48af900a1736-istio-podinfo\") pod \"475e23f4-aca8-444f-bd29-48af900a1736\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " Jul 09 19:33:41.879249 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.879214 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-socket\") pod \"475e23f4-aca8-444f-bd29-48af900a1736\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " Jul 09 19:33:41.879249 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.879237 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-credential-socket\") pod \"475e23f4-aca8-444f-bd29-48af900a1736\" (UID: \"475e23f4-aca8-444f-bd29-48af900a1736\") " Jul 09 19:33:41.880319 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.879235 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "475e23f4-aca8-444f-bd29-48af900a1736" (UID: "475e23f4-aca8-444f-bd29-48af900a1736"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:41.880319 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.879584 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "475e23f4-aca8-444f-bd29-48af900a1736" (UID: "475e23f4-aca8-444f-bd29-48af900a1736"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:41.880473 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.879974 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-data" (OuterVolumeSpecName: "istio-data") pod "475e23f4-aca8-444f-bd29-48af900a1736" (UID: "475e23f4-aca8-444f-bd29-48af900a1736"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:41.880473 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.880081 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/475e23f4-aca8-444f-bd29-48af900a1736-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "475e23f4-aca8-444f-bd29-48af900a1736" (UID: "475e23f4-aca8-444f-bd29-48af900a1736"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:33:41.880619 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.880534 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "475e23f4-aca8-444f-bd29-48af900a1736" (UID: "475e23f4-aca8-444f-bd29-48af900a1736"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:41.881224 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.881197 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-kube-api-access-9s8m9" (OuterVolumeSpecName: "kube-api-access-9s8m9") pod "475e23f4-aca8-444f-bd29-48af900a1736" (UID: "475e23f4-aca8-444f-bd29-48af900a1736"). InnerVolumeSpecName "kube-api-access-9s8m9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:33:41.881378 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.881361 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-istio-token" (OuterVolumeSpecName: "istio-token") pod "475e23f4-aca8-444f-bd29-48af900a1736" (UID: "475e23f4-aca8-444f-bd29-48af900a1736"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:33:41.881429 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.881397 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "475e23f4-aca8-444f-bd29-48af900a1736" (UID: "475e23f4-aca8-444f-bd29-48af900a1736"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:33:41.881466 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.881442 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/475e23f4-aca8-444f-bd29-48af900a1736-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "475e23f4-aca8-444f-bd29-48af900a1736" (UID: "475e23f4-aca8-444f-bd29-48af900a1736"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:33:41.980581 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.980550 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/475e23f4-aca8-444f-bd29-48af900a1736-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:41.980581 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.980581 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:41.980727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.980596 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:41.980727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.980609 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s8m9\" (UniqueName: \"kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-kube-api-access-9s8m9\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:41.980727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.980622 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:41.980727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.980634 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:41.980727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.980645 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/475e23f4-aca8-444f-bd29-48af900a1736-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:41.980727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.980658 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/475e23f4-aca8-444f-bd29-48af900a1736-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:41.980727 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:41.980670 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/475e23f4-aca8-444f-bd29-48af900a1736-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:33:42.204180 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.204153 2576 generic.go:356] "Generic (PLEG): container finished" podID="475e23f4-aca8-444f-bd29-48af900a1736" containerID="1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096" exitCode=0 Jul 09 19:33:42.204319 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.204196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" event={"ID":"475e23f4-aca8-444f-bd29-48af900a1736","Type":"ContainerDied","Data":"1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096"} Jul 09 19:33:42.204319 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.204233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" event={"ID":"475e23f4-aca8-444f-bd29-48af900a1736","Type":"ContainerDied","Data":"48dcbbc65a82fecb8f33b9bf0e3ac3837b53bfe1bb6568093d547d955000be8c"} Jul 09 19:33:42.204319 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.204254 2576 scope.go:117] "RemoveContainer" containerID="1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096" Jul 09 19:33:42.204319 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.204197 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98" Jul 09 19:33:42.212672 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.212657 2576 scope.go:117] "RemoveContainer" containerID="fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61" Jul 09 19:33:42.219950 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.219933 2576 scope.go:117] "RemoveContainer" containerID="1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096" Jul 09 19:33:42.220229 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:33:42.220210 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096\": container with ID starting with 1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096 not found: ID does not exist" containerID="1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096" Jul 09 19:33:42.220291 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.220237 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096"} err="failed to get container status \"1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096\": rpc error: code = NotFound desc = could not find container \"1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096\": container with ID starting with 1f88c5ace6032150384b27b8fd60f7f579b58ee77fe7aace62e7cafb41142096 not found: ID does not exist" Jul 09 19:33:42.220291 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.220254 2576 scope.go:117] "RemoveContainer" containerID="fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61" Jul 09 19:33:42.220481 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:33:42.220464 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61\": container with ID starting with fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61 not found: ID does not exist" containerID="fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61" Jul 09 19:33:42.220552 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.220486 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61"} err="failed to get container status \"fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61\": rpc error: code = NotFound desc = could not find container \"fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61\": container with ID starting with fd9e71e390500791e9509b7e4ea5d37a1850e52446838dffdf4e3a21dc159c61 not found: ID does not exist" Jul 09 19:33:42.226216 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.226198 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98"] Jul 09 19:33:42.229328 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.229306 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9694bb-openshift-default-79577bb97c-rmr98"] Jul 09 19:33:42.728764 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:42.728731 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="475e23f4-aca8-444f-bd29-48af900a1736" path="/var/lib/kubelet/pods/475e23f4-aca8-444f-bd29-48af900a1736/volumes" Jul 09 19:33:45.171410 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.171370 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf"] Jul 09 19:33:45.171908 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.171812 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" Jul 09 19:33:45.171908 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.171830 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" Jul 09 19:33:45.172027 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.171923 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" Jul 09 19:33:45.172027 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.171934 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" Jul 09 19:33:45.172027 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.171945 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaae450a-7899-4fce-8b25-93edbf70bb26" containerName="istio-proxy" Jul 09 19:33:45.176542 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.176511 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.179578 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.179557 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a94244-openshift-default-dockercfg-5nnjf\"" Jul 09 19:33:45.187934 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.187914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf"] Jul 09 19:33:45.305410 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.305376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-istio-token\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.305410 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.305411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-data\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.305694 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.305440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847162a8-0117-4a52-9870-8c3b96381c1c-istio-podinfo\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.305694 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.305558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-credential-socket\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.305694 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.305597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847162a8-0117-4a52-9870-8c3b96381c1c-istiod-ca-cert\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.305694 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.305621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-socket\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.305694 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.305647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-certs\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.305963 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.305738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-envoy\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.305963 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.305778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mhhr\" (UniqueName: \"kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-kube-api-access-5mhhr\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.406894 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.406864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mhhr\" (UniqueName: \"kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-kube-api-access-5mhhr\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407044 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.406901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-istio-token\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407044 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.406919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-data\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407131 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847162a8-0117-4a52-9870-8c3b96381c1c-istio-podinfo\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407182 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-credential-socket\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407233 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407189 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-data\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407233 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847162a8-0117-4a52-9870-8c3b96381c1c-istiod-ca-cert\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407335 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-socket\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407335 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-certs\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407444 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-envoy\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407535 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407438 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-credential-socket\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407633 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407617 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-socket\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407721 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-certs\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.407809 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.407792 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847162a8-0117-4a52-9870-8c3b96381c1c-istiod-ca-cert\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.409466 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.409446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-envoy\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.409587 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.409571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847162a8-0117-4a52-9870-8c3b96381c1c-istio-podinfo\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.415689 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.415664 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-istio-token\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.415969 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.415947 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mhhr\" (UniqueName: \"kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-kube-api-access-5mhhr\") pod \"e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.486978 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.486949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:45.620068 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.620038 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf"] Jul 09 19:33:45.624972 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:33:45.624950 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847162a8_0117_4a52_9870_8c3b96381c1c.slice/crio-fefb6ee26184ec9892e987ed07a9f9980f46dfe42fc375fa31367f1ad4077209 WatchSource:0}: Error finding container fefb6ee26184ec9892e987ed07a9f9980f46dfe42fc375fa31367f1ad4077209: Status 404 returned error can't find the container with id fefb6ee26184ec9892e987ed07a9f9980f46dfe42fc375fa31367f1ad4077209 Jul 09 19:33:45.626819 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.626783 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:45.626914 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.626845 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:45.626914 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:45.626872 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:46.224588 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:46.224553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" event={"ID":"847162a8-0117-4a52-9870-8c3b96381c1c","Type":"ContainerStarted","Data":"47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217"} Jul 09 19:33:46.225004 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:46.224607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" event={"ID":"847162a8-0117-4a52-9870-8c3b96381c1c","Type":"ContainerStarted","Data":"fefb6ee26184ec9892e987ed07a9f9980f46dfe42fc375fa31367f1ad4077209"} Jul 09 19:33:46.246611 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:46.246560 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" podStartSLOduration=1.246542767 podStartE2EDuration="1.246542767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:33:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:33:46.245642368 +0000 UTC m=+2070.029050134" watchObservedRunningTime="2026-07-09 19:33:46.246542767 +0000 UTC m=+2070.029950533" Jul 09 19:33:46.487915 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:46.487842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:46.489031 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:46.489010 2576 patch_prober.go:28] interesting pod/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 09 19:33:46.489128 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:46.489065 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 09 19:33:47.491994 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:47.491965 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:48.234211 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:48.234187 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:48.235114 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:48.235088 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:33:54.188976 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:54.188944 2576 patch_prober.go:28] interesting pod/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 09 19:33:54.189386 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:54.189011 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 09 19:33:54.263356 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:54.263321 2576 generic.go:356] "Generic (PLEG): container finished" podID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerID="e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033" exitCode=0 Jul 09 19:33:54.263534 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:54.263450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" event={"ID":"9e44f15b-1acb-4779-9d36-11061b9d92fd","Type":"ContainerDied","Data":"e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033"} Jul 09 19:33:54.263935 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:54.263914 2576 scope.go:117] "RemoveContainer" containerID="e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033" Jul 09 19:33:54.265249 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:54.265210 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:54.265352 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:54.265312 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:54.265420 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:54.265390 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:33:55.273596 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:55.272746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" event={"ID":"9e44f15b-1acb-4779-9d36-11061b9d92fd","Type":"ContainerStarted","Data":"3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e"} Jul 09 19:33:55.706997 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:55.706955 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:33:55.707163 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:55.707119 2576 patch_prober.go:28] interesting pod/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 09 19:33:55.707210 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:55.707172 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 09 19:33:56.707911 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:56.707826 2576 patch_prober.go:28] interesting pod/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 09 19:33:56.707911 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:56.707877 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 09 19:33:57.708268 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:57.708227 2576 patch_prober.go:28] interesting pod/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 09 19:33:57.708769 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:57.708296 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 09 19:33:58.707288 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:58.707247 2576 patch_prober.go:28] interesting pod/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 09 19:33:58.707524 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:58.707306 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 09 19:33:59.707967 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:59.707939 2576 patch_prober.go:28] interesting pod/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 09 19:33:59.708391 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:33:59.707998 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 09 19:34:00.302664 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:00.302634 2576 generic.go:356] "Generic (PLEG): container finished" podID="847162a8-0117-4a52-9870-8c3b96381c1c" containerID="47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217" exitCode=0 Jul 09 19:34:00.302826 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:00.302705 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" event={"ID":"847162a8-0117-4a52-9870-8c3b96381c1c","Type":"ContainerDied","Data":"47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217"} Jul 09 19:34:00.303059 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:00.303043 2576 scope.go:117] "RemoveContainer" containerID="47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217" Jul 09 19:34:00.304020 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:00.303995 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:34:00.304081 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:00.304055 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:34:00.304118 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:00.304086 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 09 19:34:00.710951 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:00.710924 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:34:00.711398 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:00.711307 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:34:00.711907 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:00.711888 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:34:01.309115 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:01.309080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" event={"ID":"847162a8-0117-4a52-9870-8c3b96381c1c","Type":"ContainerStarted","Data":"80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7"} Jul 09 19:34:01.487616 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:01.487575 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:34:01.488793 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:01.488757 2576 patch_prober.go:28] interesting pod/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 09 19:34:01.488929 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:01.488831 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 09 19:34:02.487781 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:02.487741 2576 patch_prober.go:28] interesting pod/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 09 19:34:02.488170 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:02.487808 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 09 19:34:03.234769 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:03.234737 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:34:03.488223 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:03.488122 2576 patch_prober.go:28] interesting pod/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 09 19:34:03.488223 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:03.488183 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 09 19:34:04.487384 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:04.487343 2576 patch_prober.go:28] interesting pod/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 09 19:34:04.487687 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:04.487658 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 09 19:34:05.492144 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:05.492104 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:34:05.493046 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:05.493027 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:34:17.955113 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:17.955088 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:34:17.960425 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:17.960403 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:34:17.961647 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:17.961627 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:34:17.966786 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:34:17.966770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:39:17.979101 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:39:17.979074 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:39:17.984593 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:39:17.984566 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:39:17.985997 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:39:17.985974 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:39:17.991286 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:39:17.991270 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:40:06.313846 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:06.313813 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq"] Jul 09 19:40:06.314364 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:06.314010 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerName="istio-proxy" containerID="cri-o://3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e" gracePeriod=30 Jul 09 19:40:11.547319 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.547293 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:40:11.588823 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.588760 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-data\") pod \"9e44f15b-1acb-4779-9d36-11061b9d92fd\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " Jul 09 19:40:11.588823 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.588810 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-token\") pod \"9e44f15b-1acb-4779-9d36-11061b9d92fd\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " Jul 09 19:40:11.588978 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.588845 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-credential-socket\") pod \"9e44f15b-1acb-4779-9d36-11061b9d92fd\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " Jul 09 19:40:11.588978 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.588882 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-envoy\") pod \"9e44f15b-1acb-4779-9d36-11061b9d92fd\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " Jul 09 19:40:11.588978 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.588914 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-socket\") pod \"9e44f15b-1acb-4779-9d36-11061b9d92fd\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " Jul 09 19:40:11.588978 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.588959 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5hr6\" (UniqueName: \"kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-kube-api-access-x5hr6\") pod \"9e44f15b-1acb-4779-9d36-11061b9d92fd\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " Jul 09 19:40:11.589170 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.588983 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-podinfo\") pod \"9e44f15b-1acb-4779-9d36-11061b9d92fd\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " Jul 09 19:40:11.589170 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.589011 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-certs\") pod \"9e44f15b-1acb-4779-9d36-11061b9d92fd\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " Jul 09 19:40:11.589170 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.589050 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e44f15b-1acb-4779-9d36-11061b9d92fd-istiod-ca-cert\") pod \"9e44f15b-1acb-4779-9d36-11061b9d92fd\" (UID: \"9e44f15b-1acb-4779-9d36-11061b9d92fd\") " Jul 09 19:40:11.589328 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.589165 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e44f15b-1acb-4779-9d36-11061b9d92fd" (UID: "9e44f15b-1acb-4779-9d36-11061b9d92fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:40:11.589328 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.589311 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:11.589445 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.589363 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e44f15b-1acb-4779-9d36-11061b9d92fd" (UID: "9e44f15b-1acb-4779-9d36-11061b9d92fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:40:11.589631 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.589609 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e44f15b-1acb-4779-9d36-11061b9d92fd" (UID: "9e44f15b-1acb-4779-9d36-11061b9d92fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:40:11.589631 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.589621 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e44f15b-1acb-4779-9d36-11061b9d92fd" (UID: "9e44f15b-1acb-4779-9d36-11061b9d92fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:40:11.589768 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.589651 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e44f15b-1acb-4779-9d36-11061b9d92fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e44f15b-1acb-4779-9d36-11061b9d92fd" (UID: "9e44f15b-1acb-4779-9d36-11061b9d92fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:40:11.591200 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.591173 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e44f15b-1acb-4779-9d36-11061b9d92fd" (UID: "9e44f15b-1acb-4779-9d36-11061b9d92fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:40:11.591304 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.591221 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-kube-api-access-x5hr6" (OuterVolumeSpecName: "kube-api-access-x5hr6") pod "9e44f15b-1acb-4779-9d36-11061b9d92fd" (UID: "9e44f15b-1acb-4779-9d36-11061b9d92fd"). InnerVolumeSpecName "kube-api-access-x5hr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:40:11.591358 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.591305 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e44f15b-1acb-4779-9d36-11061b9d92fd" (UID: "9e44f15b-1acb-4779-9d36-11061b9d92fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:40:11.591483 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.591469 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e44f15b-1acb-4779-9d36-11061b9d92fd" (UID: "9e44f15b-1acb-4779-9d36-11061b9d92fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:40:11.690146 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.690125 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:11.690146 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.690146 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:11.690267 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.690155 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:11.690267 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.690163 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:11.690267 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.690172 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5hr6\" (UniqueName: \"kubernetes.io/projected/9e44f15b-1acb-4779-9d36-11061b9d92fd-kube-api-access-x5hr6\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:11.690267 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.690180 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e44f15b-1acb-4779-9d36-11061b9d92fd-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:11.690267 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.690188 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e44f15b-1acb-4779-9d36-11061b9d92fd-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:11.690267 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.690195 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e44f15b-1acb-4779-9d36-11061b9d92fd-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:11.859980 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.859929 2576 generic.go:356] "Generic (PLEG): container finished" podID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerID="3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e" exitCode=0 Jul 09 19:40:11.859980 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.859974 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" Jul 09 19:40:11.860092 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.859975 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" event={"ID":"9e44f15b-1acb-4779-9d36-11061b9d92fd","Type":"ContainerDied","Data":"3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e"} Jul 09 19:40:11.860092 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.860072 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq" event={"ID":"9e44f15b-1acb-4779-9d36-11061b9d92fd","Type":"ContainerDied","Data":"6cc970b600bb8b4ab4e315382bea38351b972121838884bb86e6927a5bd09270"} Jul 09 19:40:11.860157 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.860092 2576 scope.go:117] "RemoveContainer" containerID="3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e" Jul 09 19:40:11.868660 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.868646 2576 scope.go:117] "RemoveContainer" containerID="e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033" Jul 09 19:40:11.875662 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.875648 2576 scope.go:117] "RemoveContainer" containerID="3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e" Jul 09 19:40:11.875884 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:40:11.875866 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e\": container with ID starting with 3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e not found: ID does not exist" containerID="3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e" Jul 09 19:40:11.875954 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.875893 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e"} err="failed to get container status \"3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e\": rpc error: code = NotFound desc = could not find container \"3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e\": container with ID starting with 3731b2c04b14bc18005914b23042312bb3434a5a22b3b570524cde9ca2baa35e not found: ID does not exist" Jul 09 19:40:11.875954 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.875915 2576 scope.go:117] "RemoveContainer" containerID="e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033" Jul 09 19:40:11.876138 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:40:11.876119 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033\": container with ID starting with e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033 not found: ID does not exist" containerID="e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033" Jul 09 19:40:11.876173 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.876144 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033"} err="failed to get container status \"e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033\": rpc error: code = NotFound desc = could not find container \"e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033\": container with ID starting with e31b4dfc6091ca3505afe9b56201f0851d453f64b8fad57fa0680d5266dda033 not found: ID does not exist" Jul 09 19:40:11.881087 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.881068 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq"] Jul 09 19:40:11.884535 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:11.884516 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c8412b-openshift-default-688cd66855-5qgdq"] Jul 09 19:40:12.729934 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:12.729904 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" path="/var/lib/kubelet/pods/9e44f15b-1acb-4779-9d36-11061b9d92fd/volumes" Jul 09 19:40:13.333783 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:13.333752 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf"] Jul 09 19:40:13.333979 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:13.333957 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" containerName="istio-proxy" containerID="cri-o://80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7" gracePeriod=30 Jul 09 19:40:18.581407 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.581385 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:40:18.640351 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640292 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-istio-token\") pod \"847162a8-0117-4a52-9870-8c3b96381c1c\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " Jul 09 19:40:18.640351 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640327 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-socket\") pod \"847162a8-0117-4a52-9870-8c3b96381c1c\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " Jul 09 19:40:18.640557 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640355 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-envoy\") pod \"847162a8-0117-4a52-9870-8c3b96381c1c\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " Jul 09 19:40:18.640557 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640375 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847162a8-0117-4a52-9870-8c3b96381c1c-istiod-ca-cert\") pod \"847162a8-0117-4a52-9870-8c3b96381c1c\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " Jul 09 19:40:18.640557 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640405 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847162a8-0117-4a52-9870-8c3b96381c1c-istio-podinfo\") pod \"847162a8-0117-4a52-9870-8c3b96381c1c\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " Jul 09 19:40:18.640557 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640436 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mhhr\" (UniqueName: \"kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-kube-api-access-5mhhr\") pod \"847162a8-0117-4a52-9870-8c3b96381c1c\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " Jul 09 19:40:18.640557 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640468 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-certs\") pod \"847162a8-0117-4a52-9870-8c3b96381c1c\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " Jul 09 19:40:18.640557 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640546 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-data\") pod \"847162a8-0117-4a52-9870-8c3b96381c1c\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " Jul 09 19:40:18.640877 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640604 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-credential-socket\") pod \"847162a8-0117-4a52-9870-8c3b96381c1c\" (UID: \"847162a8-0117-4a52-9870-8c3b96381c1c\") " Jul 09 19:40:18.640877 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640828 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "847162a8-0117-4a52-9870-8c3b96381c1c" (UID: "847162a8-0117-4a52-9870-8c3b96381c1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:40:18.640877 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640856 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/847162a8-0117-4a52-9870-8c3b96381c1c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "847162a8-0117-4a52-9870-8c3b96381c1c" (UID: "847162a8-0117-4a52-9870-8c3b96381c1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 19:40:18.641031 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640919 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-certs\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:18.641087 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.640974 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "847162a8-0117-4a52-9870-8c3b96381c1c" (UID: "847162a8-0117-4a52-9870-8c3b96381c1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:40:18.641087 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.641048 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "847162a8-0117-4a52-9870-8c3b96381c1c" (UID: "847162a8-0117-4a52-9870-8c3b96381c1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:40:18.641383 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.641362 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-data" (OuterVolumeSpecName: "istio-data") pod "847162a8-0117-4a52-9870-8c3b96381c1c" (UID: "847162a8-0117-4a52-9870-8c3b96381c1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:40:18.642575 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.642543 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "847162a8-0117-4a52-9870-8c3b96381c1c" (UID: "847162a8-0117-4a52-9870-8c3b96381c1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 19:40:18.642731 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.642712 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-kube-api-access-5mhhr" (OuterVolumeSpecName: "kube-api-access-5mhhr") pod "847162a8-0117-4a52-9870-8c3b96381c1c" (UID: "847162a8-0117-4a52-9870-8c3b96381c1c"). InnerVolumeSpecName "kube-api-access-5mhhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:40:18.642863 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.642842 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-istio-token" (OuterVolumeSpecName: "istio-token") pod "847162a8-0117-4a52-9870-8c3b96381c1c" (UID: "847162a8-0117-4a52-9870-8c3b96381c1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 19:40:18.642925 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.642842 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/847162a8-0117-4a52-9870-8c3b96381c1c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "847162a8-0117-4a52-9870-8c3b96381c1c" (UID: "847162a8-0117-4a52-9870-8c3b96381c1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 19:40:18.741793 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.741774 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-data\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:18.741793 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.741792 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-credential-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:18.741907 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.741802 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-istio-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:18.741907 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.741810 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-workload-socket\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:18.741907 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.741818 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/847162a8-0117-4a52-9870-8c3b96381c1c-istio-envoy\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:18.741907 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.741826 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/847162a8-0117-4a52-9870-8c3b96381c1c-istiod-ca-cert\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:18.741907 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.741833 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/847162a8-0117-4a52-9870-8c3b96381c1c-istio-podinfo\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:18.741907 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.741840 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mhhr\" (UniqueName: \"kubernetes.io/projected/847162a8-0117-4a52-9870-8c3b96381c1c-kube-api-access-5mhhr\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" Jul 09 19:40:18.894734 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.894673 2576 generic.go:356] "Generic (PLEG): container finished" podID="847162a8-0117-4a52-9870-8c3b96381c1c" containerID="80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7" exitCode=0 Jul 09 19:40:18.894837 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.894731 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" Jul 09 19:40:18.894837 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.894757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" event={"ID":"847162a8-0117-4a52-9870-8c3b96381c1c","Type":"ContainerDied","Data":"80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7"} Jul 09 19:40:18.894837 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.894806 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf" event={"ID":"847162a8-0117-4a52-9870-8c3b96381c1c","Type":"ContainerDied","Data":"fefb6ee26184ec9892e987ed07a9f9980f46dfe42fc375fa31367f1ad4077209"} Jul 09 19:40:18.894837 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.894835 2576 scope.go:117] "RemoveContainer" containerID="80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7" Jul 09 19:40:18.902686 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.902672 2576 scope.go:117] "RemoveContainer" containerID="47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217" Jul 09 19:40:18.909797 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.909780 2576 scope.go:117] "RemoveContainer" containerID="80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7" Jul 09 19:40:18.910018 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:40:18.910003 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7\": container with ID starting with 80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7 not found: ID does not exist" containerID="80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7" Jul 09 19:40:18.910073 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.910025 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7"} err="failed to get container status \"80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7\": rpc error: code = NotFound desc = could not find container \"80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7\": container with ID starting with 80a0ddb5ba505f709e28982180cc076af7f965c4bb05c05e231355f20b63d4c7 not found: ID does not exist" Jul 09 19:40:18.910073 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.910039 2576 scope.go:117] "RemoveContainer" containerID="47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217" Jul 09 19:40:18.910290 ip-10-0-140-253 kubenswrapper[2576]: E0709 19:40:18.910273 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217\": container with ID starting with 47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217 not found: ID does not exist" containerID="47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217" Jul 09 19:40:18.910351 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.910300 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217"} err="failed to get container status \"47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217\": rpc error: code = NotFound desc = could not find container \"47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217\": container with ID starting with 47f78670546f4a7d6f78f8d60abc24fa725e7ae176c635c5c34f4df25f863217 not found: ID does not exist" Jul 09 19:40:18.915808 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.915786 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf"] Jul 09 19:40:18.919849 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:18.919832 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a94244-openshift-default-c569778d7-7ckpf"] Jul 09 19:40:19.435085 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:19.435058 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779db88bb-g84xv_604e7ad9-1534-4442-8020-31b24525ec41/copy-manifests/0.log" Jul 09 19:40:19.442558 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:19.442536 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779db88bb-g84xv_604e7ad9-1534-4442-8020-31b24525ec41/manager/0.log" Jul 09 19:40:20.733394 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:20.730542 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" path="/var/lib/kubelet/pods/847162a8-0117-4a52-9870-8c3b96381c1c/volumes" Jul 09 19:40:22.485547 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:22.485523 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4th8cr_3f94e877-a5bd-4a5c-bd39-892fb88b2cb1/istio-proxy/0.log" Jul 09 19:40:22.600379 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:22.600357 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jglcd_20b54ef1-0b20-4956-9821-fba26ddab0c9/discovery/0.log" Jul 09 19:40:22.934750 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:22.934727 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8wl8m_c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da/istio-proxy/1.log" Jul 09 19:40:23.618381 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:23.618357 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hj2ql_fdc32820-4298-48a5-b229-3e9ce379cc1b/main/0.log" Jul 09 19:40:23.843902 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:23.843880 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-t9q57_d55111a4-656b-455f-bf08-3296abb9bc7c/main/0.log" Jul 09 19:40:30.609737 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:30.609707 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lpcft_7cd65f36-9ffa-46e3-995f-7cc0395f757d/global-pull-secret-syncer/0.log" Jul 09 19:40:30.698102 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:30.698075 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dg6vk_b717b23c-d36c-453a-9f54-a03a5e8d7317/konnectivity-agent/0.log" Jul 09 19:40:30.812100 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:30.812079 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-253.ec2.internal_51fdd73d126d5084e958299073e38c7f/haproxy/0.log" Jul 09 19:40:37.510348 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:37.510316 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5c8cd_e0923fce-5a9a-4b14-99e0-f69f8c615e37/node-exporter/0.log" Jul 09 19:40:37.534192 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:37.534173 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5c8cd_e0923fce-5a9a-4b14-99e0-f69f8c615e37/kube-rbac-proxy/0.log" Jul 09 19:40:37.560348 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:37.560328 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5c8cd_e0923fce-5a9a-4b14-99e0-f69f8c615e37/init-textfile/0.log" Jul 09 19:40:40.442462 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:40.442434 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/1.log" Jul 09 19:40:40.448805 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:40.448783 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwnzq_f4c316ad-4abf-4014-8d87-01cf69151274/console-operator/2.log" Jul 09 19:40:41.124810 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.124778 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc"] Jul 09 19:40:41.125080 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.125069 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" containerName="istio-proxy" Jul 09 19:40:41.125129 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.125082 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" containerName="istio-proxy" Jul 09 19:40:41.125129 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.125092 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" Jul 09 19:40:41.125129 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.125097 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="475e23f4-aca8-444f-bd29-48af900a1736" containerName="istio-proxy" Jul 09 19:40:41.125129 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.125106 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerName="istio-proxy" Jul 09 19:40:41.125129 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.125112 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerName="istio-proxy" Jul 09 19:40:41.125283 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.125169 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" containerName="istio-proxy" Jul 09 19:40:41.125283 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.125176 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e44f15b-1acb-4779-9d36-11061b9d92fd" containerName="istio-proxy" Jul 09 19:40:41.125283 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.125183 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="847162a8-0117-4a52-9870-8c3b96381c1c" containerName="istio-proxy" Jul 09 19:40:41.127870 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.127850 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.131013 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.130982 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vtw49\"/\"kube-root-ca.crt\"" Jul 09 19:40:41.131135 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.131033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vtw49\"/\"default-dockercfg-8sjz6\"" Jul 09 19:40:41.132227 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.132207 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vtw49\"/\"openshift-service-ca.crt\"" Jul 09 19:40:41.137398 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.137379 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc"] Jul 09 19:40:41.205138 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.205107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-proc\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.205300 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.205147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-podres\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.205300 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.205172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-lib-modules\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.205414 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.205292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-sys\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.205414 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.205329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xtf8\" (UniqueName: \"kubernetes.io/projected/5f8dc794-30f0-4979-b729-fdd6d2d372f9-kube-api-access-8xtf8\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.306018 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.305988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-proc\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.306186 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.306030 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-podres\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.306186 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.306117 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-proc\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.306186 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.306149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-lib-modules\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.306186 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.306175 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-podres\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.306380 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.306234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-sys\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.306380 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.306263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xtf8\" (UniqueName: \"kubernetes.io/projected/5f8dc794-30f0-4979-b729-fdd6d2d372f9-kube-api-access-8xtf8\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.306380 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.306281 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-lib-modules\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.306380 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.306309 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f8dc794-30f0-4979-b729-fdd6d2d372f9-sys\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.315058 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.315032 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xtf8\" (UniqueName: \"kubernetes.io/projected/5f8dc794-30f0-4979-b729-fdd6d2d372f9-kube-api-access-8xtf8\") pod \"perf-node-gather-daemonset-h42dc\" (UID: \"5f8dc794-30f0-4979-b729-fdd6d2d372f9\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.438051 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.438024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:41.563401 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.563346 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc"] Jul 09 19:40:41.566256 ip-10-0-140-253 kubenswrapper[2576]: W0709 19:40:41.566226 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5f8dc794_30f0_4979_b729_fdd6d2d372f9.slice/crio-2c3005c57d23ba97a758ff02669c29f766b389745fc6272de5d1e9701e682508 WatchSource:0}: Error finding container 2c3005c57d23ba97a758ff02669c29f766b389745fc6272de5d1e9701e682508: Status 404 returned error can't find the container with id 2c3005c57d23ba97a758ff02669c29f766b389745fc6272de5d1e9701e682508 Jul 09 19:40:41.988134 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.988096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" event={"ID":"5f8dc794-30f0-4979-b729-fdd6d2d372f9","Type":"ContainerStarted","Data":"ffe1f5774a17f2e966f74c29263bcf51dda3a8a14fc32422d98f49f353c6f3b4"} Jul 09 19:40:41.988307 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.988153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" event={"ID":"5f8dc794-30f0-4979-b729-fdd6d2d372f9","Type":"ContainerStarted","Data":"2c3005c57d23ba97a758ff02669c29f766b389745fc6272de5d1e9701e682508"} Jul 09 19:40:41.988307 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:41.988199 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:42.005648 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:42.005600 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" podStartSLOduration=1.005585165 podStartE2EDuration="1.005585165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:40:42.004295053 +0000 UTC m=+2485.787702819" watchObservedRunningTime="2026-07-09 19:40:42.005585165 +0000 UTC m=+2485.788992930" Jul 09 19:40:42.914038 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:42.914009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tkm5j_78435845-9b02-4b2a-9c9e-8ee04618f9c0/dns/0.log" Jul 09 19:40:42.934516 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:42.934473 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tkm5j_78435845-9b02-4b2a-9c9e-8ee04618f9c0/kube-rbac-proxy/0.log" Jul 09 19:40:43.005872 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:43.005846 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s4g5r_b2c4f776-0c98-4e11-bb43-23c96122f8ff/dns-node-resolver/0.log" Jul 09 19:40:43.579848 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:43.579813 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5hq5_e432054c-7eae-4a1f-a642-1c56f474dbb8/node-ca/0.log" Jul 09 19:40:44.490416 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:44.490388 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4th8cr_3f94e877-a5bd-4a5c-bd39-892fb88b2cb1/istio-proxy/0.log" Jul 09 19:40:44.604889 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:44.604859 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jglcd_20b54ef1-0b20-4956-9821-fba26ddab0c9/discovery/0.log" Jul 09 19:40:44.681769 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:44.681740 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8wl8m_c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da/istio-proxy/0.log" Jul 09 19:40:44.715038 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:44.715006 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8wl8m_c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da/istio-proxy/1.log" Jul 09 19:40:45.503750 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:45.503720 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqlrt_5dead0cf-83f9-471d-a4b9-7de73e42c48a/serve-healthcheck-canary/0.log" Jul 09 19:40:45.967694 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:45.967669 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xdwrm_4834de22-67ed-4151-abd1-01db4df72cbf/insights-operator/0.log" Jul 09 19:40:45.968211 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:45.968188 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xdwrm_4834de22-67ed-4151-abd1-01db4df72cbf/insights-operator/1.log" Jul 09 19:40:46.061327 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:46.061305 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlcpp_fc23d3a6-a4c6-4790-aade-ca148619d0d0/kube-rbac-proxy/0.log" Jul 09 19:40:46.082193 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:46.082170 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlcpp_fc23d3a6-a4c6-4790-aade-ca148619d0d0/exporter/0.log" Jul 09 19:40:46.104651 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:46.104619 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlcpp_fc23d3a6-a4c6-4790-aade-ca148619d0d0/extractor/0.log" Jul 09 19:40:48.002984 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:48.002955 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-h42dc" Jul 09 19:40:48.700783 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:48.700755 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779db88bb-g84xv_604e7ad9-1534-4442-8020-31b24525ec41/manager/0.log" Jul 09 19:40:48.731400 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:48.731375 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779db88bb-g84xv_604e7ad9-1534-4442-8020-31b24525ec41/copy-manifests/0.log" Jul 09 19:40:50.044766 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:50.044741 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8ff7d7b96-g698d_d5abd29a-12cd-44de-9f02-f12040efb394/manager/0.log" Jul 09 19:40:51.643611 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:51.643535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4th8cr_3f94e877-a5bd-4a5c-bd39-892fb88b2cb1/istio-proxy/0.log" Jul 09 19:40:51.741133 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:51.741106 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jglcd_20b54ef1-0b20-4956-9821-fba26ddab0c9/discovery/0.log" Jul 09 19:40:51.785758 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:51.785733 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8wl8m_c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da/istio-proxy/0.log" Jul 09 19:40:51.813576 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:51.813551 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8wl8m_c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da/istio-proxy/1.log" Jul 09 19:40:53.167591 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:53.166805 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4th8cr_3f94e877-a5bd-4a5c-bd39-892fb88b2cb1/istio-proxy/0.log" Jul 09 19:40:53.273009 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:53.272982 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jglcd_20b54ef1-0b20-4956-9821-fba26ddab0c9/discovery/0.log" Jul 09 19:40:53.321357 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:53.321336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8wl8m_c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da/istio-proxy/0.log" Jul 09 19:40:53.349825 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:53.349803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8wl8m_c40c5c9c-aed6-40b3-9b3e-2cc3d25d71da/istio-proxy/1.log" Jul 09 19:40:55.294923 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:55.294898 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-qhngf_431e59c7-f782-4fa2-8268-05bd691f7605/migrator/0.log" Jul 09 19:40:55.339049 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:55.339023 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-qhngf_431e59c7-f782-4fa2-8268-05bd691f7605/graceful-termination/0.log" Jul 09 19:40:57.080924 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:57.080897 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk5px_559bf9aa-006f-4808-b979-aecf3bb3b1cf/kube-multus-additional-cni-plugins/0.log" Jul 09 19:40:57.102355 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:57.102328 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk5px_559bf9aa-006f-4808-b979-aecf3bb3b1cf/egress-router-binary-copy/0.log" Jul 09 19:40:57.125737 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:57.125720 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk5px_559bf9aa-006f-4808-b979-aecf3bb3b1cf/cni-plugins/0.log" Jul 09 19:40:57.148312 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:57.148252 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk5px_559bf9aa-006f-4808-b979-aecf3bb3b1cf/bond-cni-plugin/0.log" Jul 09 19:40:57.169824 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:57.169808 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk5px_559bf9aa-006f-4808-b979-aecf3bb3b1cf/routeoverride-cni/0.log" Jul 09 19:40:57.193030 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:57.193015 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk5px_559bf9aa-006f-4808-b979-aecf3bb3b1cf/whereabouts-cni-bincopy/0.log" Jul 09 19:40:57.213995 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:57.213971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk5px_559bf9aa-006f-4808-b979-aecf3bb3b1cf/whereabouts-cni/0.log" Jul 09 19:40:57.274048 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:57.274031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w9wrf_07f68d9e-d699-4cd8-a254-c641caf926f9/kube-multus/0.log" Jul 09 19:40:57.293844 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:57.293828 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c4kkr_a9f3616e-5200-4753-8a67-1252d9f93c23/network-metrics-daemon/0.log" Jul 09 19:40:57.312719 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:57.312701 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c4kkr_a9f3616e-5200-4753-8a67-1252d9f93c23/kube-rbac-proxy/0.log" Jul 09 19:40:58.310438 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:58.310414 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-controller/0.log" Jul 09 19:40:58.329386 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:58.329367 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/0.log" Jul 09 19:40:58.329508 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:58.329457 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovn-acl-logging/1.log" Jul 09 19:40:58.346405 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:58.346384 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/kube-rbac-proxy-node/0.log" Jul 09 19:40:58.368218 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:58.368202 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 19:40:58.389783 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:58.389768 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/northd/0.log" Jul 09 19:40:58.409774 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:58.409755 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/nbdb/0.log" Jul 09 19:40:58.430100 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:58.430082 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/sbdb/0.log" Jul 09 19:40:58.480104 ip-10-0-140-253 kubenswrapper[2576]: I0709 19:40:58.480086 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-69v7j_6380f011-119f-4154-824a-51ddb4626e9c/ovnkube-controller/0.log"