Jul 21 16:59:49.665123 ip-10-0-136-64 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 21 16:59:49.665253 ip-10-0-136-64 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 21 16:59:49.665335 ip-10-0-136-64 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 21 16:59:49.665752 ip-10-0-136-64 systemd[1]: Failed to start Kubernetes Kubelet. Jul 21 17:00:00.961783 ip-10-0-136-64 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 21 17:00:00.961801 ip-10-0-136-64 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b4f1b78be73e401b9d5509effb2c80ce -- Jul 21 17:01:38.441882 ip-10-0-136-64 systemd[1]: Starting Kubernetes Kubelet... Jul 21 17:01:38.893286 ip-10-0-136-64 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 17:01:38.893286 ip-10-0-136-64 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 17:01:38.893286 ip-10-0-136-64 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 17:01:38.893286 ip-10-0-136-64 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 17:01:38.893286 ip-10-0-136-64 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 17:01:38.894270 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.894180 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 17:01:38.901675 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901650 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:01:38.901675 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901670 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:01:38.901675 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901674 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:01:38.901675 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901677 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901682 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901685 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901688 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901691 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901694 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901697 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901701 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901706 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901709 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901716 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901719 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901722 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901725 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901727 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901730 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901732 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901735 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901737 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:01:38.901795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901741 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901745 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901749 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901752 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901754 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901757 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901760 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901764 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901767 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901769 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901772 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901775 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901777 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901779 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901782 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901785 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901788 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901791 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901793 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:01:38.902237 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901796 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901799 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901802 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901805 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901807 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901817 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901819 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901822 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901825 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901827 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901830 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901833 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901836 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901838 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901841 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901843 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901846 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901848 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901851 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901853 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:01:38.902705 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901856 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901859 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901862 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901865 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901867 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901870 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901872 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901875 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901880 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901884 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901887 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901890 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901892 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901895 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901898 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901900 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901902 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901905 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901910 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901913 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:01:38.903169 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901915 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901918 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901920 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901923 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901926 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901929 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901931 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901934 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901937 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901939 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901942 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901945 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901948 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901951 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901953 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901956 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901959 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:01:38.903656 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.901961 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:01:38.905073 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905051 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:01:38.905073 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905070 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:01:38.905073 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905074 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:01:38.905073 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905077 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:01:38.905073 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905080 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905083 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905087 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905090 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905093 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905095 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905098 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905102 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905105 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905107 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905110 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905112 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905115 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905117 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905120 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905122 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905125 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905128 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905130 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905133 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:01:38.905261 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905135 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905138 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905144 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905147 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905149 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905152 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905154 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905157 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905160 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905162 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905165 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905167 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905170 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905172 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905175 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905178 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905181 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905183 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905186 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905189 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:01:38.905787 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905191 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905193 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905196 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905198 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905202 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905204 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905206 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905209 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905212 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905214 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905216 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905219 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905221 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905224 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905227 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905229 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905231 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905234 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905236 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905238 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:01:38.906268 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905241 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905243 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905246 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905248 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905250 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905255 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905261 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905264 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905268 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905271 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905274 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905277 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905280 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905282 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905284 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905287 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905290 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905292 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905295 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:01:38.906795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905301 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905305 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905308 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905311 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905313 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905316 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905319 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905321 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905323 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905326 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905328 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905331 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905335 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905339 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905342 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905344 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905766 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905771 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905774 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905777 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:01:38.907254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905781 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905783 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905786 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905789 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905792 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905795 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905798 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905800 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905803 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905806 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905809 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905811 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905814 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905818 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905822 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905826 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905829 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905831 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905835 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905839 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:01:38.907738 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905841 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905844 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905846 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905849 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905851 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905853 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905856 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905859 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905861 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905864 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905867 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905869 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905872 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905875 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905878 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905881 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905883 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905885 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905888 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:01:38.908252 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905890 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905893 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905895 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905898 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905900 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905902 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905906 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905908 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905911 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905913 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905915 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905918 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905920 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905923 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905927 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905929 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905932 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905934 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905936 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905939 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:01:38.908726 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905941 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905944 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905946 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905949 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905952 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905954 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905957 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905959 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905962 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905964 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905967 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905969 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905972 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905974 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905977 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905979 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905981 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905984 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905986 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905990 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:01:38.909193 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905993 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905995 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.905998 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906000 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906002 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906005 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906007 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906010 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906012 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906014 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906017 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906019 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906022 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906024 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906028 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906032 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906106 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906113 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906119 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906124 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 17:01:38.909712 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906128 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906132 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906137 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906141 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906144 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906147 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906150 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906153 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906156 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906159 2562 flags.go:64] FLAG: --cgroup-root="" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906162 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906165 2562 flags.go:64] FLAG: --client-ca-file="" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906168 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906171 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906175 2562 flags.go:64] FLAG: --cluster-domain="" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906178 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906181 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906184 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906187 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906191 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906195 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906198 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906201 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906204 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 21 17:01:38.910182 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906206 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906209 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906212 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906215 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906219 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906222 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906224 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906227 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906229 2562 flags.go:64] FLAG: --enable-server="true" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906232 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906237 2562 flags.go:64] FLAG: --event-burst="100" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906239 2562 flags.go:64] FLAG: --event-qps="50" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906242 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906245 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906248 2562 flags.go:64] FLAG: --eviction-hard="" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906251 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906254 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906257 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906260 2562 flags.go:64] FLAG: --eviction-soft="" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906263 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906266 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906270 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906273 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906276 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906281 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 17:01:38.910769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906284 2562 flags.go:64] FLAG: --feature-gates="" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906288 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906291 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906294 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906297 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906300 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906303 2562 flags.go:64] FLAG: --help="false" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906305 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-136-64.ec2.internal" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906308 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906311 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906314 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906317 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906320 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906323 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906326 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906328 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906331 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906334 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906337 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906339 2562 flags.go:64] FLAG: --kube-reserved="" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906342 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906344 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906347 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906350 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 17:01:38.911378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906352 2562 flags.go:64] FLAG: --lock-file="" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906355 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906358 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906360 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906366 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906372 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906375 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906379 2562 flags.go:64] FLAG: --logging-format="text" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906382 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906385 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906388 2562 flags.go:64] FLAG: --manifest-url="" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906391 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906395 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906398 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906402 2562 flags.go:64] FLAG: --max-pods="110" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906405 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906408 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906410 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906413 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906416 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906419 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906422 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906429 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906432 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906435 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 17:01:38.911972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906438 2562 flags.go:64] FLAG: --pod-cidr="" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906440 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906446 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906448 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906451 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906454 2562 flags.go:64] FLAG: --port="10250" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906457 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906460 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06edc73f2d12074b4" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906463 2562 flags.go:64] FLAG: --qos-reserved="" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906465 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906468 2562 flags.go:64] FLAG: --register-node="true" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906471 2562 flags.go:64] FLAG: --register-with-taints="" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906475 2562 flags.go:64] FLAG: --registry-burst="10" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906478 2562 flags.go:64] FLAG: --registry-qps="5" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906482 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906484 2562 flags.go:64] FLAG: --reserved-memory="" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906489 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906492 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906495 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906497 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906500 2562 flags.go:64] FLAG: --runonce="false" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906503 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906505 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906508 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906529 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 17:01:38.912691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906534 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906537 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906540 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906543 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906546 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906549 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906552 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906555 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906558 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906561 2562 flags.go:64] FLAG: --system-cgroups="" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906563 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906569 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906571 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906574 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906579 2562 flags.go:64] FLAG: --tls-min-version="" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906582 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906584 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906587 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906590 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906593 2562 flags.go:64] FLAG: --v="2" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906597 2562 flags.go:64] FLAG: --version="false" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906603 2562 flags.go:64] FLAG: --vmodule="" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906607 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.906611 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906758 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:01:38.913666 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906762 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906765 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906768 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906771 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906774 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906777 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906779 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906782 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906785 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906787 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906790 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906792 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906795 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906798 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906800 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906803 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906805 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906809 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906811 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:01:38.914732 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906814 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906816 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906819 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906822 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906824 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906827 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906830 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906832 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906835 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906838 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906842 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906845 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906849 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906853 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906856 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906858 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906861 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906864 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906867 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906870 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:01:38.915543 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906872 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906875 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906877 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906880 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906883 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906886 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906888 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906891 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906894 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906897 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906901 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906903 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906906 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906909 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906912 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906914 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906917 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906919 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906922 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:01:38.916386 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906924 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906927 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906931 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906934 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906938 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906941 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906944 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906946 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906950 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906954 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906956 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906959 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906962 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906964 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906967 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906969 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906972 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906974 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906977 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906979 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:01:38.917309 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906982 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906984 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906987 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906989 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906992 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906994 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906997 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.906999 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907002 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907004 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907007 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907009 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907011 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907014 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907017 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907020 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907023 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907026 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907029 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:01:38.917831 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.907031 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.907036 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.915659 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.915682 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.915709 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.915718 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915808 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915816 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915821 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915826 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915831 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915836 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915840 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915844 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915849 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:01:38.918572 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915853 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915857 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915862 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915866 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915870 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915874 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915878 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915883 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915887 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915891 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915895 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915899 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915904 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915908 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915912 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915923 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915928 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915932 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915936 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915942 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:01:38.919198 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915950 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915955 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915959 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915963 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915970 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915975 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915980 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915985 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915990 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915994 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.915999 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916004 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916008 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916013 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916017 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916022 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916026 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916031 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916035 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:01:38.919836 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916040 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916045 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916049 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916054 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916058 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916062 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916067 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916072 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916076 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916081 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916085 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916089 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916093 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916097 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916101 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916106 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916110 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916115 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916119 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:01:38.920370 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916123 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916127 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916131 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916135 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916139 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916144 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916148 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916152 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916156 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916160 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916164 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916168 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916172 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916176 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916182 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916187 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916192 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916197 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916202 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916207 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:01:38.920891 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916211 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916215 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916219 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916224 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916229 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916233 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916238 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916242 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916247 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916251 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916255 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916259 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.916267 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916488 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916497 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:01:38.921396 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916502 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916507 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916533 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916538 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916542 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916546 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916549 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916553 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916556 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916560 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916565 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916569 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916572 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916576 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916579 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916583 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916587 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916591 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916595 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:01:38.921790 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916598 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916602 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916608 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916611 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916615 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916619 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916623 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916626 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916630 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916634 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916638 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916642 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916645 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916649 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916653 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916656 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916660 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916664 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916668 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916671 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:01:38.922304 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916675 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916679 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916683 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916687 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916691 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916695 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916699 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916702 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916707 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916711 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916715 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916719 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916723 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916727 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916731 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916736 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916741 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916745 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916749 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916753 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:01:38.922803 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916756 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916760 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916765 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916769 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916773 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916777 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916781 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916785 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916789 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916793 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916799 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916805 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916809 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916813 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916818 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916822 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916826 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916830 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916834 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916838 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:01:38.923342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916842 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916846 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916850 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916854 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916858 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916864 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916869 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916873 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916878 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916883 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916888 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916892 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916898 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916904 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916908 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916912 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916916 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:01:38.923913 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:38.916920 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:01:38.924326 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.916928 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 17:01:38.924326 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.917098 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 17:01:38.924326 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.920254 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 17:01:38.924326 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.922055 2562 server.go:1019] "Starting client certificate rotation" Jul 21 17:01:38.924326 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.922173 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 17:01:38.924326 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.922213 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 17:01:38.925069 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.925053 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 17:01:38.928184 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.928163 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 17:01:38.943125 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.943105 2562 log.go:25] "Validated CRI v1 runtime API" Jul 21 17:01:38.945584 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.945567 2562 log.go:25] "Validated CRI v1 image API" Jul 21 17:01:38.946466 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.946451 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 17:01:38.949123 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.949093 2562 fs.go:135] Filesystem UUIDs: map[3951df93-d340-4104-a1f1-7f0b9a9c4407:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 af0a744d-f39a-4d5f-bab0-b9d6021d09a4:/dev/nvme0n1p3] Jul 21 17:01:38.949206 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.949121 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 17:01:38.954745 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.954722 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 17:01:38.957035 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.956916 2562 manager.go:216] Machine: {Timestamp:2026-07-21 17:01:38.9554044 +0000 UTC m=+0.382230484 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098943 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f072e0aec1ef92196d0ff0a9efb35 SystemUUID:ec2f072e-0aec-1ef9-2196-d0ff0a9efb35 BootID:b4f1b78b-e73e-401b-9d55-09effb2c80ce Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:17:eb:9f:d6:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:17:eb:9f:d6:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:44:1b:19:ab:fa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 17:01:38.957035 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.957030 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 17:01:38.957184 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.957126 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 17:01:38.960944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.960918 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 17:01:38.961087 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.960947 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 17:01:38.961751 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.961740 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 17:01:38.961783 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.961753 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 17:01:38.961783 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.961761 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 17:01:38.961783 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.961776 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 17:01:38.963652 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.963642 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 17:01:38.968263 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.968250 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 21 17:01:38.968400 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.968390 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 17:01:38.968447 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.968423 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 21 17:01:38.968447 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.968433 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 17:01:38.968447 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.968445 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 17:01:38.968573 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.968454 2562 kubelet.go:398] "Adding apiserver pod source" Jul 21 17:01:38.968573 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.968465 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 17:01:38.968876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.968862 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 17:01:38.968918 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.968888 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 17:01:38.971332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.971314 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 17:01:38.974057 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.974040 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 17:01:38.974174 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.974074 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 17:01:38.975582 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975570 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 17:01:38.975624 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975587 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 17:01:38.975624 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975594 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 17:01:38.975624 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975599 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 17:01:38.975624 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975613 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 17:01:38.975624 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975622 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 17:01:38.975759 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975636 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 17:01:38.975759 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975641 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 17:01:38.975759 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975648 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 17:01:38.975759 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975654 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 17:01:38.975759 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975667 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 17:01:38.975759 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.975672 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 17:01:38.977328 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.977316 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 17:01:38.977328 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.977326 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 17:01:38.979740 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:38.979710 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 17:01:38.979843 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.979743 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 17:01:38.979890 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:38.979831 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 17:01:38.980806 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.980790 2562 server.go:1268] "Started kubelet" Jul 21 17:01:38.980978 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.980925 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 17:01:38.981091 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.980999 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 17:01:38.981581 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.981553 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 17:01:38.981766 ip-10-0-136-64 systemd[1]: Started Kubernetes Kubelet. Jul 21 17:01:38.983745 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.983729 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 21 17:01:38.986171 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.986151 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 17:01:38.988102 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:38.988084 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 17:01:38.994973 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.994959 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 17:01:38.995037 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.995014 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 17:01:38.995203 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:38.995182 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:38.995861 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.995758 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 17:01:38.995861 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.995841 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 17:01:38.995861 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.995858 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 17:01:38.996017 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.995942 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 21 17:01:38.996017 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.995951 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 21 17:01:38.996118 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.996056 2562 factory.go:55] Registering systemd factory Jul 21 17:01:38.996118 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.996072 2562 factory.go:223] Registration of the systemd container factory successfully Jul 21 17:01:38.996400 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.996368 2562 factory.go:153] Registering CRI-O factory Jul 21 17:01:38.996400 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.996391 2562 factory.go:223] Registration of the crio container factory successfully Jul 21 17:01:38.996504 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.996454 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 17:01:38.996504 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.996481 2562 factory.go:103] Registering Raw factory Jul 21 17:01:38.996504 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.996499 2562 manager.go:1196] Started watching for new ooms in manager Jul 21 17:01:38.996968 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:38.996951 2562 manager.go:349] Starting recovery of all containers Jul 21 17:01:38.997962 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:38.996697 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-64.ec2.internal.18c45cb84cf6ccd3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-64.ec2.internal,UID:ip-10-0-136-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-64.ec2.internal,},FirstTimestamp:2026-07-21 17:01:38.980539603 +0000 UTC m=+0.407365686,LastTimestamp:2026-07-21 17:01:38.980539603 +0000 UTC m=+0.407365686,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-64.ec2.internal,}" Jul 21 17:01:39.009447 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.009413 2562 manager.go:354] Recovery completed Jul 21 17:01:39.011109 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.011085 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 17:01:39.011370 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.011349 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 17:01:39.013840 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.013824 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:01:39.016274 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.016258 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:01:39.016335 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.016289 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:01:39.016335 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.016300 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:01:39.016882 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.016868 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 17:01:39.016882 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.016875 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:01:39.016983 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.016880 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 17:01:39.016983 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.016963 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 21 17:01:39.017651 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.017633 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:01:39.017708 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.017664 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:01:39.017708 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.017678 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:01:39.019087 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.019075 2562 policy_none.go:49] "None policy: Start" Jul 21 17:01:39.019129 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.019090 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 17:01:39.019129 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.019101 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 17:01:39.021116 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.021103 2562 policy_none.go:47] "Start" Jul 21 17:01:39.023459 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.023422 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vz2k4" Jul 21 17:01:39.028464 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.028392 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-64.ec2.internal.18c45cb84f18140e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-64.ec2.internal,UID:ip-10-0-136-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-64.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-64.ec2.internal,},FirstTimestamp:2026-07-21 17:01:39.016274958 +0000 UTC m=+0.443101041,LastTimestamp:2026-07-21 17:01:39.016274958 +0000 UTC m=+0.443101041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-64.ec2.internal,}" Jul 21 17:01:39.031463 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.031449 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vz2k4" Jul 21 17:01:39.036679 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.036589 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-64.ec2.internal.18c45cb84f185cfb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-64.ec2.internal,UID:ip-10-0-136-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-64.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-64.ec2.internal,},FirstTimestamp:2026-07-21 17:01:39.016293627 +0000 UTC m=+0.443119711,LastTimestamp:2026-07-21 17:01:39.016293627 +0000 UTC m=+0.443119711,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-64.ec2.internal,}" Jul 21 17:01:39.061188 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.061166 2562 manager.go:337] "Starting Device Plugin manager" Jul 21 17:01:39.079049 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.061215 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 17:01:39.079049 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.061228 2562 server.go:87] "Starting device plugin registration server" Jul 21 17:01:39.079049 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.061546 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 17:01:39.079049 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.061560 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 17:01:39.079049 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.061641 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 17:01:39.079049 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.061733 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 17:01:39.079049 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.061744 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 17:01:39.079049 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.062090 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 17:01:39.079049 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.062134 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:39.106358 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.106326 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 17:01:39.107915 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.107897 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 17:01:39.108031 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.107941 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 17:01:39.108031 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.108018 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 17:01:39.108126 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.108069 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 17:01:39.110782 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.110758 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 17:01:39.162136 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.162101 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:01:39.163214 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.163192 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:01:39.163276 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.163230 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:01:39.163276 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.163240 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:01:39.163276 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.163264 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.174472 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.174448 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.174472 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.174475 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-64.ec2.internal\": node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:39.208677 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.208640 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal"] Jul 21 17:01:39.208822 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.208731 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:01:39.210177 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.210161 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:01:39.210241 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.210196 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:01:39.210241 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.210213 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:01:39.212642 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.212628 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:01:39.212753 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.212739 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.212786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.212772 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:01:39.213314 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.213292 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:01:39.213354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.213333 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:01:39.213354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.213342 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:01:39.213354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.213348 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:01:39.213458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.213359 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:01:39.213458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.213371 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:01:39.215717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.215703 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.215770 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.215729 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:01:39.217032 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.217016 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:01:39.217113 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.217048 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:01:39.217113 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.217066 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:01:39.232268 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.232246 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:39.244214 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.244194 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-64.ec2.internal\" not found" node="ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.248629 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.248614 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-64.ec2.internal\" not found" node="ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.296933 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.296859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d63a5b170b7d76783b7c341a24c4e00-config\") pod \"kube-apiserver-proxy-ip-10-0-136-64.ec2.internal\" (UID: \"7d63a5b170b7d76783b7c341a24c4e00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.333367 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.333338 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:39.397953 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.397921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d63a5b170b7d76783b7c341a24c4e00-config\") pod \"kube-apiserver-proxy-ip-10-0-136-64.ec2.internal\" (UID: \"7d63a5b170b7d76783b7c341a24c4e00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.398038 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.397959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed12d33b7d36e6679d99991d700ea551-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal\" (UID: \"ed12d33b7d36e6679d99991d700ea551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.398038 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.397979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed12d33b7d36e6679d99991d700ea551-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal\" (UID: \"ed12d33b7d36e6679d99991d700ea551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.398038 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.398010 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d63a5b170b7d76783b7c341a24c4e00-config\") pod \"kube-apiserver-proxy-ip-10-0-136-64.ec2.internal\" (UID: \"7d63a5b170b7d76783b7c341a24c4e00\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.434216 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.434185 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:39.498781 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.498743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed12d33b7d36e6679d99991d700ea551-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal\" (UID: \"ed12d33b7d36e6679d99991d700ea551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.498781 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.498783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed12d33b7d36e6679d99991d700ea551-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal\" (UID: \"ed12d33b7d36e6679d99991d700ea551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.498880 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.498813 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed12d33b7d36e6679d99991d700ea551-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal\" (UID: \"ed12d33b7d36e6679d99991d700ea551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.498880 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.498836 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed12d33b7d36e6679d99991d700ea551-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal\" (UID: \"ed12d33b7d36e6679d99991d700ea551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.534912 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.534878 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:39.547099 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.547049 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.551956 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.551774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal" Jul 21 17:01:39.635757 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.635566 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:39.736157 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.736124 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:39.836650 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.836578 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:39.921226 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.921185 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 17:01:39.921717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:39.921359 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 17:01:39.937510 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:39.937475 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:40.025196 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.025160 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 17:01:40.037543 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.037478 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 16:56:39 +0000 UTC" deadline="2028-03-05 13:25:43.026596178 +0000 UTC" Jul 21 17:01:40.037639 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.037550 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14228h24m2.989049842s" Jul 21 17:01:40.037639 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:40.037581 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:40.043697 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.043674 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 17:01:40.138224 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:40.138123 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:40.161155 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:40.161116 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded12d33b7d36e6679d99991d700ea551.slice/crio-7acf66cd82db0dc3f5b7c472532601241eb10f5f32d40e7ae21318a481b4ce5b WatchSource:0}: Error finding container 7acf66cd82db0dc3f5b7c472532601241eb10f5f32d40e7ae21318a481b4ce5b: Status 404 returned error can't find the container with id 7acf66cd82db0dc3f5b7c472532601241eb10f5f32d40e7ae21318a481b4ce5b Jul 21 17:01:40.161505 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:40.161475 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d63a5b170b7d76783b7c341a24c4e00.slice/crio-5649001c69216fcee2b0a3c1c82c8bd253dd2d81057651da9788f08cdfbc1b24 WatchSource:0}: Error finding container 5649001c69216fcee2b0a3c1c82c8bd253dd2d81057651da9788f08cdfbc1b24: Status 404 returned error can't find the container with id 5649001c69216fcee2b0a3c1c82c8bd253dd2d81057651da9788f08cdfbc1b24 Jul 21 17:01:40.166729 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.166701 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 17:01:40.224776 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.224743 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:01:40.225845 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.225824 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:01:40.225942 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.225860 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:01:40.225942 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.225871 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:01:40.239030 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:40.239006 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:40.339474 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:40.339422 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:40.440198 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:40.440106 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-64.ec2.internal\" not found" Jul 21 17:01:40.478366 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.478345 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 17:01:40.496199 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.496167 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" Jul 21 17:01:40.531554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.531508 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 17:01:40.532676 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.532659 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal" Jul 21 17:01:40.552809 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.552785 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 17:01:40.822084 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.822049 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 17:01:40.969934 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.969839 2562 apiserver.go:52] "Watching apiserver" Jul 21 17:01:40.981960 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.981915 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 17:01:40.982401 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.982369 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-w98hx","openshift-multus/network-metrics-daemon-mmld6","openshift-network-operator/iptables-alerter-xtzb2","kube-system/global-pull-secret-syncer-9wmh5","kube-system/konnectivity-agent-zfhq4","openshift-image-registry/node-ca-dcwzd","openshift-multus/multus-kx7sk","openshift-network-diagnostics/network-check-target-9dw5f","openshift-ovn-kubernetes/ovnkube-node-52kzf","kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz","openshift-cluster-node-tuning-operator/tuned-djdh6","openshift-dns/node-resolver-7mn88","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal"] Jul 21 17:01:40.985096 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.985072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:40.985200 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:40.985169 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:01:40.988035 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.988013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:40.988151 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:40.988079 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:01:40.990401 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.990380 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:40.992859 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.992834 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:40.995144 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.995123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:40.995300 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.995288 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 17:01:40.997012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.996995 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 17:01:40.997184 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.997161 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 17:01:40.997267 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.997178 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mn262\"" Jul 21 17:01:40.997770 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.997512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:40.999620 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.998838 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 17:01:40.999620 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.998943 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 17:01:41.000188 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.999946 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 17:01:41.000188 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:40.999997 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zgll9\"" Jul 21 17:01:41.000340 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.000302 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.000340 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.000311 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 17:01:41.000810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.000795 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mdvht\"" Jul 21 17:01:41.000870 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.000810 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 17:01:41.000920 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.000798 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 17:01:41.001536 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.001492 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 17:01:41.001653 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.001597 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 17:01:41.003090 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.003067 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 17:01:41.003380 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.003363 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 17:01:41.003477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.003456 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 17:01:41.004577 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.004555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:41.004698 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.004627 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4f6p8\"" Jul 21 17:01:41.004804 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.004759 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:01:41.006642 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.006616 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qlmtx\"" Jul 21 17:01:41.008075 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008052 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.008350 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd55f\" (UniqueName: \"kubernetes.io/projected/bea7850a-c3ef-4e12-93ad-d45749c5fcb3-kube-api-access-cd55f\") pod \"node-resolver-7mn88\" (UID: \"bea7850a-c3ef-4e12-93ad-d45749c5fcb3\") " pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:41.008474 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-socket-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.008474 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9582d63-4893-4fa0-916c-01eb9a2f34e5-iptables-alerter-script\") pod \"iptables-alerter-xtzb2\" (UID: \"b9582d63-4893-4fa0-916c-01eb9a2f34e5\") " pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:41.008474 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008420 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9582d63-4893-4fa0-916c-01eb9a2f34e5-host-slash\") pod \"iptables-alerter-xtzb2\" (UID: \"b9582d63-4893-4fa0-916c-01eb9a2f34e5\") " pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:41.008474 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-system-cni-dir\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.008760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.008760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dpm9\" (UniqueName: \"kubernetes.io/projected/e1cfe833-0b60-46e2-8ea3-f79da62ade52-kube-api-access-8dpm9\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.008760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008680 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bea7850a-c3ef-4e12-93ad-d45749c5fcb3-hosts-file\") pod \"node-resolver-7mn88\" (UID: \"bea7850a-c3ef-4e12-93ad-d45749c5fcb3\") " pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:41.008760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-device-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.008760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j8k8\" (UniqueName: \"kubernetes.io/projected/868c5fc4-fa01-42de-9d01-327840e2e28c-kube-api-access-5j8k8\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.009016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgxvp\" (UniqueName: \"kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp\") pod \"network-check-target-9dw5f\" (UID: \"49ef420e-de57-415f-aa1d-6351ccda544e\") " pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:41.009016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:41.009016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfx6b\" (UniqueName: \"kubernetes.io/projected/b9582d63-4893-4fa0-916c-01eb9a2f34e5-kube-api-access-pfx6b\") pod \"iptables-alerter-xtzb2\" (UID: \"b9582d63-4893-4fa0-916c-01eb9a2f34e5\") " pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:41.009016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-sys-fs\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.009016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84cf\" (UniqueName: \"kubernetes.io/projected/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-kube-api-access-j84cf\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:41.009016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008983 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 17:01:41.009016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.008984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-cnibin\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.009313 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.009038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-os-release\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.009313 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.009057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1cfe833-0b60-46e2-8ea3-f79da62ade52-cni-binary-copy\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.009313 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.009072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1cfe833-0b60-46e2-8ea3-f79da62ade52-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.009313 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.009093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1cfe833-0b60-46e2-8ea3-f79da62ade52-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.009313 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.009117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea7850a-c3ef-4e12-93ad-d45749c5fcb3-tmp-dir\") pod \"node-resolver-7mn88\" (UID: \"bea7850a-c3ef-4e12-93ad-d45749c5fcb3\") " pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:41.009313 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.009134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.009313 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.009152 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-registration-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.009313 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.009167 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-etc-selinux\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.010784 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.010760 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.011691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.011671 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 17:01:41.012298 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.012280 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hpsbv\"" Jul 21 17:01:41.012690 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.012668 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 17:01:41.014350 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.013835 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 17:01:41.014350 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.013902 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 17:01:41.014350 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.013923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.014892 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.014485 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 17:01:41.015095 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.015074 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 17:01:41.015188 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.015170 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 17:01:41.015272 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.015198 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ll7nw\"" Jul 21 17:01:41.016232 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.016214 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 17:01:41.016315 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.016247 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 17:01:41.016644 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.016623 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:01:41.017341 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.017321 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 17:01:41.017468 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.017441 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 17:01:41.017578 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.017443 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xjmn8\"" Jul 21 17:01:41.022783 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.022759 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 17:01:41.022900 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.022794 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 17:01:41.023095 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.023082 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5r9rg\"" Jul 21 17:01:41.028754 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.028726 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 17:01:41.079133 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.079107 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ql65r" Jul 21 17:01:41.097588 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.097536 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 17:01:41.097793 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.097596 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ql65r" Jul 21 17:01:41.109827 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.109767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bea7850a-c3ef-4e12-93ad-d45749c5fcb3-hosts-file\") pod \"node-resolver-7mn88\" (UID: \"bea7850a-c3ef-4e12-93ad-d45749c5fcb3\") " pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:41.109827 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.109827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxvp\" (UniqueName: \"kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp\") pod \"network-check-target-9dw5f\" (UID: \"49ef420e-de57-415f-aa1d-6351ccda544e\") " pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:41.110082 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.109949 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bea7850a-c3ef-4e12-93ad-d45749c5fcb3-hosts-file\") pod \"node-resolver-7mn88\" (UID: \"bea7850a-c3ef-4e12-93ad-d45749c5fcb3\") " pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:41.110082 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.109978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:41.110082 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1cfe833-0b60-46e2-8ea3-f79da62ade52-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.110252 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bb84b52-52bc-4234-93c0-fd885a659f48-serviceca\") pod \"node-ca-dcwzd\" (UID: \"1bb84b52-52bc-4234-93c0-fd885a659f48\") " pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.110252 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-systemd-units\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.110252 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.110111 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:41.110418 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-hostroot\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.110418 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-sysctl-d\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.110418 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-run-multus-certs\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.110418 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110388 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdv8x\" (UniqueName: \"kubernetes.io/projected/8f364216-7512-468f-8db0-647921e29c9f-kube-api-access-jdv8x\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.110587 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.110587 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.110541 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs podName:e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5 nodeName:}" failed. No retries permitted until 2026-07-21 17:01:41.61048183 +0000 UTC m=+3.037307908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs") pod "network-metrics-daemon-mmld6" (UID: "e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:41.110684 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110584 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.110684 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110592 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-socket-dir-parent\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.110684 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110626 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-run-netns\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.110684 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-run-ovn\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.110850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f364216-7512-468f-8db0-647921e29c9f-env-overrides\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.110850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9582d63-4893-4fa0-916c-01eb9a2f34e5-iptables-alerter-script\") pod \"iptables-alerter-xtzb2\" (UID: \"b9582d63-4893-4fa0-916c-01eb9a2f34e5\") " pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:41.110850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9582d63-4893-4fa0-916c-01eb9a2f34e5-host-slash\") pod \"iptables-alerter-xtzb2\" (UID: \"b9582d63-4893-4fa0-916c-01eb9a2f34e5\") " pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:41.110850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110825 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1cfe833-0b60-46e2-8ea3-f79da62ade52-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.110850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-system-cni-dir\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.111091 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-kubernetes\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.111091 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110898 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-system-cni-dir\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.111091 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110931 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9582d63-4893-4fa0-916c-01eb9a2f34e5-host-slash\") pod \"iptables-alerter-xtzb2\" (UID: \"b9582d63-4893-4fa0-916c-01eb9a2f34e5\") " pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:41.111091 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-cni-dir\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.111091 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.110992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-cnibin\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.111091 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56stn\" (UniqueName: \"kubernetes.io/projected/fb5da059-fd1d-45dc-a594-f8a4f08352dc-kube-api-access-56stn\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.111091 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2bb9fc30-3e5e-41bb-abfc-11d27086161b-kubelet-config\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:41.111488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dpm9\" (UniqueName: \"kubernetes.io/projected/e1cfe833-0b60-46e2-8ea3-f79da62ade52-kube-api-access-8dpm9\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.111488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfx6b\" (UniqueName: \"kubernetes.io/projected/b9582d63-4893-4fa0-916c-01eb9a2f34e5-kube-api-access-pfx6b\") pod \"iptables-alerter-xtzb2\" (UID: \"b9582d63-4893-4fa0-916c-01eb9a2f34e5\") " pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:41.111488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-lib-modules\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.111488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spkbg\" (UniqueName: \"kubernetes.io/projected/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-kube-api-access-spkbg\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.111488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-system-cni-dir\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.111488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f364216-7512-468f-8db0-647921e29c9f-ovnkube-config\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.111488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111426 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9582d63-4893-4fa0-916c-01eb9a2f34e5-iptables-alerter-script\") pod \"iptables-alerter-xtzb2\" (UID: \"b9582d63-4893-4fa0-916c-01eb9a2f34e5\") " pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:41.111488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-cnibin\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.111923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111567 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-systemd\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.111923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111599 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-cnibin\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.111923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-node-log\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.111923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-log-socket\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.111923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-run-k8s-cni-cncf-io\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.111923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-var-lib-cni-bin\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.111923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.111923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.111923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111851 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-var-lib-cni-multus\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.111923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bb84b52-52bc-4234-93c0-fd885a659f48-host\") pod \"node-ca-dcwzd\" (UID: \"1bb84b52-52bc-4234-93c0-fd885a659f48\") " pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-run-openvswitch\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.111970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j8k8\" (UniqueName: \"kubernetes.io/projected/868c5fc4-fa01-42de-9d01-327840e2e28c-kube-api-access-5j8k8\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1cfe833-0b60-46e2-8ea3-f79da62ade52-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-sysconfig\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112083 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae9e8a1-8e64-4c18-a812-aca9b6948847-agent-certs\") pod \"konnectivity-agent-zfhq4\" (UID: \"6ae9e8a1-8e64-4c18-a812-aca9b6948847\") " pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2bb9fc30-3e5e-41bb-abfc-11d27086161b-dbus\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-kubelet\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-conf-dir\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-modprobe-d\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-os-release\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1cfe833-0b60-46e2-8ea3-f79da62ade52-cni-binary-copy\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.112458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112422 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-run\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.113004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-var-lib-kubelet\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.113004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-run-netns\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.113004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-etc-openvswitch\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.113004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112700 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1cfe833-0b60-46e2-8ea3-f79da62ade52-os-release\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.113004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-registration-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.113004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112805 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-etc-selinux\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.113004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112860 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-registration-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.113004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-tmp\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-os-release\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrvg2\" (UniqueName: \"kubernetes.io/projected/1bb84b52-52bc-4234-93c0-fd885a659f48-kube-api-access-vrvg2\") pod \"node-ca-dcwzd\" (UID: \"1bb84b52-52bc-4234-93c0-fd885a659f48\") " pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-slash\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f364216-7512-468f-8db0-647921e29c9f-ovn-node-metrics-cert\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd55f\" (UniqueName: \"kubernetes.io/projected/bea7850a-c3ef-4e12-93ad-d45749c5fcb3-kube-api-access-cd55f\") pod \"node-resolver-7mn88\" (UID: \"bea7850a-c3ef-4e12-93ad-d45749c5fcb3\") " pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-socket-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113229 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1cfe833-0b60-46e2-8ea3-f79da62ade52-cni-binary-copy\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-cni-netd\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-device-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113061 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-etc-selinux\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113294 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-sysctl-conf\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.113317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-sys\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-tuned\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-var-lib-kubelet\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113374 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-socket-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113390 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-cni-bin\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-sys-fs\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84cf\" (UniqueName: \"kubernetes.io/projected/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-kube-api-access-j84cf\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb5da059-fd1d-45dc-a594-f8a4f08352dc-cni-binary-copy\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-etc-kubernetes\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-var-lib-openvswitch\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea7850a-c3ef-4e12-93ad-d45749c5fcb3-tmp-dir\") pod \"node-resolver-7mn88\" (UID: \"bea7850a-c3ef-4e12-93ad-d45749c5fcb3\") " pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-host\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-daemon-config\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.112972 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1cfe833-0b60-46e2-8ea3-f79da62ade52-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113664 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-device-dir\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-run-systemd\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.113810 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113735 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f364216-7512-468f-8db0-647921e29c9f-ovnkube-script-lib\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.114613 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae9e8a1-8e64-4c18-a812-aca9b6948847-konnectivity-ca\") pod \"konnectivity-agent-zfhq4\" (UID: \"6ae9e8a1-8e64-4c18-a812-aca9b6948847\") " pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:01:41.114613 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.114613 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.113970 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/868c5fc4-fa01-42de-9d01-327840e2e28c-sys-fs\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.114613 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.114027 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bea7850a-c3ef-4e12-93ad-d45749c5fcb3-tmp-dir\") pod \"node-resolver-7mn88\" (UID: \"bea7850a-c3ef-4e12-93ad-d45749c5fcb3\") " pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:41.115995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.115936 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" event={"ID":"ed12d33b7d36e6679d99991d700ea551","Type":"ContainerStarted","Data":"7acf66cd82db0dc3f5b7c472532601241eb10f5f32d40e7ae21318a481b4ce5b"} Jul 21 17:01:41.117354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.117330 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal" event={"ID":"7d63a5b170b7d76783b7c341a24c4e00","Type":"ContainerStarted","Data":"5649001c69216fcee2b0a3c1c82c8bd253dd2d81057651da9788f08cdfbc1b24"} Jul 21 17:01:41.124723 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.124695 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:01:41.124723 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.124728 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:01:41.124923 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.124745 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgxvp for pod openshift-network-diagnostics/network-check-target-9dw5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:41.124923 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.124840 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp podName:49ef420e-de57-415f-aa1d-6351ccda544e nodeName:}" failed. No retries permitted until 2026-07-21 17:01:41.624817154 +0000 UTC m=+3.051643229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tgxvp" (UniqueName: "kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp") pod "network-check-target-9dw5f" (UID: "49ef420e-de57-415f-aa1d-6351ccda544e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:41.125032 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.125002 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 17:01:41.129576 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.129553 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j8k8\" (UniqueName: \"kubernetes.io/projected/868c5fc4-fa01-42de-9d01-327840e2e28c-kube-api-access-5j8k8\") pod \"aws-ebs-csi-driver-node-6fqdz\" (UID: \"868c5fc4-fa01-42de-9d01-327840e2e28c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.129735 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.129616 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84cf\" (UniqueName: \"kubernetes.io/projected/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-kube-api-access-j84cf\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:41.129735 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.129632 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dpm9\" (UniqueName: \"kubernetes.io/projected/e1cfe833-0b60-46e2-8ea3-f79da62ade52-kube-api-access-8dpm9\") pod \"multus-additional-cni-plugins-w98hx\" (UID: \"e1cfe833-0b60-46e2-8ea3-f79da62ade52\") " pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.129975 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.129953 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd55f\" (UniqueName: \"kubernetes.io/projected/bea7850a-c3ef-4e12-93ad-d45749c5fcb3-kube-api-access-cd55f\") pod \"node-resolver-7mn88\" (UID: \"bea7850a-c3ef-4e12-93ad-d45749c5fcb3\") " pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:41.130613 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.130567 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfx6b\" (UniqueName: \"kubernetes.io/projected/b9582d63-4893-4fa0-916c-01eb9a2f34e5-kube-api-access-pfx6b\") pod \"iptables-alerter-xtzb2\" (UID: \"b9582d63-4893-4fa0-916c-01eb9a2f34e5\") " pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:41.214450 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-run-k8s-cni-cncf-io\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.214450 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-var-lib-cni-bin\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214485 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214542 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-run-k8s-cni-cncf-io\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214556 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214570 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-var-lib-cni-bin\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-var-lib-cni-multus\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214613 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-var-lib-cni-multus\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bb84b52-52bc-4234-93c0-fd885a659f48-host\") pod \"node-ca-dcwzd\" (UID: \"1bb84b52-52bc-4234-93c0-fd885a659f48\") " pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-run-openvswitch\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-sysconfig\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae9e8a1-8e64-4c18-a812-aca9b6948847-agent-certs\") pod \"konnectivity-agent-zfhq4\" (UID: \"6ae9e8a1-8e64-4c18-a812-aca9b6948847\") " pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214712 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-run-openvswitch\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.214717 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2bb9fc30-3e5e-41bb-abfc-11d27086161b-dbus\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-kubelet\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214751 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bb84b52-52bc-4234-93c0-fd885a659f48-host\") pod \"node-ca-dcwzd\" (UID: \"1bb84b52-52bc-4234-93c0-fd885a659f48\") " pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214783 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-kubelet\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214783 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-sysconfig\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-conf-dir\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.214985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-modprobe-d\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-run\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-var-lib-kubelet\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-run-netns\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215070 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-conf-dir\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215081 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2bb9fc30-3e5e-41bb-abfc-11d27086161b-dbus\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215111 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-run\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215119 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-etc-openvswitch\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-etc-openvswitch\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215138 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-var-lib-kubelet\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215148 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-modprobe-d\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-tmp\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.215287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-os-release\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215159 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-run-netns\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrvg2\" (UniqueName: \"kubernetes.io/projected/1bb84b52-52bc-4234-93c0-fd885a659f48-kube-api-access-vrvg2\") pod \"node-ca-dcwzd\" (UID: \"1bb84b52-52bc-4234-93c0-fd885a659f48\") " pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-slash\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f364216-7512-468f-8db0-647921e29c9f-ovn-node-metrics-cert\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215306 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-os-release\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215347 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-slash\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-cni-netd\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-sysctl-conf\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-sys\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-tuned\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-var-lib-kubelet\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-cni-bin\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb5da059-fd1d-45dc-a594-f8a4f08352dc-cni-binary-copy\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-etc-kubernetes\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-var-lib-openvswitch\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215670 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-sysctl-conf\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-host\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.216186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-daemon-config\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215777 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-sys\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-run-systemd\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f364216-7512-468f-8db0-647921e29c9f-ovnkube-script-lib\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215838 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-host\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae9e8a1-8e64-4c18-a812-aca9b6948847-konnectivity-ca\") pod \"konnectivity-agent-zfhq4\" (UID: \"6ae9e8a1-8e64-4c18-a812-aca9b6948847\") " pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215881 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215924 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-var-lib-openvswitch\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bb84b52-52bc-4234-93c0-fd885a659f48-serviceca\") pod \"node-ca-dcwzd\" (UID: \"1bb84b52-52bc-4234-93c0-fd885a659f48\") " pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-systemd-units\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215999 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-hostroot\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-sysctl-d\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-run-multus-certs\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdv8x\" (UniqueName: \"kubernetes.io/projected/8f364216-7512-468f-8db0-647921e29c9f-kube-api-access-jdv8x\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-socket-dir-parent\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-run-netns\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-run-ovn\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.217105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f364216-7512-468f-8db0-647921e29c9f-env-overrides\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-kubernetes\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-cni-dir\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216279 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb5da059-fd1d-45dc-a594-f8a4f08352dc-cni-binary-copy\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-cnibin\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56stn\" (UniqueName: \"kubernetes.io/projected/fb5da059-fd1d-45dc-a594-f8a4f08352dc-kube-api-access-56stn\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216353 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-cnibin\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216403 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-var-lib-kubelet\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215885 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-etc-kubernetes\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215973 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-run-systemd\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216547 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-sysctl-d\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216623 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-run-multus-certs\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216653 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-daemon-config\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.215728 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-cni-netd\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.216763 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.216834 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret podName:2bb9fc30-3e5e-41bb-abfc-11d27086161b nodeName:}" failed. No retries permitted until 2026-07-21 17:01:41.716814463 +0000 UTC m=+3.143640544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret") pod "global-pull-secret-syncer-9wmh5" (UID: "2bb9fc30-3e5e-41bb-abfc-11d27086161b") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216969 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-socket-dir-parent\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216976 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ae9e8a1-8e64-4c18-a812-aca9b6948847-konnectivity-ca\") pod \"konnectivity-agent-zfhq4\" (UID: \"6ae9e8a1-8e64-4c18-a812-aca9b6948847\") " pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:01:41.217995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217030 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-hostroot\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.216364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2bb9fc30-3e5e-41bb-abfc-11d27086161b-kubelet-config\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217089 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-kubernetes\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217101 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2bb9fc30-3e5e-41bb-abfc-11d27086161b-kubelet-config\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217144 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-run-ovn\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217403 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bb84b52-52bc-4234-93c0-fd885a659f48-serviceca\") pod \"node-ca-dcwzd\" (UID: \"1bb84b52-52bc-4234-93c0-fd885a659f48\") " pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217451 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-systemd-units\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217488 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-cni-bin\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217618 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f364216-7512-468f-8db0-647921e29c9f-env-overrides\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217672 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-host-run-netns\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217737 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-multus-cni-dir\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217751 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f364216-7512-468f-8db0-647921e29c9f-ovnkube-script-lib\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-lib-modules\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217795 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spkbg\" (UniqueName: \"kubernetes.io/projected/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-kube-api-access-spkbg\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-lib-modules\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-system-cni-dir\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f364216-7512-468f-8db0-647921e29c9f-ovnkube-config\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.219131 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-systemd\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.220211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-node-log\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.220211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-log-socket\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.220211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217995 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-systemd\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.220211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.217935 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb5da059-fd1d-45dc-a594-f8a4f08352dc-system-cni-dir\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.220211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.218075 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-log-socket\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.220211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.218076 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f364216-7512-468f-8db0-647921e29c9f-node-log\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.220211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.218306 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f364216-7512-468f-8db0-647921e29c9f-ovnkube-config\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.220211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.218314 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-etc-tuned\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.220211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.218511 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f364216-7512-468f-8db0-647921e29c9f-ovn-node-metrics-cert\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.220211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.218666 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ae9e8a1-8e64-4c18-a812-aca9b6948847-agent-certs\") pod \"konnectivity-agent-zfhq4\" (UID: \"6ae9e8a1-8e64-4c18-a812-aca9b6948847\") " pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:01:41.220713 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.220614 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-tmp\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.234500 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.234468 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spkbg\" (UniqueName: \"kubernetes.io/projected/5ffcb71f-d1bf-4ed1-8092-d96afde9cad5-kube-api-access-spkbg\") pod \"tuned-djdh6\" (UID: \"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5\") " pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.237090 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.237057 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdv8x\" (UniqueName: \"kubernetes.io/projected/8f364216-7512-468f-8db0-647921e29c9f-kube-api-access-jdv8x\") pod \"ovnkube-node-52kzf\" (UID: \"8f364216-7512-468f-8db0-647921e29c9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.237239 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.237105 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56stn\" (UniqueName: \"kubernetes.io/projected/fb5da059-fd1d-45dc-a594-f8a4f08352dc-kube-api-access-56stn\") pod \"multus-kx7sk\" (UID: \"fb5da059-fd1d-45dc-a594-f8a4f08352dc\") " pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.237405 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.237371 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrvg2\" (UniqueName: \"kubernetes.io/projected/1bb84b52-52bc-4234-93c0-fd885a659f48-kube-api-access-vrvg2\") pod \"node-ca-dcwzd\" (UID: \"1bb84b52-52bc-4234-93c0-fd885a659f48\") " pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.310383 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.310349 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xtzb2" Jul 21 17:01:41.318543 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.318493 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w98hx" Jul 21 17:01:41.323833 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:41.323791 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9582d63_4893_4fa0_916c_01eb9a2f34e5.slice/crio-eeb6d2b81124f6b6de2f2ae6a3a516eea897ebf9122f5f3c7bc4ffe9d7530f2c WatchSource:0}: Error finding container eeb6d2b81124f6b6de2f2ae6a3a516eea897ebf9122f5f3c7bc4ffe9d7530f2c: Status 404 returned error can't find the container with id eeb6d2b81124f6b6de2f2ae6a3a516eea897ebf9122f5f3c7bc4ffe9d7530f2c Jul 21 17:01:41.328197 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.328163 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7mn88" Jul 21 17:01:41.331185 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:41.331151 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cfe833_0b60_46e2_8ea3_f79da62ade52.slice/crio-1e82092d540e977a7bacbb3bf5f01ac4f786a1a956818b22781bbb615f59d607 WatchSource:0}: Error finding container 1e82092d540e977a7bacbb3bf5f01ac4f786a1a956818b22781bbb615f59d607: Status 404 returned error can't find the container with id 1e82092d540e977a7bacbb3bf5f01ac4f786a1a956818b22781bbb615f59d607 Jul 21 17:01:41.334504 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.334357 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" Jul 21 17:01:41.338548 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:41.338508 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea7850a_c3ef_4e12_93ad_d45749c5fcb3.slice/crio-b2c53427afb1653d3c0f8e2d1abf2be8a6039438283ca8e8190e494427e2e3f1 WatchSource:0}: Error finding container b2c53427afb1653d3c0f8e2d1abf2be8a6039438283ca8e8190e494427e2e3f1: Status 404 returned error can't find the container with id b2c53427afb1653d3c0f8e2d1abf2be8a6039438283ca8e8190e494427e2e3f1 Jul 21 17:01:41.343157 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.343137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kx7sk" Jul 21 17:01:41.343620 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:41.343565 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868c5fc4_fa01_42de_9d01_327840e2e28c.slice/crio-5641ca013ecb0bca069ba0c0d4b92026b80106baef0fdbe031ec88c4a3d8f842 WatchSource:0}: Error finding container 5641ca013ecb0bca069ba0c0d4b92026b80106baef0fdbe031ec88c4a3d8f842: Status 404 returned error can't find the container with id 5641ca013ecb0bca069ba0c0d4b92026b80106baef0fdbe031ec88c4a3d8f842 Jul 21 17:01:41.350823 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.350803 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:01:41.357704 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.357674 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dcwzd" Jul 21 17:01:41.364710 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.364687 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-djdh6" Jul 21 17:01:41.371370 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.371336 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:01:41.622464 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.622416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:41.622675 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.622608 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:41.622730 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.622689 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs podName:e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5 nodeName:}" failed. No retries permitted until 2026-07-21 17:01:42.622666785 +0000 UTC m=+4.049492861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs") pod "network-metrics-daemon-mmld6" (UID: "e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:41.708443 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:41.708412 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae9e8a1_8e64_4c18_a812_aca9b6948847.slice/crio-8073b856e62f2844dc6149d8d5e1a5409fccbcc7a9e5989d131a7690b83bf29d WatchSource:0}: Error finding container 8073b856e62f2844dc6149d8d5e1a5409fccbcc7a9e5989d131a7690b83bf29d: Status 404 returned error can't find the container with id 8073b856e62f2844dc6149d8d5e1a5409fccbcc7a9e5989d131a7690b83bf29d Jul 21 17:01:41.710527 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:41.710115 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ffcb71f_d1bf_4ed1_8092_d96afde9cad5.slice/crio-1d68103a3bcf9ff5d7ca16604f7ee5232427340ca5e38671180f6b25ec8db275 WatchSource:0}: Error finding container 1d68103a3bcf9ff5d7ca16604f7ee5232427340ca5e38671180f6b25ec8db275: Status 404 returned error can't find the container with id 1d68103a3bcf9ff5d7ca16604f7ee5232427340ca5e38671180f6b25ec8db275 Jul 21 17:01:41.711625 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:41.711575 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f364216_7512_468f_8db0_647921e29c9f.slice/crio-10405200aaf5572594cdd82fb8b440d067d4005808abfee8a98a2e73e8bb9ad6 WatchSource:0}: Error finding container 10405200aaf5572594cdd82fb8b440d067d4005808abfee8a98a2e73e8bb9ad6: Status 404 returned error can't find the container with id 10405200aaf5572594cdd82fb8b440d067d4005808abfee8a98a2e73e8bb9ad6 Jul 21 17:01:41.712794 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:41.712772 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5da059_fd1d_45dc_a594_f8a4f08352dc.slice/crio-1871080b27afdb802547c94ab2e765bd4c357406f64a7f0d82ef81f9d60efb2d WatchSource:0}: Error finding container 1871080b27afdb802547c94ab2e765bd4c357406f64a7f0d82ef81f9d60efb2d: Status 404 returned error can't find the container with id 1871080b27afdb802547c94ab2e765bd4c357406f64a7f0d82ef81f9d60efb2d Jul 21 17:01:41.714465 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:01:41.714445 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb84b52_52bc_4234_93c0_fd885a659f48.slice/crio-6aaef78f537758fd755e9ebd8d98c94b37b1958c00f1ab11d26070dec74fcab1 WatchSource:0}: Error finding container 6aaef78f537758fd755e9ebd8d98c94b37b1958c00f1ab11d26070dec74fcab1: Status 404 returned error can't find the container with id 6aaef78f537758fd755e9ebd8d98c94b37b1958c00f1ab11d26070dec74fcab1 Jul 21 17:01:41.723430 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.723406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:41.723530 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:41.723441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxvp\" (UniqueName: \"kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp\") pod \"network-check-target-9dw5f\" (UID: \"49ef420e-de57-415f-aa1d-6351ccda544e\") " pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:41.723584 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.723569 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:41.723632 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.723585 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:01:41.723632 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.723603 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:01:41.723632 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.723617 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgxvp for pod openshift-network-diagnostics/network-check-target-9dw5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:41.723735 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.723638 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret podName:2bb9fc30-3e5e-41bb-abfc-11d27086161b nodeName:}" failed. No retries permitted until 2026-07-21 17:01:42.723620773 +0000 UTC m=+4.150446849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret") pod "global-pull-secret-syncer-9wmh5" (UID: "2bb9fc30-3e5e-41bb-abfc-11d27086161b") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:41.723735 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:41.723661 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp podName:49ef420e-de57-415f-aa1d-6351ccda544e nodeName:}" failed. No retries permitted until 2026-07-21 17:01:42.723645421 +0000 UTC m=+4.150471493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgxvp" (UniqueName: "kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp") pod "network-check-target-9dw5f" (UID: "49ef420e-de57-415f-aa1d-6351ccda544e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:42.101663 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.101581 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:56:41 +0000 UTC" deadline="2028-04-02 23:06:34.28900709 +0000 UTC" Jul 21 17:01:42.101663 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.101667 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14910h4m52.18734544s" Jul 21 17:01:42.108655 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.108619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:42.108817 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:42.108774 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:01:42.122716 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.122671 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" event={"ID":"ed12d33b7d36e6679d99991d700ea551","Type":"ContainerStarted","Data":"182508651f59ca526a9b91ea6a1a12dc2e804db65ae5f0bbcfc44aecad26b26b"} Jul 21 17:01:42.124655 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.124624 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dcwzd" event={"ID":"1bb84b52-52bc-4234-93c0-fd885a659f48","Type":"ContainerStarted","Data":"6aaef78f537758fd755e9ebd8d98c94b37b1958c00f1ab11d26070dec74fcab1"} Jul 21 17:01:42.127254 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.127218 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kx7sk" event={"ID":"fb5da059-fd1d-45dc-a594-f8a4f08352dc","Type":"ContainerStarted","Data":"1871080b27afdb802547c94ab2e765bd4c357406f64a7f0d82ef81f9d60efb2d"} Jul 21 17:01:42.130748 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.130670 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-djdh6" event={"ID":"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5","Type":"ContainerStarted","Data":"1d68103a3bcf9ff5d7ca16604f7ee5232427340ca5e38671180f6b25ec8db275"} Jul 21 17:01:42.132459 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.132386 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w98hx" event={"ID":"e1cfe833-0b60-46e2-8ea3-f79da62ade52","Type":"ContainerStarted","Data":"1e82092d540e977a7bacbb3bf5f01ac4f786a1a956818b22781bbb615f59d607"} Jul 21 17:01:42.133945 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.133868 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xtzb2" event={"ID":"b9582d63-4893-4fa0-916c-01eb9a2f34e5","Type":"ContainerStarted","Data":"eeb6d2b81124f6b6de2f2ae6a3a516eea897ebf9122f5f3c7bc4ffe9d7530f2c"} Jul 21 17:01:42.135596 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.135540 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" event={"ID":"8f364216-7512-468f-8db0-647921e29c9f","Type":"ContainerStarted","Data":"10405200aaf5572594cdd82fb8b440d067d4005808abfee8a98a2e73e8bb9ad6"} Jul 21 17:01:42.139990 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.139960 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfhq4" event={"ID":"6ae9e8a1-8e64-4c18-a812-aca9b6948847","Type":"ContainerStarted","Data":"8073b856e62f2844dc6149d8d5e1a5409fccbcc7a9e5989d131a7690b83bf29d"} Jul 21 17:01:42.141983 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.141955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" event={"ID":"868c5fc4-fa01-42de-9d01-327840e2e28c","Type":"ContainerStarted","Data":"5641ca013ecb0bca069ba0c0d4b92026b80106baef0fdbe031ec88c4a3d8f842"} Jul 21 17:01:42.146497 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.146469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7mn88" event={"ID":"bea7850a-c3ef-4e12-93ad-d45749c5fcb3","Type":"ContainerStarted","Data":"b2c53427afb1653d3c0f8e2d1abf2be8a6039438283ca8e8190e494427e2e3f1"} Jul 21 17:01:42.631820 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.631032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:42.631820 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:42.631270 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:42.631820 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:42.631345 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs podName:e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5 nodeName:}" failed. No retries permitted until 2026-07-21 17:01:44.63132308 +0000 UTC m=+6.058149166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs") pod "network-metrics-daemon-mmld6" (UID: "e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:42.732676 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.731707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:42.732676 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:42.731769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxvp\" (UniqueName: \"kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp\") pod \"network-check-target-9dw5f\" (UID: \"49ef420e-de57-415f-aa1d-6351ccda544e\") " pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:42.732676 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:42.731965 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:01:42.732676 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:42.731992 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:01:42.732676 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:42.732005 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgxvp for pod openshift-network-diagnostics/network-check-target-9dw5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:42.732676 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:42.732070 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp podName:49ef420e-de57-415f-aa1d-6351ccda544e nodeName:}" failed. No retries permitted until 2026-07-21 17:01:44.732048781 +0000 UTC m=+6.158874870 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgxvp" (UniqueName: "kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp") pod "network-check-target-9dw5f" (UID: "49ef420e-de57-415f-aa1d-6351ccda544e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:42.732676 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:42.732507 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:42.732676 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:42.732568 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret podName:2bb9fc30-3e5e-41bb-abfc-11d27086161b nodeName:}" failed. No retries permitted until 2026-07-21 17:01:44.732551389 +0000 UTC m=+6.159377487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret") pod "global-pull-secret-syncer-9wmh5" (UID: "2bb9fc30-3e5e-41bb-abfc-11d27086161b") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:43.102447 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:43.102090 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:56:41 +0000 UTC" deadline="2028-03-30 08:45:08.24093052 +0000 UTC" Jul 21 17:01:43.102447 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:43.102399 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14823h43m25.13854038s" Jul 21 17:01:43.110215 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:43.109675 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:43.110215 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:43.109825 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:01:43.110802 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:43.110612 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:43.110802 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:43.110732 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:01:43.155370 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:43.155334 2562 generic.go:356] "Generic (PLEG): container finished" podID="ed12d33b7d36e6679d99991d700ea551" containerID="182508651f59ca526a9b91ea6a1a12dc2e804db65ae5f0bbcfc44aecad26b26b" exitCode=0 Jul 21 17:01:43.155528 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:43.155389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" event={"ID":"ed12d33b7d36e6679d99991d700ea551","Type":"ContainerDied","Data":"182508651f59ca526a9b91ea6a1a12dc2e804db65ae5f0bbcfc44aecad26b26b"} Jul 21 17:01:44.109730 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:44.109115 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:44.109730 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:44.109294 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:01:44.648163 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:44.648116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:44.648358 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:44.648290 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:44.648428 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:44.648362 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs podName:e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5 nodeName:}" failed. No retries permitted until 2026-07-21 17:01:48.648341594 +0000 UTC m=+10.075167678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs") pod "network-metrics-daemon-mmld6" (UID: "e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:44.748725 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:44.748678 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:44.748926 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:44.748765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxvp\" (UniqueName: \"kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp\") pod \"network-check-target-9dw5f\" (UID: \"49ef420e-de57-415f-aa1d-6351ccda544e\") " pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:44.748980 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:44.748938 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:01:44.748980 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:44.748957 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:01:44.748980 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:44.748971 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgxvp for pod openshift-network-diagnostics/network-check-target-9dw5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:44.749136 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:44.749039 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp podName:49ef420e-de57-415f-aa1d-6351ccda544e nodeName:}" failed. No retries permitted until 2026-07-21 17:01:48.749018433 +0000 UTC m=+10.175844521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgxvp" (UniqueName: "kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp") pod "network-check-target-9dw5f" (UID: "49ef420e-de57-415f-aa1d-6351ccda544e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:44.749523 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:44.749499 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:44.749649 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:44.749562 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret podName:2bb9fc30-3e5e-41bb-abfc-11d27086161b nodeName:}" failed. No retries permitted until 2026-07-21 17:01:48.749545003 +0000 UTC m=+10.176371090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret") pod "global-pull-secret-syncer-9wmh5" (UID: "2bb9fc30-3e5e-41bb-abfc-11d27086161b") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:45.111846 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:45.111128 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:45.111846 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:45.111264 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:01:45.111846 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:45.111684 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:45.111846 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:45.111788 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:01:46.109333 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:46.108754 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:46.109333 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:46.108927 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:01:47.112741 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:47.112049 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:47.112741 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:47.112229 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:01:47.113339 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:47.112790 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:47.113339 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:47.112900 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:01:48.108907 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:48.108870 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:48.109093 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:48.109031 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:01:48.683577 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:48.683538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:48.683986 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:48.683739 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:48.683986 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:48.683816 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs podName:e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5 nodeName:}" failed. No retries permitted until 2026-07-21 17:01:56.683796416 +0000 UTC m=+18.110622502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs") pod "network-metrics-daemon-mmld6" (UID: "e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:48.784786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:48.784548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:48.784786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:48.784590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxvp\" (UniqueName: \"kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp\") pod \"network-check-target-9dw5f\" (UID: \"49ef420e-de57-415f-aa1d-6351ccda544e\") " pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:48.784786 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:48.784702 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:48.784786 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:48.784711 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:01:48.784786 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:48.784729 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:01:48.784786 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:48.784738 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgxvp for pod openshift-network-diagnostics/network-check-target-9dw5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:48.784786 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:48.784787 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret podName:2bb9fc30-3e5e-41bb-abfc-11d27086161b nodeName:}" failed. No retries permitted until 2026-07-21 17:01:56.784763521 +0000 UTC m=+18.211589613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret") pod "global-pull-secret-syncer-9wmh5" (UID: "2bb9fc30-3e5e-41bb-abfc-11d27086161b") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:48.785321 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:48.784811 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp podName:49ef420e-de57-415f-aa1d-6351ccda544e nodeName:}" failed. No retries permitted until 2026-07-21 17:01:56.784798471 +0000 UTC m=+18.211624543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgxvp" (UniqueName: "kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp") pod "network-check-target-9dw5f" (UID: "49ef420e-de57-415f-aa1d-6351ccda544e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:49.110183 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:49.109670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:49.110183 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:49.109797 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:01:49.110409 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:49.110302 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:49.110467 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:49.110440 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:01:50.109032 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:50.108996 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:50.109477 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:50.109135 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:01:51.109276 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:51.108591 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:51.109276 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:51.108731 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:01:51.109276 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:51.108601 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:51.109276 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:51.109179 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:01:52.109480 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:52.108960 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:52.109480 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:52.109108 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:01:53.109117 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:53.108609 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:53.109117 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:53.108744 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:01:53.109359 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:53.109087 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:53.109479 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:53.109461 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:01:54.108835 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:54.108798 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:54.109259 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:54.108952 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:01:55.108758 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:55.108720 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:55.108983 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:55.108734 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:55.108983 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:55.108863 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:01:55.108983 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:55.108918 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:01:56.108723 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:56.108682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:56.108962 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:56.108837 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:01:56.746372 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:56.746338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:56.746887 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:56.746463 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:56.746887 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:56.746541 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs podName:e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:12.746507443 +0000 UTC m=+34.173333515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs") pod "network-metrics-daemon-mmld6" (UID: "e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:01:56.846796 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:56.846755 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:56.846796 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:56.846804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxvp\" (UniqueName: \"kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp\") pod \"network-check-target-9dw5f\" (UID: \"49ef420e-de57-415f-aa1d-6351ccda544e\") " pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:56.847024 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:56.846899 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:56.847024 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:56.846919 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:01:56.847024 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:56.846946 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:01:56.847024 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:56.846960 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgxvp for pod openshift-network-diagnostics/network-check-target-9dw5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:56.847024 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:56.846961 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret podName:2bb9fc30-3e5e-41bb-abfc-11d27086161b nodeName:}" failed. No retries permitted until 2026-07-21 17:02:12.846943115 +0000 UTC m=+34.273769192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret") pod "global-pull-secret-syncer-9wmh5" (UID: "2bb9fc30-3e5e-41bb-abfc-11d27086161b") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:01:56.847024 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:56.847000 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp podName:49ef420e-de57-415f-aa1d-6351ccda544e nodeName:}" failed. No retries permitted until 2026-07-21 17:02:12.84698855 +0000 UTC m=+34.273814621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgxvp" (UniqueName: "kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp") pod "network-check-target-9dw5f" (UID: "49ef420e-de57-415f-aa1d-6351ccda544e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:01:57.108237 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:57.108202 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:57.108420 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:57.108203 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:57.108420 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:57.108343 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:01:57.108554 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:57.108423 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:01:58.108875 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:58.108833 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:01:58.109344 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:58.108982 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:01:59.108886 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:59.108852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:01:59.109293 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:01:59.108852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:01:59.109293 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:59.108980 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:01:59.109293 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:01:59.109062 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:02:00.109051 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:00.109014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:00.109411 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:00.109142 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:02:01.108716 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:01.108656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:01.108896 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:01.108811 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:02:01.108896 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:01.108875 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:01.109043 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:01.108987 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:02:02.108777 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.108747 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:02.109244 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:02.108964 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:02:02.197029 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.196817 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" event={"ID":"8f364216-7512-468f-8db0-647921e29c9f","Type":"ContainerStarted","Data":"d7df135af4e32eb928ae50564d7c8d47d8fe53cf027edfb6f1d3ca1b774d0935"} Jul 21 17:02:02.198485 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.198460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zfhq4" event={"ID":"6ae9e8a1-8e64-4c18-a812-aca9b6948847","Type":"ContainerStarted","Data":"7e1a4a666cf572ab86790a37957d2a2ea2cecd820f23c89ab76b19b9708786f7"} Jul 21 17:02:02.200870 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.200845 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" event={"ID":"868c5fc4-fa01-42de-9d01-327840e2e28c","Type":"ContainerStarted","Data":"65a65217345bd3d3c06ac631e594fd81bcdceff6a421c3305e5577aed6e8ab7e"} Jul 21 17:02:02.202099 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.202073 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7mn88" event={"ID":"bea7850a-c3ef-4e12-93ad-d45749c5fcb3","Type":"ContainerStarted","Data":"80a746900c6a64fbdb929230a9e5743970d460c6477922f47c183ae5de18b1cd"} Jul 21 17:02:02.205729 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.205694 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal" event={"ID":"7d63a5b170b7d76783b7c341a24c4e00","Type":"ContainerStarted","Data":"fdc40359d180a27b9bfcdb8c71a291d8ac62f5d8740e02b971b84494366bee23"} Jul 21 17:02:02.207943 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.207917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" event={"ID":"ed12d33b7d36e6679d99991d700ea551","Type":"ContainerStarted","Data":"464af8d7873f2b53159524ba0c252ae78da650911f62dd20b3335029b307afc6"} Jul 21 17:02:02.209817 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.209794 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dcwzd" event={"ID":"1bb84b52-52bc-4234-93c0-fd885a659f48","Type":"ContainerStarted","Data":"bf7a24cb7d1f5aa92712f1ce38003e50f5e34becc8583aa0e1bcca6f283ccade"} Jul 21 17:02:02.211619 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.211597 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kx7sk" event={"ID":"fb5da059-fd1d-45dc-a594-f8a4f08352dc","Type":"ContainerStarted","Data":"8d6ad5e72a8fd2437052fedb91952c40f6a3fe55fe0fb48c257d67f6c6a090d7"} Jul 21 17:02:02.213508 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.213487 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-djdh6" event={"ID":"5ffcb71f-d1bf-4ed1-8092-d96afde9cad5","Type":"ContainerStarted","Data":"bf9966a2c5d9bbc3517fb7b9967ce0ebe414c2ec33ba06558a54ba5a56152a76"} Jul 21 17:02:02.215763 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.215739 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w98hx" event={"ID":"e1cfe833-0b60-46e2-8ea3-f79da62ade52","Type":"ContainerStarted","Data":"bb8e4f5c6b0e0c22783a5c15104dcfd38af1cea48ec8de640b4949ac8f3adc7a"} Jul 21 17:02:02.230775 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.230507 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zfhq4" podStartSLOduration=2.040128093 podStartE2EDuration="22.230488234s" totalImagesPullingTime="20.190360141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:02.230058022 +0000 UTC m=+23.656884116" watchObservedRunningTime="2026-07-21 17:02:02.230488234 +0000 UTC m=+23.657314319" Jul 21 17:02:02.303752 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.301250 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-64.ec2.internal" podStartSLOduration=21.301188594 podStartE2EDuration="21.301188594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:02.300677539 +0000 UTC m=+23.727503632" watchObservedRunningTime="2026-07-21 17:02:02.301188594 +0000 UTC m=+23.728014688" Jul 21 17:02:02.303752 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.301919 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kx7sk" podStartSLOduration=3.019395619 podStartE2EDuration="23.301902647s" totalImagesPullingTime="20.282507028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:02.270294257 +0000 UTC m=+23.697120350" watchObservedRunningTime="2026-07-21 17:02:02.301902647 +0000 UTC m=+23.728728741" Jul 21 17:02:02.354862 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.354811 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-64.ec2.internal" podStartSLOduration=21.354793766 podStartE2EDuration="21.354793766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:02.330376952 +0000 UTC m=+23.757203042" watchObservedRunningTime="2026-07-21 17:02:02.354793766 +0000 UTC m=+23.781619860" Jul 21 17:02:02.355075 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.355042 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7mn88" podStartSLOduration=2.795529991 podStartE2EDuration="23.355029654s" totalImagesPullingTime="20.559499663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:02.355030596 +0000 UTC m=+23.781856671" watchObservedRunningTime="2026-07-21 17:02:02.355029654 +0000 UTC m=+23.781855749" Jul 21 17:02:02.383801 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.383754 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dcwzd" podStartSLOduration=2.200094131 podStartE2EDuration="22.383736482s" totalImagesPullingTime="20.183642351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:02.383642429 +0000 UTC m=+23.810468522" watchObservedRunningTime="2026-07-21 17:02:02.383736482 +0000 UTC m=+23.810562575" Jul 21 17:02:02.461190 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.461146 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-djdh6" podStartSLOduration=2.257274939 podStartE2EDuration="22.46112932s" totalImagesPullingTime="20.203854381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:02.417773672 +0000 UTC m=+23.844599765" watchObservedRunningTime="2026-07-21 17:02:02.46112932 +0000 UTC m=+23.887955413" Jul 21 17:02:02.649064 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.648984 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:02:02.649616 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:02.649597 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:02:03.109000 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.108962 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:03.109755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.109011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:03.109755 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:03.109120 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:02:03.109755 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:03.109242 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:02:03.219422 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.219385 2562 generic.go:356] "Generic (PLEG): container finished" podID="e1cfe833-0b60-46e2-8ea3-f79da62ade52" containerID="bb8e4f5c6b0e0c22783a5c15104dcfd38af1cea48ec8de640b4949ac8f3adc7a" exitCode=0 Jul 21 17:02:03.219652 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.219475 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w98hx" event={"ID":"e1cfe833-0b60-46e2-8ea3-f79da62ade52","Type":"ContainerDied","Data":"bb8e4f5c6b0e0c22783a5c15104dcfd38af1cea48ec8de640b4949ac8f3adc7a"} Jul 21 17:02:03.222838 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.222814 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" event={"ID":"8f364216-7512-468f-8db0-647921e29c9f","Type":"ContainerStarted","Data":"7ccdb2911b9a3506798ace4dd9e9ed12a21a0e3c1d3e583e65d3aba59927f0b8"} Jul 21 17:02:03.222966 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.222904 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" event={"ID":"8f364216-7512-468f-8db0-647921e29c9f","Type":"ContainerStarted","Data":"54c74fcd3df4c1a4a613debe696237b0184e2862885446748f9e841e7d324983"} Jul 21 17:02:03.222966 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.222957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" event={"ID":"8f364216-7512-468f-8db0-647921e29c9f","Type":"ContainerStarted","Data":"a0a80e82e99d80e1625d45a306bceffb4b03c3ad1412c89b95171dc45e20ad35"} Jul 21 17:02:03.223051 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.222996 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" event={"ID":"8f364216-7512-468f-8db0-647921e29c9f","Type":"ContainerStarted","Data":"b2169ed9841906acbd818782f40b27ceed50802b4d92db3f73b74e2d8f19a3ad"} Jul 21 17:02:03.223051 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.223025 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" event={"ID":"8f364216-7512-468f-8db0-647921e29c9f","Type":"ContainerStarted","Data":"d08bd217fc84e05fdc98030d07f4b7c29106ffa6c2aeeb910309da81f2559411"} Jul 21 17:02:03.223859 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.223837 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:02:03.224298 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.224280 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zfhq4" Jul 21 17:02:03.814343 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:03.814313 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 17:02:04.079409 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:04.079293 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T17:02:03.814333794Z","UUID":"449098b3-ee15-4da1-84f0-4570493fb13a","Handler":null,"Name":"","Endpoint":""} Jul 21 17:02:04.082179 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:04.082142 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 17:02:04.082179 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:04.082181 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 17:02:04.108818 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:04.108782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:04.108996 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:04.108934 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:02:04.227854 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:04.227819 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" event={"ID":"868c5fc4-fa01-42de-9d01-327840e2e28c","Type":"ContainerStarted","Data":"cd64678b477b18d5052308a53cad5be6c5863a4111edbff33d02180b0fb57635"} Jul 21 17:02:04.229702 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:04.229675 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xtzb2" event={"ID":"b9582d63-4893-4fa0-916c-01eb9a2f34e5","Type":"ContainerStarted","Data":"6b1cfa0e181a069eec865d2e444a34a86da0ec4d9d0313c2d674070066797ffe"} Jul 21 17:02:04.255215 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:04.255166 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xtzb2" podStartSLOduration=4.67033167 podStartE2EDuration="25.25515024s" totalImagesPullingTime="20.58481857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:04.255088306 +0000 UTC m=+25.681914400" watchObservedRunningTime="2026-07-21 17:02:04.25515024 +0000 UTC m=+25.681976332" Jul 21 17:02:05.108366 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:05.108335 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:05.108579 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:05.108456 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:02:05.108579 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:05.108504 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:05.108684 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:05.108617 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:02:05.234824 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:05.234791 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" event={"ID":"8f364216-7512-468f-8db0-647921e29c9f","Type":"ContainerStarted","Data":"d9afa3e25cb9dd695f72bc4b6347f65713d5f75e1f35f5e0d4da06f88b2907b5"} Jul 21 17:02:06.109185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:06.109150 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:06.109365 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:06.109281 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:02:06.239669 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:06.239627 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" event={"ID":"868c5fc4-fa01-42de-9d01-327840e2e28c","Type":"ContainerStarted","Data":"3902a04d5bac057033c2b9dc7eea7a094f90c7101258fa913f664d4ef85e42b1"} Jul 21 17:02:06.269078 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:06.269018 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fqdz" podStartSLOduration=3.741646074 podStartE2EDuration="27.26900283s" totalImagesPullingTime="23.527356756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:06.268859663 +0000 UTC m=+27.695685756" watchObservedRunningTime="2026-07-21 17:02:06.26900283 +0000 UTC m=+27.695828922" Jul 21 17:02:07.108834 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:07.108597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:07.109007 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:07.108597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:07.109007 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:07.108957 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:02:07.109101 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:07.109063 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:02:08.108225 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:08.108192 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:08.108601 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:08.108304 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:02:08.249240 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:08.249182 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" event={"ID":"8f364216-7512-468f-8db0-647921e29c9f","Type":"ContainerStarted","Data":"ab14b61f95411c79a2c059a90d402fe5b6897ecef0db7d1d7f99ef6cab850e5f"} Jul 21 17:02:08.249583 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:08.249555 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:02:08.249646 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:08.249636 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:02:08.249701 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:08.249688 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:02:08.267348 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:08.267257 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:02:08.269851 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:08.269734 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:02:08.285417 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:08.285375 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" podStartSLOduration=8.001726867 podStartE2EDuration="28.285361578s" totalImagesPullingTime="20.283634711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:08.28403042 +0000 UTC m=+29.710856513" watchObservedRunningTime="2026-07-21 17:02:08.285361578 +0000 UTC m=+29.712187671" Jul 21 17:02:09.109804 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:09.109764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:09.110716 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:09.109857 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:02:09.110716 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:09.109908 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:09.110716 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:09.109999 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:02:09.253153 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:09.252961 2562 generic.go:356] "Generic (PLEG): container finished" podID="e1cfe833-0b60-46e2-8ea3-f79da62ade52" containerID="ccad85ade341960719478188a24f56273cb870fd0aaf043d2c8fb32b1db30684" exitCode=0 Jul 21 17:02:09.253406 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:09.253044 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w98hx" event={"ID":"e1cfe833-0b60-46e2-8ea3-f79da62ade52","Type":"ContainerDied","Data":"ccad85ade341960719478188a24f56273cb870fd0aaf043d2c8fb32b1db30684"} Jul 21 17:02:10.109100 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:10.109067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:10.109296 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:10.109183 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:02:10.612267 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:10.612233 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mmld6"] Jul 21 17:02:10.612618 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:10.612360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:10.612618 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:10.612453 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:02:10.614479 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:10.614458 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9wmh5"] Jul 21 17:02:10.614602 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:10.614560 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:10.614652 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:10.614636 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:02:10.620275 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:10.620250 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9dw5f"] Jul 21 17:02:10.620394 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:10.620346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:10.620470 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:10.620445 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:02:11.259638 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:11.259602 2562 generic.go:356] "Generic (PLEG): container finished" podID="e1cfe833-0b60-46e2-8ea3-f79da62ade52" containerID="4554a04ecc50e0ba8c89692dfb209339f291fe3404570695505d15b783477017" exitCode=0 Jul 21 17:02:11.259800 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:11.259655 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w98hx" event={"ID":"e1cfe833-0b60-46e2-8ea3-f79da62ade52","Type":"ContainerDied","Data":"4554a04ecc50e0ba8c89692dfb209339f291fe3404570695505d15b783477017"} Jul 21 17:02:12.108746 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:12.108705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:12.108746 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:12.108742 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:12.109326 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:12.108831 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:12.109326 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.108852 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:02:12.109326 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.108900 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:02:12.109326 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.109000 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:02:12.763678 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:12.763652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:12.763782 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.763770 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:02:12.763841 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.763833 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs podName:e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:44.763819635 +0000 UTC m=+66.190645710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs") pod "network-metrics-daemon-mmld6" (UID: "e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:02:12.864672 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:12.864626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:12.864859 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:12.864679 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxvp\" (UniqueName: \"kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp\") pod \"network-check-target-9dw5f\" (UID: \"49ef420e-de57-415f-aa1d-6351ccda544e\") " pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:12.864859 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.864787 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:02:12.864859 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.864800 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:02:12.864859 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.864823 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:02:12.864859 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.864837 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgxvp for pod openshift-network-diagnostics/network-check-target-9dw5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:02:12.865037 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.864865 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret podName:2bb9fc30-3e5e-41bb-abfc-11d27086161b nodeName:}" failed. No retries permitted until 2026-07-21 17:02:44.86485011 +0000 UTC m=+66.291676186 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret") pod "global-pull-secret-syncer-9wmh5" (UID: "2bb9fc30-3e5e-41bb-abfc-11d27086161b") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:02:12.865037 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:12.864888 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp podName:49ef420e-de57-415f-aa1d-6351ccda544e nodeName:}" failed. No retries permitted until 2026-07-21 17:02:44.864873482 +0000 UTC m=+66.291699572 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgxvp" (UniqueName: "kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp") pod "network-check-target-9dw5f" (UID: "49ef420e-de57-415f-aa1d-6351ccda544e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:02:13.266394 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:13.266358 2562 generic.go:356] "Generic (PLEG): container finished" podID="e1cfe833-0b60-46e2-8ea3-f79da62ade52" containerID="37707cfc27b16e833b02553efcc78cd618e62ce7fbaf59d3f7e4729f938c3935" exitCode=0 Jul 21 17:02:13.266394 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:13.266397 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w98hx" event={"ID":"e1cfe833-0b60-46e2-8ea3-f79da62ade52","Type":"ContainerDied","Data":"37707cfc27b16e833b02553efcc78cd618e62ce7fbaf59d3f7e4729f938c3935"} Jul 21 17:02:14.108415 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:14.108375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:14.108636 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:14.108375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:14.108636 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:14.108535 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mmld6" podUID="e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5" Jul 21 17:02:14.108636 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:14.108385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:14.108806 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:14.108634 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dw5f" podUID="49ef420e-de57-415f-aa1d-6351ccda544e" Jul 21 17:02:14.108806 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:14.108695 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9wmh5" podUID="2bb9fc30-3e5e-41bb-abfc-11d27086161b" Jul 21 17:02:15.749925 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.749617 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-64.ec2.internal" event="NodeReady" Jul 21 17:02:15.750318 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.750005 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 17:02:15.797566 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.797528 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6db68fc5c-vmjrb"] Jul 21 17:02:15.801224 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.801200 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.805297 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.805074 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 17:02:15.805297 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.805090 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 17:02:15.805478 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.805454 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 17:02:15.805665 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.805638 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fjqct\"" Jul 21 17:02:15.810248 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.810224 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ntx42"] Jul 21 17:02:15.814438 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.814414 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:15.814758 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.814735 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 17:02:15.818108 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.818088 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 17:02:15.818344 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.818290 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 17:02:15.820821 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.820052 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2sbmq"] Jul 21 17:02:15.821263 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.821166 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhhmq\"" Jul 21 17:02:15.824065 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.824042 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db68fc5c-vmjrb"] Jul 21 17:02:15.824183 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.824147 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2sbmq" Jul 21 17:02:15.826820 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.826799 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 17:02:15.826923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.826892 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4j6ls\"" Jul 21 17:02:15.827190 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.827171 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 17:02:15.827288 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.827228 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 17:02:15.836141 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.835873 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ntx42"] Jul 21 17:02:15.836141 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.835936 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2sbmq"] Jul 21 17:02:15.886492 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.886458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.886693 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.886502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-installation-pull-secrets\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.886693 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.886545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sxd5\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-kube-api-access-9sxd5\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.886693 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.886578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-image-registry-private-configuration\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.886693 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.886595 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30514292-2e10-4f03-bb6b-477468668f13-ca-trust-extracted\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.886693 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.886611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-registry-certificates\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.886693 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.886627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-trusted-ca\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.886893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.886692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-bound-sa-token\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.987273 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.987238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.987457 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.987293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:15.987457 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.987324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-installation-pull-secrets\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.987457 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.987349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74f5d180-f2a1-4374-9f31-871aa10b67cb-config-volume\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:15.987457 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.987376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sxd5\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-kube-api-access-9sxd5\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.987457 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:15.987410 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 17:02:15.987457 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.987417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-image-registry-private-configuration\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.987457 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:15.987440 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db68fc5c-vmjrb: secret "image-registry-tls" not found Jul 21 17:02:15.987786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.987464 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f5d180-f2a1-4374-9f31-871aa10b67cb-tmp-dir\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:15.988009 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:15.987986 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls podName:30514292-2e10-4f03-bb6b-477468668f13 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:16.48795525 +0000 UTC m=+37.914781345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls") pod "image-registry-6db68fc5c-vmjrb" (UID: "30514292-2e10-4f03-bb6b-477468668f13") : secret "image-registry-tls" not found Jul 21 17:02:15.988205 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.988062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30514292-2e10-4f03-bb6b-477468668f13-ca-trust-extracted\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.988205 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.988094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-registry-certificates\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.988205 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.988157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-trusted-ca\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.988205 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.988185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjzf5\" (UniqueName: \"kubernetes.io/projected/74f5d180-f2a1-4374-9f31-871aa10b67cb-kube-api-access-xjzf5\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:15.988408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.988235 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcnvx\" (UniqueName: \"kubernetes.io/projected/9500322d-e6bc-4636-bc5f-6162ab5a7f15-kube-api-access-qcnvx\") pod \"ingress-canary-2sbmq\" (UID: \"9500322d-e6bc-4636-bc5f-6162ab5a7f15\") " pod="openshift-ingress-canary/ingress-canary-2sbmq" Jul 21 17:02:15.988408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.988296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9500322d-e6bc-4636-bc5f-6162ab5a7f15-cert\") pod \"ingress-canary-2sbmq\" (UID: \"9500322d-e6bc-4636-bc5f-6162ab5a7f15\") " pod="openshift-ingress-canary/ingress-canary-2sbmq" Jul 21 17:02:15.988408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.988341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-bound-sa-token\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.988575 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.988414 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30514292-2e10-4f03-bb6b-477468668f13-ca-trust-extracted\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.989067 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.988799 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-registry-certificates\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.989862 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.989842 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-trusted-ca\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.992359 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.992336 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-image-registry-private-configuration\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.992484 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.992367 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-installation-pull-secrets\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.998815 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.998791 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-bound-sa-token\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:15.998953 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:15.998938 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sxd5\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-kube-api-access-9sxd5\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:16.088769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.088731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:16.088966 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.088784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74f5d180-f2a1-4374-9f31-871aa10b67cb-config-volume\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:16.088966 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.088832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f5d180-f2a1-4374-9f31-871aa10b67cb-tmp-dir\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:16.088966 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.088863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjzf5\" (UniqueName: \"kubernetes.io/projected/74f5d180-f2a1-4374-9f31-871aa10b67cb-kube-api-access-xjzf5\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:16.088966 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.088888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcnvx\" (UniqueName: \"kubernetes.io/projected/9500322d-e6bc-4636-bc5f-6162ab5a7f15-kube-api-access-qcnvx\") pod \"ingress-canary-2sbmq\" (UID: \"9500322d-e6bc-4636-bc5f-6162ab5a7f15\") " pod="openshift-ingress-canary/ingress-canary-2sbmq" Jul 21 17:02:16.088966 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:16.088901 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:02:16.088966 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.088937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9500322d-e6bc-4636-bc5f-6162ab5a7f15-cert\") pod \"ingress-canary-2sbmq\" (UID: \"9500322d-e6bc-4636-bc5f-6162ab5a7f15\") " pod="openshift-ingress-canary/ingress-canary-2sbmq" Jul 21 17:02:16.089271 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:16.088973 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls podName:74f5d180-f2a1-4374-9f31-871aa10b67cb nodeName:}" failed. No retries permitted until 2026-07-21 17:02:16.588954038 +0000 UTC m=+38.015780127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls") pod "dns-default-ntx42" (UID: "74f5d180-f2a1-4374-9f31-871aa10b67cb") : secret "dns-default-metrics-tls" not found Jul 21 17:02:16.089536 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.089497 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74f5d180-f2a1-4374-9f31-871aa10b67cb-config-volume\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:16.089668 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.089646 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74f5d180-f2a1-4374-9f31-871aa10b67cb-tmp-dir\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:16.091939 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.091912 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9500322d-e6bc-4636-bc5f-6162ab5a7f15-cert\") pod \"ingress-canary-2sbmq\" (UID: \"9500322d-e6bc-4636-bc5f-6162ab5a7f15\") " pod="openshift-ingress-canary/ingress-canary-2sbmq" Jul 21 17:02:16.093021 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.092982 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:16.099159 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.099136 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjzf5\" (UniqueName: \"kubernetes.io/projected/74f5d180-f2a1-4374-9f31-871aa10b67cb-kube-api-access-xjzf5\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:16.099446 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.099427 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcnvx\" (UniqueName: \"kubernetes.io/projected/9500322d-e6bc-4636-bc5f-6162ab5a7f15-kube-api-access-qcnvx\") pod \"ingress-canary-2sbmq\" (UID: \"9500322d-e6bc-4636-bc5f-6162ab5a7f15\") " pod="openshift-ingress-canary/ingress-canary-2sbmq" Jul 21 17:02:16.108698 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.108666 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:16.108854 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.108712 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:16.108854 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.108773 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:16.111530 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.111484 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 17:02:16.111753 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.111723 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 17:02:16.111753 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.111740 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5l8sr\"" Jul 21 17:02:16.111933 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.111917 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 17:02:16.111981 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.111948 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 17:02:16.112124 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.112111 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59btl\"" Jul 21 17:02:16.137095 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.137068 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2sbmq" Jul 21 17:02:16.241030 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.240985 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:16.294356 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.294326 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2sbmq"] Jul 21 17:02:16.298342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:16.298313 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9500322d_e6bc_4636_bc5f_6162ab5a7f15.slice/crio-d76ec2ff60d424ed3f79ba76aacc285458414b9ab7cfe7b31575ff6635fc5230 WatchSource:0}: Error finding container d76ec2ff60d424ed3f79ba76aacc285458414b9ab7cfe7b31575ff6635fc5230: Status 404 returned error can't find the container with id d76ec2ff60d424ed3f79ba76aacc285458414b9ab7cfe7b31575ff6635fc5230 Jul 21 17:02:16.492467 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.492385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:16.492640 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:16.492559 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 17:02:16.492640 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:16.492580 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db68fc5c-vmjrb: secret "image-registry-tls" not found Jul 21 17:02:16.492711 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:16.492647 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls podName:30514292-2e10-4f03-bb6b-477468668f13 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:17.49263104 +0000 UTC m=+38.919457114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls") pod "image-registry-6db68fc5c-vmjrb" (UID: "30514292-2e10-4f03-bb6b-477468668f13") : secret "image-registry-tls" not found Jul 21 17:02:16.593348 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:16.593310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:16.593534 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:16.593492 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:02:16.593607 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:16.593592 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls podName:74f5d180-f2a1-4374-9f31-871aa10b67cb nodeName:}" failed. No retries permitted until 2026-07-21 17:02:17.593571165 +0000 UTC m=+39.020397241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls") pod "dns-default-ntx42" (UID: "74f5d180-f2a1-4374-9f31-871aa10b67cb") : secret "dns-default-metrics-tls" not found Jul 21 17:02:17.277057 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:17.277007 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2sbmq" event={"ID":"9500322d-e6bc-4636-bc5f-6162ab5a7f15","Type":"ContainerStarted","Data":"d76ec2ff60d424ed3f79ba76aacc285458414b9ab7cfe7b31575ff6635fc5230"} Jul 21 17:02:17.499583 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:17.499546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:17.499757 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:17.499739 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 17:02:17.499826 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:17.499765 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db68fc5c-vmjrb: secret "image-registry-tls" not found Jul 21 17:02:17.499874 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:17.499837 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls podName:30514292-2e10-4f03-bb6b-477468668f13 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:19.499818443 +0000 UTC m=+40.926644515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls") pod "image-registry-6db68fc5c-vmjrb" (UID: "30514292-2e10-4f03-bb6b-477468668f13") : secret "image-registry-tls" not found Jul 21 17:02:17.600176 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:17.600129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:17.600348 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:17.600311 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:02:17.600414 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:17.600393 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls podName:74f5d180-f2a1-4374-9f31-871aa10b67cb nodeName:}" failed. No retries permitted until 2026-07-21 17:02:19.600372849 +0000 UTC m=+41.027198933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls") pod "dns-default-ntx42" (UID: "74f5d180-f2a1-4374-9f31-871aa10b67cb") : secret "dns-default-metrics-tls" not found Jul 21 17:02:18.285164 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:18.284819 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w98hx" event={"ID":"e1cfe833-0b60-46e2-8ea3-f79da62ade52","Type":"ContainerStarted","Data":"765d0e3a60f4ea5234c96f3a2997e626de6deaec1497ac84d1a4b73ffc0139ac"} Jul 21 17:02:19.290134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.290101 2562 generic.go:356] "Generic (PLEG): container finished" podID="e1cfe833-0b60-46e2-8ea3-f79da62ade52" containerID="765d0e3a60f4ea5234c96f3a2997e626de6deaec1497ac84d1a4b73ffc0139ac" exitCode=0 Jul 21 17:02:19.290499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.290182 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w98hx" event={"ID":"e1cfe833-0b60-46e2-8ea3-f79da62ade52","Type":"ContainerDied","Data":"765d0e3a60f4ea5234c96f3a2997e626de6deaec1497ac84d1a4b73ffc0139ac"} Jul 21 17:02:19.314220 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.314193 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8"] Jul 21 17:02:19.326330 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.326304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8" Jul 21 17:02:19.329036 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.329006 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 21 17:02:19.329144 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.329037 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 21 17:02:19.329144 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.329043 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v9scq\"" Jul 21 17:02:19.336557 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.336529 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8"] Jul 21 17:02:19.416111 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.416078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfdjb\" (UniqueName: \"kubernetes.io/projected/4381557d-43c7-4dfa-9ee1-4767702c9036-kube-api-access-cfdjb\") pod \"volume-data-source-validator-78cf4c6f6-5z4q8\" (UID: \"4381557d-43c7-4dfa-9ee1-4767702c9036\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8" Jul 21 17:02:19.423072 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.423041 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7"] Jul 21 17:02:19.440981 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.440938 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k"] Jul 21 17:02:19.441259 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.441235 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:19.443993 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.443836 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 21 17:02:19.443993 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.443943 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 21 17:02:19.444189 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.444018 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 21 17:02:19.444189 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.444053 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 21 17:02:19.444285 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.444208 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vqhsc\"" Jul 21 17:02:19.452294 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.451338 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-v5cw2"] Jul 21 17:02:19.453690 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.453054 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.456112 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.456084 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 21 17:02:19.456222 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.456179 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6c6sh\"" Jul 21 17:02:19.456332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.456315 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 21 17:02:19.456426 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.456410 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 21 17:02:19.456563 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.456542 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 21 17:02:19.467349 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.467232 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k"] Jul 21 17:02:19.467349 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.467274 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7"] Jul 21 17:02:19.467349 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.467295 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-v5cw2"] Jul 21 17:02:19.467349 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.467346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.470263 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.470123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 21 17:02:19.470400 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.470379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9hj95\"" Jul 21 17:02:19.470537 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.470427 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 21 17:02:19.470537 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.470380 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 17:02:19.470848 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.470832 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 17:02:19.477797 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.477386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:19.478270 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.478252 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 21 17:02:19.516564 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.516531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:19.516888 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.516651 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 17:02:19.516888 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.516846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdjb\" (UniqueName: \"kubernetes.io/projected/4381557d-43c7-4dfa-9ee1-4767702c9036-kube-api-access-cfdjb\") pod \"volume-data-source-validator-78cf4c6f6-5z4q8\" (UID: \"4381557d-43c7-4dfa-9ee1-4767702c9036\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8" Jul 21 17:02:19.516888 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.516867 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db68fc5c-vmjrb: secret "image-registry-tls" not found Jul 21 17:02:19.517139 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.516952 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls podName:30514292-2e10-4f03-bb6b-477468668f13 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:23.516930521 +0000 UTC m=+44.943756591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls") pod "image-registry-6db68fc5c-vmjrb" (UID: "30514292-2e10-4f03-bb6b-477468668f13") : secret "image-registry-tls" not found Jul 21 17:02:19.517378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.517359 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9"] Jul 21 17:02:19.531488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.531456 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4"] Jul 21 17:02:19.531626 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.531604 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:19.531979 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.531928 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfdjb\" (UniqueName: \"kubernetes.io/projected/4381557d-43c7-4dfa-9ee1-4767702c9036-kube-api-access-cfdjb\") pod \"volume-data-source-validator-78cf4c6f6-5z4q8\" (UID: \"4381557d-43c7-4dfa-9ee1-4767702c9036\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8" Jul 21 17:02:19.535205 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.535172 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 21 17:02:19.535324 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.535238 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 21 17:02:19.536205 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.536180 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gnpft\"" Jul 21 17:02:19.536351 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.536251 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 21 17:02:19.537720 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.537697 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69d6dcbc6-52rk5"] Jul 21 17:02:19.538184 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.538162 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:19.543623 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.543496 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-thl5j\"" Jul 21 17:02:19.543623 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.543498 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 17:02:19.543828 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.543811 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 17:02:19.544070 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.544050 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 21 17:02:19.545744 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.545716 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 21 17:02:19.547818 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.547791 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-zlwt2"] Jul 21 17:02:19.547960 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.547939 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.551194 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.551174 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 21 17:02:19.551677 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.551661 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 21 17:02:19.551769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.551714 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 21 17:02:19.551769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.551760 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 17:02:19.551964 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.551951 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 17:02:19.552005 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.551963 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jdtws\"" Jul 21 17:02:19.552064 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.552046 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 21 17:02:19.555762 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.555742 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9"] Jul 21 17:02:19.555867 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.555774 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4"] Jul 21 17:02:19.555867 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.555789 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-zlwt2"] Jul 21 17:02:19.555867 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.555801 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69d6dcbc6-52rk5"] Jul 21 17:02:19.556018 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.555876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.558273 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.558257 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 21 17:02:19.558472 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.558459 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 21 17:02:19.562081 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.562032 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 21 17:02:19.562081 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.562056 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 21 17:02:19.562239 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.562085 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cncgd\"" Jul 21 17:02:19.565421 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.565400 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 21 17:02:19.595258 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.595220 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:19.617441 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1997ec8d-0dca-46b0-99da-b416ea6c50ec-serving-cert\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.617619 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1997ec8d-0dca-46b0-99da-b416ea6c50ec-snapshots\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.617619 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617484 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/105321d0-98bd-4ecf-b05b-162f7cde46f4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-p5lk7\" (UID: \"105321d0-98bd-4ecf-b05b-162f7cde46f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:19.617619 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617530 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/105321d0-98bd-4ecf-b05b-162f7cde46f4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-p5lk7\" (UID: \"105321d0-98bd-4ecf-b05b-162f7cde46f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:19.617619 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617576 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8b74\" (UniqueName: \"kubernetes.io/projected/105321d0-98bd-4ecf-b05b-162f7cde46f4-kube-api-access-q8b74\") pod \"kube-storage-version-migrator-operator-7658d9b749-p5lk7\" (UID: \"105321d0-98bd-4ecf-b05b-162f7cde46f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:19.617619 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1997ec8d-0dca-46b0-99da-b416ea6c50ec-tmp\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.617833 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1997ec8d-0dca-46b0-99da-b416ea6c50ec-service-ca-bundle\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.617833 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1997ec8d-0dca-46b0-99da-b416ea6c50ec-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.617833 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvwmj\" (UniqueName: \"kubernetes.io/projected/6d375130-c287-41c1-902d-068410ff6bcd-kube-api-access-cvwmj\") pod \"service-ca-operator-5bcbc94c78-74g4k\" (UID: \"6d375130-c287-41c1-902d-068410ff6bcd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.617833 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nhgb\" (UniqueName: \"kubernetes.io/projected/1997ec8d-0dca-46b0-99da-b416ea6c50ec-kube-api-access-5nhgb\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.617833 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d375130-c287-41c1-902d-068410ff6bcd-serving-cert\") pod \"service-ca-operator-5bcbc94c78-74g4k\" (UID: \"6d375130-c287-41c1-902d-068410ff6bcd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.617995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d375130-c287-41c1-902d-068410ff6bcd-config\") pod \"service-ca-operator-5bcbc94c78-74g4k\" (UID: \"6d375130-c287-41c1-902d-068410ff6bcd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.617995 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.617879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:19.618058 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.618001 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:02:19.618058 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.618052 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls podName:74f5d180-f2a1-4374-9f31-871aa10b67cb nodeName:}" failed. No retries permitted until 2026-07-21 17:02:23.618038896 +0000 UTC m=+45.044864970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls") pod "dns-default-ntx42" (UID: "74f5d180-f2a1-4374-9f31-871aa10b67cb") : secret "dns-default-metrics-tls" not found Jul 21 17:02:19.634234 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.634198 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw"] Jul 21 17:02:19.642034 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.642009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8" Jul 21 17:02:19.650762 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.650735 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw" Jul 21 17:02:19.654780 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.654722 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4h6h6\"" Jul 21 17:02:19.657609 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.657584 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw"] Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.728880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d375130-c287-41c1-902d-068410ff6bcd-config\") pod \"service-ca-operator-5bcbc94c78-74g4k\" (UID: \"6d375130-c287-41c1-902d-068410ff6bcd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.728951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-default-certificate\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.728986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv2nj\" (UniqueName: \"kubernetes.io/projected/557d6c3a-29e4-4aa1-b180-e7646476a34e-kube-api-access-bv2nj\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1997ec8d-0dca-46b0-99da-b416ea6c50ec-serving-cert\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1997ec8d-0dca-46b0-99da-b416ea6c50ec-snapshots\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/105321d0-98bd-4ecf-b05b-162f7cde46f4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-p5lk7\" (UID: \"105321d0-98bd-4ecf-b05b-162f7cde46f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn62j\" (UniqueName: \"kubernetes.io/projected/8974afe7-625b-40f6-bb4a-5c9d82359cdc-kube-api-access-nn62j\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trt8l\" (UniqueName: \"kubernetes.io/projected/a86149c7-2cc8-4325-8228-2224094207ce-kube-api-access-trt8l\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/105321d0-98bd-4ecf-b05b-162f7cde46f4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-p5lk7\" (UID: \"105321d0-98bd-4ecf-b05b-162f7cde46f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8b74\" (UniqueName: \"kubernetes.io/projected/105321d0-98bd-4ecf-b05b-162f7cde46f4-kube-api-access-q8b74\") pod \"kube-storage-version-migrator-operator-7658d9b749-p5lk7\" (UID: \"105321d0-98bd-4ecf-b05b-162f7cde46f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1997ec8d-0dca-46b0-99da-b416ea6c50ec-tmp\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxsfz\" (UniqueName: \"kubernetes.io/projected/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-kube-api-access-pxsfz\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1997ec8d-0dca-46b0-99da-b416ea6c50ec-service-ca-bundle\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.730705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8974afe7-625b-40f6-bb4a-5c9d82359cdc-serving-cert\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8974afe7-625b-40f6-bb4a-5c9d82359cdc-trusted-ca\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-stats-auth\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8974afe7-625b-40f6-bb4a-5c9d82359cdc-config\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1997ec8d-0dca-46b0-99da-b416ea6c50ec-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729480 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvwmj\" (UniqueName: \"kubernetes.io/projected/6d375130-c287-41c1-902d-068410ff6bcd-kube-api-access-cvwmj\") pod \"service-ca-operator-5bcbc94c78-74g4k\" (UID: \"6d375130-c287-41c1-902d-068410ff6bcd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nhgb\" (UniqueName: \"kubernetes.io/projected/1997ec8d-0dca-46b0-99da-b416ea6c50ec-kube-api-access-5nhgb\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d375130-c287-41c1-902d-068410ff6bcd-serving-cert\") pod \"service-ca-operator-5bcbc94c78-74g4k\" (UID: \"6d375130-c287-41c1-902d-068410ff6bcd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.729676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.731555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.730302 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d375130-c287-41c1-902d-068410ff6bcd-config\") pod \"service-ca-operator-5bcbc94c78-74g4k\" (UID: \"6d375130-c287-41c1-902d-068410ff6bcd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.742322 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.740838 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1997ec8d-0dca-46b0-99da-b416ea6c50ec-serving-cert\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.742322 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.741421 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1997ec8d-0dca-46b0-99da-b416ea6c50ec-snapshots\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.742322 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.741945 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/105321d0-98bd-4ecf-b05b-162f7cde46f4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-p5lk7\" (UID: \"105321d0-98bd-4ecf-b05b-162f7cde46f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:19.754139 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.746278 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1997ec8d-0dca-46b0-99da-b416ea6c50ec-tmp\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.754139 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.746792 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1997ec8d-0dca-46b0-99da-b416ea6c50ec-service-ca-bundle\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.754139 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.748190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1997ec8d-0dca-46b0-99da-b416ea6c50ec-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.754139 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.753728 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d375130-c287-41c1-902d-068410ff6bcd-serving-cert\") pod \"service-ca-operator-5bcbc94c78-74g4k\" (UID: \"6d375130-c287-41c1-902d-068410ff6bcd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.758587 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.757712 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/105321d0-98bd-4ecf-b05b-162f7cde46f4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-p5lk7\" (UID: \"105321d0-98bd-4ecf-b05b-162f7cde46f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:19.758587 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.758073 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8b74\" (UniqueName: \"kubernetes.io/projected/105321d0-98bd-4ecf-b05b-162f7cde46f4-kube-api-access-q8b74\") pod \"kube-storage-version-migrator-operator-7658d9b749-p5lk7\" (UID: \"105321d0-98bd-4ecf-b05b-162f7cde46f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:19.758587 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.758531 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:19.759031 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.758972 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvwmj\" (UniqueName: \"kubernetes.io/projected/6d375130-c287-41c1-902d-068410ff6bcd-kube-api-access-cvwmj\") pod \"service-ca-operator-5bcbc94c78-74g4k\" (UID: \"6d375130-c287-41c1-902d-068410ff6bcd\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.760839 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.760671 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nhgb\" (UniqueName: \"kubernetes.io/projected/1997ec8d-0dca-46b0-99da-b416ea6c50ec-kube-api-access-5nhgb\") pod \"insights-operator-555d9d7885-v5cw2\" (UID: \"1997ec8d-0dca-46b0-99da-b416ea6c50ec\") " pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.767441 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.767406 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" Jul 21 17:02:19.820773 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.820740 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8"] Jul 21 17:02:19.823511 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.823487 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-v5cw2" Jul 21 17:02:19.824441 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:19.824408 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4381557d_43c7_4dfa_9ee1_4767702c9036.slice/crio-c978d778ad6c68ed292abc4e4b100bd74457d1e09315c102e3547d44a52bc7d8 WatchSource:0}: Error finding container c978d778ad6c68ed292abc4e4b100bd74457d1e09315c102e3547d44a52bc7d8: Status 404 returned error can't find the container with id c978d778ad6c68ed292abc4e4b100bd74457d1e09315c102e3547d44a52bc7d8 Jul 21 17:02:19.830386 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.830479 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.830479 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-default-certificate\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.830642 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.830569 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 17:02:19.830642 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.830598 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:20.330574607 +0000 UTC m=+41.757400693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : configmap references non-existent config key: service-ca.crt Jul 21 17:02:19.830745 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.830644 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:20.330624804 +0000 UTC m=+41.757450876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : secret "router-metrics-certs-default" not found Jul 21 17:02:19.830745 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv2nj\" (UniqueName: \"kubernetes.io/projected/557d6c3a-29e4-4aa1-b180-e7646476a34e-kube-api-access-bv2nj\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:19.830745 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn62j\" (UniqueName: \"kubernetes.io/projected/8974afe7-625b-40f6-bb4a-5c9d82359cdc-kube-api-access-nn62j\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.830944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trt8l\" (UniqueName: \"kubernetes.io/projected/a86149c7-2cc8-4325-8228-2224094207ce-kube-api-access-trt8l\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.830944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830803 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:19.830944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxsfz\" (UniqueName: \"kubernetes.io/projected/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-kube-api-access-pxsfz\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:19.830944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m2jn\" (UniqueName: \"kubernetes.io/projected/c1febf6d-ee2b-470d-b8ff-5f8e96db69fe-kube-api-access-9m2jn\") pod \"network-check-source-7bc5b6bf85-wmkqw\" (UID: \"c1febf6d-ee2b-470d-b8ff-5f8e96db69fe\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw" Jul 21 17:02:19.830944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8974afe7-625b-40f6-bb4a-5c9d82359cdc-serving-cert\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.831185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8974afe7-625b-40f6-bb4a-5c9d82359cdc-trusted-ca\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.831185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.830985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-stats-auth\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.831185 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.830958 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 17:02:19.831185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.831025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8974afe7-625b-40f6-bb4a-5c9d82359cdc-config\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.831185 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.831053 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls podName:557d6c3a-29e4-4aa1-b180-e7646476a34e nodeName:}" failed. No retries permitted until 2026-07-21 17:02:20.331040129 +0000 UTC m=+41.757866200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2btp9" (UID: "557d6c3a-29e4-4aa1-b180-e7646476a34e") : secret "samples-operator-tls" not found Jul 21 17:02:19.831185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.831083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:19.831185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.831119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:19.831964 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.831789 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8974afe7-625b-40f6-bb4a-5c9d82359cdc-config\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.831964 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.831889 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:19.831964 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.831930 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8974afe7-625b-40f6-bb4a-5c9d82359cdc-trusted-ca\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.831964 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:19.831936 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls podName:06d7cf7a-e354-4bf0-89d3-c3440c3e9555 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:20.331920657 +0000 UTC m=+41.758746730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dchw4" (UID: "06d7cf7a-e354-4bf0-89d3-c3440c3e9555") : secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:19.832164 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.831992 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:19.833836 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.833801 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-default-certificate\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.833907 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.833871 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-stats-auth\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.833907 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.833885 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8974afe7-625b-40f6-bb4a-5c9d82359cdc-serving-cert\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.841946 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.841920 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn62j\" (UniqueName: \"kubernetes.io/projected/8974afe7-625b-40f6-bb4a-5c9d82359cdc-kube-api-access-nn62j\") pod \"console-operator-565b7b569d-zlwt2\" (UID: \"8974afe7-625b-40f6-bb4a-5c9d82359cdc\") " pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.842085 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.841926 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv2nj\" (UniqueName: \"kubernetes.io/projected/557d6c3a-29e4-4aa1-b180-e7646476a34e-kube-api-access-bv2nj\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:19.842308 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.842287 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxsfz\" (UniqueName: \"kubernetes.io/projected/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-kube-api-access-pxsfz\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:19.843155 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.843136 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trt8l\" (UniqueName: \"kubernetes.io/projected/a86149c7-2cc8-4325-8228-2224094207ce-kube-api-access-trt8l\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:19.855409 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.855375 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:19.872034 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.872005 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:19.931898 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.931864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m2jn\" (UniqueName: \"kubernetes.io/projected/c1febf6d-ee2b-470d-b8ff-5f8e96db69fe-kube-api-access-9m2jn\") pod \"network-check-source-7bc5b6bf85-wmkqw\" (UID: \"c1febf6d-ee2b-470d-b8ff-5f8e96db69fe\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw" Jul 21 17:02:19.938735 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.938691 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k"] Jul 21 17:02:19.943149 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.943122 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m2jn\" (UniqueName: \"kubernetes.io/projected/c1febf6d-ee2b-470d-b8ff-5f8e96db69fe-kube-api-access-9m2jn\") pod \"network-check-source-7bc5b6bf85-wmkqw\" (UID: \"c1febf6d-ee2b-470d-b8ff-5f8e96db69fe\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw" Jul 21 17:02:19.972765 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:19.972731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw" Jul 21 17:02:20.053722 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:20.053632 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" Jul 21 17:02:20.296136 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:20.296097 2562 generic.go:356] "Generic (PLEG): container finished" podID="e1cfe833-0b60-46e2-8ea3-f79da62ade52" containerID="4bad3eceac662621447fe61e86e81903bf52bb8c3f7c70f7df04b189fed43164" exitCode=0 Jul 21 17:02:20.296577 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:20.296214 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w98hx" event={"ID":"e1cfe833-0b60-46e2-8ea3-f79da62ade52","Type":"ContainerDied","Data":"4bad3eceac662621447fe61e86e81903bf52bb8c3f7c70f7df04b189fed43164"} Jul 21 17:02:20.297695 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:20.297669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8" event={"ID":"4381557d-43c7-4dfa-9ee1-4767702c9036","Type":"ContainerStarted","Data":"c978d778ad6c68ed292abc4e4b100bd74457d1e09315c102e3547d44a52bc7d8"} Jul 21 17:02:20.335948 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:20.335853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:20.335948 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:20.335908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:20.336157 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:20.335952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:20.336157 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:20.336048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:20.336157 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:20.336051 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:20.336157 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:20.336084 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 17:02:20.336157 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:20.336132 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls podName:06d7cf7a-e354-4bf0-89d3-c3440c3e9555 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:21.336111118 +0000 UTC m=+42.762937190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dchw4" (UID: "06d7cf7a-e354-4bf0-89d3-c3440c3e9555") : secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:20.336157 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:20.336152 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:21.336142881 +0000 UTC m=+42.762968954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : configmap references non-existent config key: service-ca.crt Jul 21 17:02:20.336481 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:20.336167 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:21.336158373 +0000 UTC m=+42.762984448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : secret "router-metrics-certs-default" not found Jul 21 17:02:20.336481 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:20.336184 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 17:02:20.336481 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:20.336247 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls podName:557d6c3a-29e4-4aa1-b180-e7646476a34e nodeName:}" failed. No retries permitted until 2026-07-21 17:02:21.336231085 +0000 UTC m=+42.763057159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2btp9" (UID: "557d6c3a-29e4-4aa1-b180-e7646476a34e") : secret "samples-operator-tls" not found Jul 21 17:02:20.696494 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:20.696403 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d375130_c287_41c1_902d_068410ff6bcd.slice/crio-36222bbfdaa83a98d87e54f1553390138e720bb7933fde5dc852412c296d9b6a WatchSource:0}: Error finding container 36222bbfdaa83a98d87e54f1553390138e720bb7933fde5dc852412c296d9b6a: Status 404 returned error can't find the container with id 36222bbfdaa83a98d87e54f1553390138e720bb7933fde5dc852412c296d9b6a Jul 21 17:02:20.883292 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:20.883258 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-zlwt2"] Jul 21 17:02:20.886254 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:20.886229 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8974afe7_625b_40f6_bb4a_5c9d82359cdc.slice/crio-55f065832598e92c31d7952353869ef64005923cbe61c452791dba15fa099611 WatchSource:0}: Error finding container 55f065832598e92c31d7952353869ef64005923cbe61c452791dba15fa099611: Status 404 returned error can't find the container with id 55f065832598e92c31d7952353869ef64005923cbe61c452791dba15fa099611 Jul 21 17:02:21.104595 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.104560 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-v5cw2"] Jul 21 17:02:21.108658 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.108544 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw"] Jul 21 17:02:21.112052 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.112031 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7"] Jul 21 17:02:21.141864 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:21.141832 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1997ec8d_0dca_46b0_99da_b416ea6c50ec.slice/crio-232c2a9b42279d836224b6e0b5cc0c5efb8896f501935d903cd2676f19e9ef73 WatchSource:0}: Error finding container 232c2a9b42279d836224b6e0b5cc0c5efb8896f501935d903cd2676f19e9ef73: Status 404 returned error can't find the container with id 232c2a9b42279d836224b6e0b5cc0c5efb8896f501935d903cd2676f19e9ef73 Jul 21 17:02:21.142489 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:21.142463 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105321d0_98bd_4ecf_b05b_162f7cde46f4.slice/crio-4afb95891c2f89385f351c9015647885b51412ffd6df47d7422452bc009af78a WatchSource:0}: Error finding container 4afb95891c2f89385f351c9015647885b51412ffd6df47d7422452bc009af78a: Status 404 returned error can't find the container with id 4afb95891c2f89385f351c9015647885b51412ffd6df47d7422452bc009af78a Jul 21 17:02:21.143280 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:21.143213 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1febf6d_ee2b_470d_b8ff_5f8e96db69fe.slice/crio-5d12f336bc246e1130d32911cc27e09ade0637167819c29745115cb580cb0f24 WatchSource:0}: Error finding container 5d12f336bc246e1130d32911cc27e09ade0637167819c29745115cb580cb0f24: Status 404 returned error can't find the container with id 5d12f336bc246e1130d32911cc27e09ade0637167819c29745115cb580cb0f24 Jul 21 17:02:21.304643 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.304610 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w98hx" event={"ID":"e1cfe833-0b60-46e2-8ea3-f79da62ade52","Type":"ContainerStarted","Data":"e505b6122dac87bb63af3a6d71988273dab19c27975228757bfb8abcf3d24301"} Jul 21 17:02:21.306134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.306097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw" event={"ID":"c1febf6d-ee2b-470d-b8ff-5f8e96db69fe","Type":"ContainerStarted","Data":"5d12f336bc246e1130d32911cc27e09ade0637167819c29745115cb580cb0f24"} Jul 21 17:02:21.307430 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.307403 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" event={"ID":"8974afe7-625b-40f6-bb4a-5c9d82359cdc","Type":"ContainerStarted","Data":"55f065832598e92c31d7952353869ef64005923cbe61c452791dba15fa099611"} Jul 21 17:02:21.308577 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.308549 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" event={"ID":"105321d0-98bd-4ecf-b05b-162f7cde46f4","Type":"ContainerStarted","Data":"4afb95891c2f89385f351c9015647885b51412ffd6df47d7422452bc009af78a"} Jul 21 17:02:21.311473 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.311448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v5cw2" event={"ID":"1997ec8d-0dca-46b0-99da-b416ea6c50ec","Type":"ContainerStarted","Data":"232c2a9b42279d836224b6e0b5cc0c5efb8896f501935d903cd2676f19e9ef73"} Jul 21 17:02:21.312648 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.312619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" event={"ID":"6d375130-c287-41c1-902d-068410ff6bcd","Type":"ContainerStarted","Data":"36222bbfdaa83a98d87e54f1553390138e720bb7933fde5dc852412c296d9b6a"} Jul 21 17:02:21.332691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.332637 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w98hx" podStartSLOduration=9.259620137 podStartE2EDuration="42.33261988s" totalImagesPullingTime="33.072999743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:21.330979843 +0000 UTC m=+42.757805937" watchObservedRunningTime="2026-07-21 17:02:21.33261988 +0000 UTC m=+42.759445966" Jul 21 17:02:21.346704 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.346664 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:21.346879 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.346718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:21.346879 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.346757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:21.346879 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.346834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:21.347028 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:21.346982 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 17:02:21.347081 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:21.347073 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls podName:557d6c3a-29e4-4aa1-b180-e7646476a34e nodeName:}" failed. No retries permitted until 2026-07-21 17:02:23.347028071 +0000 UTC m=+44.773854149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2btp9" (UID: "557d6c3a-29e4-4aa1-b180-e7646476a34e") : secret "samples-operator-tls" not found Jul 21 17:02:21.347441 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:21.347420 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:21.347572 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:21.347478 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls podName:06d7cf7a-e354-4bf0-89d3-c3440c3e9555 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:23.347463305 +0000 UTC m=+44.774289382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dchw4" (UID: "06d7cf7a-e354-4bf0-89d3-c3440c3e9555") : secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:21.347572 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:21.347560 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 17:02:21.347700 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:21.347599 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:23.347588192 +0000 UTC m=+44.774414277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : secret "router-metrics-certs-default" not found Jul 21 17:02:21.347700 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:21.347669 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:23.347657492 +0000 UTC m=+44.774483575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : configmap references non-existent config key: service-ca.crt Jul 21 17:02:21.573113 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.573065 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:21.651926 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:21.651889 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:22.079040 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:22.079004 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:22.180503 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:22.180428 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:22.318144 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:22.318103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8" event={"ID":"4381557d-43c7-4dfa-9ee1-4767702c9036","Type":"ContainerStarted","Data":"0edd564d259092cab117f5aac02b49b4a476c687ba21a9bc6bdd33992abfd000"} Jul 21 17:02:22.320777 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:22.320744 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2sbmq" event={"ID":"9500322d-e6bc-4636-bc5f-6162ab5a7f15","Type":"ContainerStarted","Data":"737973bad3f5a580bbbfc287e98f6aa43568a476e13745b40725b4dd4a3d789e"} Jul 21 17:02:22.373496 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:22.373384 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-5z4q8" podStartSLOduration=1.023464125 podStartE2EDuration="3.373357757s" totalImagesPullingTime="2.349893632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:22.339690905 +0000 UTC m=+43.766516999" watchObservedRunningTime="2026-07-21 17:02:22.373357757 +0000 UTC m=+43.800183851" Jul 21 17:02:22.438784 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:22.438665 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:22.540359 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:22.540302 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:23.366343 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:23.366303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:23.366847 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:23.366407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:23.366847 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:23.366445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:23.366847 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:23.366492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:23.366847 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.366707 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:27.366683752 +0000 UTC m=+48.793509837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : configmap references non-existent config key: service-ca.crt Jul 21 17:02:23.366847 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.366797 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 17:02:23.366847 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.366836 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls podName:557d6c3a-29e4-4aa1-b180-e7646476a34e nodeName:}" failed. No retries permitted until 2026-07-21 17:02:27.366824848 +0000 UTC m=+48.793650924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2btp9" (UID: "557d6c3a-29e4-4aa1-b180-e7646476a34e") : secret "samples-operator-tls" not found Jul 21 17:02:23.367161 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.366894 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:23.367161 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.366930 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls podName:06d7cf7a-e354-4bf0-89d3-c3440c3e9555 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:27.366919295 +0000 UTC m=+48.793745379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dchw4" (UID: "06d7cf7a-e354-4bf0-89d3-c3440c3e9555") : secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:23.367621 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.367460 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 17:02:23.367621 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.367545 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:27.36750795 +0000 UTC m=+48.794334035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : secret "router-metrics-certs-default" not found Jul 21 17:02:23.568895 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:23.568854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:23.569061 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.569016 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 17:02:23.569061 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.569038 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db68fc5c-vmjrb: secret "image-registry-tls" not found Jul 21 17:02:23.569136 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.569104 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls podName:30514292-2e10-4f03-bb6b-477468668f13 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:31.569085332 +0000 UTC m=+52.995911402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls") pod "image-registry-6db68fc5c-vmjrb" (UID: "30514292-2e10-4f03-bb6b-477468668f13") : secret "image-registry-tls" not found Jul 21 17:02:23.670017 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:23.669934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:23.670160 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.670124 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:02:23.670201 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:23.670175 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls podName:74f5d180-f2a1-4374-9f31-871aa10b67cb nodeName:}" failed. No retries permitted until 2026-07-21 17:02:31.670162375 +0000 UTC m=+53.096988446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls") pod "dns-default-ntx42" (UID: "74f5d180-f2a1-4374-9f31-871aa10b67cb") : secret "dns-default-metrics-tls" not found Jul 21 17:02:24.522192 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:24.522160 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:24.621779 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:24.621736 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" limit=1024 Jul 21 17:02:27.407809 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:27.407772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:27.408371 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:27.407855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:27.408371 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:27.407880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:27.408371 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:27.407907 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:27.408371 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:27.407948 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 17:02:27.408371 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:27.407995 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:27.408371 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:27.408031 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls podName:557d6c3a-29e4-4aa1-b180-e7646476a34e nodeName:}" failed. No retries permitted until 2026-07-21 17:02:35.408010804 +0000 UTC m=+56.834836890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2btp9" (UID: "557d6c3a-29e4-4aa1-b180-e7646476a34e") : secret "samples-operator-tls" not found Jul 21 17:02:27.408371 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:27.408028 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 17:02:27.408371 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:27.408054 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls podName:06d7cf7a-e354-4bf0-89d3-c3440c3e9555 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:35.408039585 +0000 UTC m=+56.834865656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dchw4" (UID: "06d7cf7a-e354-4bf0-89d3-c3440c3e9555") : secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:27.408371 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:27.408075 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:35.408063274 +0000 UTC m=+56.834889345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : configmap references non-existent config key: service-ca.crt Jul 21 17:02:27.408371 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:27.408089 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:35.408082453 +0000 UTC m=+56.834908524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : secret "router-metrics-certs-default" not found Jul 21 17:02:28.341606 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.341538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v5cw2" event={"ID":"1997ec8d-0dca-46b0-99da-b416ea6c50ec","Type":"ContainerStarted","Data":"8592babeb6c4afcbd80c6eef013c74c15bf4766a0069bddab2a2426afb48c6bb"} Jul 21 17:02:28.343333 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.343303 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" event={"ID":"6d375130-c287-41c1-902d-068410ff6bcd","Type":"ContainerStarted","Data":"8275740f5fdad3a16e44aba17193ee6d36a9ab733f79336858984d0e087eb4b9"} Jul 21 17:02:28.345949 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.345923 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw" event={"ID":"c1febf6d-ee2b-470d-b8ff-5f8e96db69fe","Type":"ContainerStarted","Data":"44d8240d21964bfa424ebe96b0bf1c02748a0e4cd66e5efb2e5b4c0db543a1ea"} Jul 21 17:02:28.347900 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.347876 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/0.log" Jul 21 17:02:28.348014 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.347922 2562 generic.go:356] "Generic (PLEG): container finished" podID="8974afe7-625b-40f6-bb4a-5c9d82359cdc" containerID="90b5c7395e567b01054bfe9dcd42c4fee6e8fde393267bf8b99dc9fcd0937ff3" exitCode=255 Jul 21 17:02:28.348146 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.348040 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" event={"ID":"8974afe7-625b-40f6-bb4a-5c9d82359cdc","Type":"ContainerDied","Data":"90b5c7395e567b01054bfe9dcd42c4fee6e8fde393267bf8b99dc9fcd0937ff3"} Jul 21 17:02:28.348223 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.348194 2562 scope.go:117] "RemoveContainer" containerID="90b5c7395e567b01054bfe9dcd42c4fee6e8fde393267bf8b99dc9fcd0937ff3" Jul 21 17:02:28.350498 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.350474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" event={"ID":"105321d0-98bd-4ecf-b05b-162f7cde46f4","Type":"ContainerStarted","Data":"53cf904c50e69f433e7166bac992a98cb930870b718c2a09f67107fe10457556"} Jul 21 17:02:28.368683 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.368621 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2sbmq" podStartSLOduration=8.4961036 podStartE2EDuration="13.368593822s" totalImagesPullingTime="4.872490222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:22.373781357 +0000 UTC m=+43.800607452" watchObservedRunningTime="2026-07-21 17:02:28.368593822 +0000 UTC m=+49.795419916" Jul 21 17:02:28.368867 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.368814 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-v5cw2" podStartSLOduration=2.782223524 podStartE2EDuration="9.368807479s" totalImagesPullingTime="6.586583955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:28.366971036 +0000 UTC m=+49.793797127" watchObservedRunningTime="2026-07-21 17:02:28.368807479 +0000 UTC m=+49.795633553" Jul 21 17:02:28.396740 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.396280 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" podStartSLOduration=2.809585205 podStartE2EDuration="9.396257478s" totalImagesPullingTime="6.586672273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:28.395587396 +0000 UTC m=+49.822413490" watchObservedRunningTime="2026-07-21 17:02:28.396257478 +0000 UTC m=+49.823083572" Jul 21 17:02:28.451794 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.451725 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wmkqw" podStartSLOduration=2.855815667 podStartE2EDuration="9.451704384s" totalImagesPullingTime="6.595888717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:28.451580825 +0000 UTC m=+49.878406919" watchObservedRunningTime="2026-07-21 17:02:28.451704384 +0000 UTC m=+49.878530479" Jul 21 17:02:28.475818 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:28.475761 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" podStartSLOduration=2.424386525 podStartE2EDuration="9.47574054s" totalImagesPullingTime="7.051354015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:28.4753 +0000 UTC m=+49.902126103" watchObservedRunningTime="2026-07-21 17:02:28.47574054 +0000 UTC m=+49.902566635" Jul 21 17:02:29.187705 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.187666 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ngcdm"] Jul 21 17:02:29.225259 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.225229 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ngcdm"] Jul 21 17:02:29.225425 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.225360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.233067 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.228642 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 17:02:29.233067 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.228724 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 17:02:29.233067 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.228850 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ntxgg\"" Jul 21 17:02:29.328158 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.328114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-data-volume\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.328356 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.328189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.328356 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.328259 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnhfw\" (UniqueName: \"kubernetes.io/projected/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-api-access-gnhfw\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.328356 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.328283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.328356 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.328308 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-crio-socket\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.356055 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.356029 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:02:29.356552 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.356510 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/0.log" Jul 21 17:02:29.356642 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.356579 2562 generic.go:356] "Generic (PLEG): container finished" podID="8974afe7-625b-40f6-bb4a-5c9d82359cdc" containerID="d46b2853ab34212ca2a87e11efa90bedcf2c7678617a226ae4a6dc0a0c33f1d4" exitCode=255 Jul 21 17:02:29.356718 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.356691 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" event={"ID":"8974afe7-625b-40f6-bb4a-5c9d82359cdc","Type":"ContainerDied","Data":"d46b2853ab34212ca2a87e11efa90bedcf2c7678617a226ae4a6dc0a0c33f1d4"} Jul 21 17:02:29.356806 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.356793 2562 scope.go:117] "RemoveContainer" containerID="90b5c7395e567b01054bfe9dcd42c4fee6e8fde393267bf8b99dc9fcd0937ff3" Jul 21 17:02:29.356915 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.356894 2562 scope.go:117] "RemoveContainer" containerID="d46b2853ab34212ca2a87e11efa90bedcf2c7678617a226ae4a6dc0a0c33f1d4" Jul 21 17:02:29.357123 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:29.357095 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-zlwt2_openshift-console-operator(8974afe7-625b-40f6-bb4a-5c9d82359cdc)\"" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" podUID="8974afe7-625b-40f6-bb4a-5c9d82359cdc" Jul 21 17:02:29.429459 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.429419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnhfw\" (UniqueName: \"kubernetes.io/projected/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-api-access-gnhfw\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.429665 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.429482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.429665 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.429549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-crio-socket\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.430423 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.429773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-data-volume\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.430423 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.429882 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-crio-socket\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.430423 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.429950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.430423 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:29.430230 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 17:02:29.430423 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:29.430292 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls podName:c4a26670-77aa-4eac-afc3-f896fbf0e4ab nodeName:}" failed. No retries permitted until 2026-07-21 17:02:29.930273915 +0000 UTC m=+51.357099989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngcdm" (UID: "c4a26670-77aa-4eac-afc3-f896fbf0e4ab") : secret "insights-runtime-extractor-tls" not found Jul 21 17:02:29.430423 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.430321 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-data-volume\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.430423 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:29.430380 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 17:02:29.430802 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:29.430442 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-rbac-proxy-cm podName:c4a26670-77aa-4eac-afc3-f896fbf0e4ab nodeName:}" failed. No retries permitted until 2026-07-21 17:02:29.930423779 +0000 UTC m=+51.357249853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ngcdm" (UID: "c4a26670-77aa-4eac-afc3-f896fbf0e4ab") : configmap "kube-rbac-proxy" not found Jul 21 17:02:29.444623 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.444538 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnhfw\" (UniqueName: \"kubernetes.io/projected/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-api-access-gnhfw\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.486700 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.486664 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl"] Jul 21 17:02:29.523631 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.523589 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl"] Jul 21 17:02:29.523776 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.523750 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl" Jul 21 17:02:29.526848 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.526823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 21 17:02:29.527011 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.526882 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 21 17:02:29.527011 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.526883 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d8dzq\"" Jul 21 17:02:29.631969 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.631931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c88n4\" (UniqueName: \"kubernetes.io/projected/2a2c9009-1651-4a04-a9af-55992b289903-kube-api-access-c88n4\") pod \"migrator-7cc9c7ffd7-fqvzl\" (UID: \"2a2c9009-1651-4a04-a9af-55992b289903\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl" Jul 21 17:02:29.733679 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.733567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c88n4\" (UniqueName: \"kubernetes.io/projected/2a2c9009-1651-4a04-a9af-55992b289903-kube-api-access-c88n4\") pod \"migrator-7cc9c7ffd7-fqvzl\" (UID: \"2a2c9009-1651-4a04-a9af-55992b289903\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl" Jul 21 17:02:29.749829 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.749789 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c88n4\" (UniqueName: \"kubernetes.io/projected/2a2c9009-1651-4a04-a9af-55992b289903-kube-api-access-c88n4\") pod \"migrator-7cc9c7ffd7-fqvzl\" (UID: \"2a2c9009-1651-4a04-a9af-55992b289903\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl" Jul 21 17:02:29.834209 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.834169 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl" Jul 21 17:02:29.873017 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.872990 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:29.873169 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.873038 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:29.935929 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.935892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.936109 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:29.936084 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 17:02:29.936173 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:29.936144 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 17:02:29.936173 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:29.936168 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls podName:c4a26670-77aa-4eac-afc3-f896fbf0e4ab nodeName:}" failed. No retries permitted until 2026-07-21 17:02:30.936147285 +0000 UTC m=+52.362973379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngcdm" (UID: "c4a26670-77aa-4eac-afc3-f896fbf0e4ab") : secret "insights-runtime-extractor-tls" not found Jul 21 17:02:29.936272 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:29.936084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:29.936272 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:29.936212 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-rbac-proxy-cm podName:c4a26670-77aa-4eac-afc3-f896fbf0e4ab nodeName:}" failed. No retries permitted until 2026-07-21 17:02:30.936194844 +0000 UTC m=+52.363020917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ngcdm" (UID: "c4a26670-77aa-4eac-afc3-f896fbf0e4ab") : configmap "kube-rbac-proxy" not found Jul 21 17:02:30.003106 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:30.002987 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl"] Jul 21 17:02:30.005753 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:30.005719 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2c9009_1651_4a04_a9af_55992b289903.slice/crio-f635eca1ac5979e7b4f1524d47e64309129718184f2b49c11b158b6cf5f15680 WatchSource:0}: Error finding container f635eca1ac5979e7b4f1524d47e64309129718184f2b49c11b158b6cf5f15680: Status 404 returned error can't find the container with id f635eca1ac5979e7b4f1524d47e64309129718184f2b49c11b158b6cf5f15680 Jul 21 17:02:30.204702 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:30.204674 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7mn88_bea7850a-c3ef-4e12-93ad-d45749c5fcb3/dns-node-resolver/0.log" Jul 21 17:02:30.361156 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:30.361132 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:02:30.361529 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:30.361497 2562 scope.go:117] "RemoveContainer" containerID="d46b2853ab34212ca2a87e11efa90bedcf2c7678617a226ae4a6dc0a0c33f1d4" Jul 21 17:02:30.361711 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:30.361689 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-zlwt2_openshift-console-operator(8974afe7-625b-40f6-bb4a-5c9d82359cdc)\"" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" podUID="8974afe7-625b-40f6-bb4a-5c9d82359cdc" Jul 21 17:02:30.362457 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:30.362435 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl" event={"ID":"2a2c9009-1651-4a04-a9af-55992b289903","Type":"ContainerStarted","Data":"f635eca1ac5979e7b4f1524d47e64309129718184f2b49c11b158b6cf5f15680"} Jul 21 17:02:30.945539 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:30.945483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:30.945927 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:30.945557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:30.945927 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:30.945709 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 17:02:30.945927 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:30.945772 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls podName:c4a26670-77aa-4eac-afc3-f896fbf0e4ab nodeName:}" failed. No retries permitted until 2026-07-21 17:02:32.945755676 +0000 UTC m=+54.372581746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngcdm" (UID: "c4a26670-77aa-4eac-afc3-f896fbf0e4ab") : secret "insights-runtime-extractor-tls" not found Jul 21 17:02:30.946047 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:30.945965 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:31.366662 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:31.366634 2562 scope.go:117] "RemoveContainer" containerID="d46b2853ab34212ca2a87e11efa90bedcf2c7678617a226ae4a6dc0a0c33f1d4" Jul 21 17:02:31.366807 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:31.366787 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-zlwt2_openshift-console-operator(8974afe7-625b-40f6-bb4a-5c9d82359cdc)\"" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" podUID="8974afe7-625b-40f6-bb4a-5c9d82359cdc" Jul 21 17:02:31.604367 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:31.604336 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dcwzd_1bb84b52-52bc-4234-93c0-fd885a659f48/node-ca/0.log" Jul 21 17:02:31.654140 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:31.654046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:31.654307 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:31.654222 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 17:02:31.654307 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:31.654242 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db68fc5c-vmjrb: secret "image-registry-tls" not found Jul 21 17:02:31.654307 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:31.654303 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls podName:30514292-2e10-4f03-bb6b-477468668f13 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:47.654287057 +0000 UTC m=+69.081113130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls") pod "image-registry-6db68fc5c-vmjrb" (UID: "30514292-2e10-4f03-bb6b-477468668f13") : secret "image-registry-tls" not found Jul 21 17:02:31.754949 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:31.754913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:31.755114 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:31.755093 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:02:31.755202 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:31.755190 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls podName:74f5d180-f2a1-4374-9f31-871aa10b67cb nodeName:}" failed. No retries permitted until 2026-07-21 17:02:47.755173667 +0000 UTC m=+69.181999738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls") pod "dns-default-ntx42" (UID: "74f5d180-f2a1-4374-9f31-871aa10b67cb") : secret "dns-default-metrics-tls" not found Jul 21 17:02:32.004978 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.004946 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2sbmq_9500322d-e6bc-4636-bc5f-6162ab5a7f15/serve-healthcheck-canary/0.log" Jul 21 17:02:32.119086 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.119043 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-jd2gl"] Jul 21 17:02:32.127433 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.127404 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.130642 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.130619 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 21 17:02:32.130769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.130625 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 21 17:02:32.131653 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.131633 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-glwpw\"" Jul 21 17:02:32.131857 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.131834 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 21 17:02:32.131969 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.131863 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 21 17:02:32.133155 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.133134 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-jd2gl"] Jul 21 17:02:32.157805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.157768 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ca990d1-04a9-42ff-a185-f66fe3fabb0b-signing-cabundle\") pod \"service-ca-58598695f7-jd2gl\" (UID: \"6ca990d1-04a9-42ff-a185-f66fe3fabb0b\") " pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.157975 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.157834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ca990d1-04a9-42ff-a185-f66fe3fabb0b-signing-key\") pod \"service-ca-58598695f7-jd2gl\" (UID: \"6ca990d1-04a9-42ff-a185-f66fe3fabb0b\") " pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.158021 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.157966 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m968v\" (UniqueName: \"kubernetes.io/projected/6ca990d1-04a9-42ff-a185-f66fe3fabb0b-kube-api-access-m968v\") pod \"service-ca-58598695f7-jd2gl\" (UID: \"6ca990d1-04a9-42ff-a185-f66fe3fabb0b\") " pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.259408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.259317 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m968v\" (UniqueName: \"kubernetes.io/projected/6ca990d1-04a9-42ff-a185-f66fe3fabb0b-kube-api-access-m968v\") pod \"service-ca-58598695f7-jd2gl\" (UID: \"6ca990d1-04a9-42ff-a185-f66fe3fabb0b\") " pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.259408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.259402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ca990d1-04a9-42ff-a185-f66fe3fabb0b-signing-cabundle\") pod \"service-ca-58598695f7-jd2gl\" (UID: \"6ca990d1-04a9-42ff-a185-f66fe3fabb0b\") " pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.259620 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.259446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ca990d1-04a9-42ff-a185-f66fe3fabb0b-signing-key\") pod \"service-ca-58598695f7-jd2gl\" (UID: \"6ca990d1-04a9-42ff-a185-f66fe3fabb0b\") " pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.260114 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.260086 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6ca990d1-04a9-42ff-a185-f66fe3fabb0b-signing-cabundle\") pod \"service-ca-58598695f7-jd2gl\" (UID: \"6ca990d1-04a9-42ff-a185-f66fe3fabb0b\") " pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.262097 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.262077 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6ca990d1-04a9-42ff-a185-f66fe3fabb0b-signing-key\") pod \"service-ca-58598695f7-jd2gl\" (UID: \"6ca990d1-04a9-42ff-a185-f66fe3fabb0b\") " pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.271487 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.271461 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m968v\" (UniqueName: \"kubernetes.io/projected/6ca990d1-04a9-42ff-a185-f66fe3fabb0b-kube-api-access-m968v\") pod \"service-ca-58598695f7-jd2gl\" (UID: \"6ca990d1-04a9-42ff-a185-f66fe3fabb0b\") " pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.374164 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.374132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl" event={"ID":"2a2c9009-1651-4a04-a9af-55992b289903","Type":"ContainerStarted","Data":"30c4a695405e8b1ce370cd744eefc6a2508efc4e3826c5a4b9d1029b07f25820"} Jul 21 17:02:32.374309 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.374192 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl" event={"ID":"2a2c9009-1651-4a04-a9af-55992b289903","Type":"ContainerStarted","Data":"36a7b5d38d246db7612c34c5e15866641b1a99d6ef4f47e67aadf3e9c8a815bd"} Jul 21 17:02:32.396200 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.396145 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fqvzl" podStartSLOduration=1.634509012 podStartE2EDuration="3.39612801s" totalImagesPullingTime="1.761618998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:32.395946105 +0000 UTC m=+53.822772198" watchObservedRunningTime="2026-07-21 17:02:32.39612801 +0000 UTC m=+53.822954102" Jul 21 17:02:32.438292 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.438260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-jd2gl" Jul 21 17:02:32.590741 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.590706 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-jd2gl"] Jul 21 17:02:32.593385 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:32.593357 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ca990d1_04a9_42ff_a185_f66fe3fabb0b.slice/crio-d13d8f6b830ecbab49962d03aacebd68e9e7aa0d0805f52230fcb76f5d50a684 WatchSource:0}: Error finding container d13d8f6b830ecbab49962d03aacebd68e9e7aa0d0805f52230fcb76f5d50a684: Status 404 returned error can't find the container with id d13d8f6b830ecbab49962d03aacebd68e9e7aa0d0805f52230fcb76f5d50a684 Jul 21 17:02:32.966374 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:32.966329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:32.966618 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:32.966491 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 17:02:32.966618 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:32.966585 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls podName:c4a26670-77aa-4eac-afc3-f896fbf0e4ab nodeName:}" failed. No retries permitted until 2026-07-21 17:02:36.966569338 +0000 UTC m=+58.393395409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngcdm" (UID: "c4a26670-77aa-4eac-afc3-f896fbf0e4ab") : secret "insights-runtime-extractor-tls" not found Jul 21 17:02:33.379147 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:33.379110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-jd2gl" event={"ID":"6ca990d1-04a9-42ff-a185-f66fe3fabb0b","Type":"ContainerStarted","Data":"ce6c49b1a4afd73f71e30eaee88478dbaea08ff1e60dd8b9e0cd1558ab61dbb8"} Jul 21 17:02:33.379678 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:33.379171 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-jd2gl" event={"ID":"6ca990d1-04a9-42ff-a185-f66fe3fabb0b","Type":"ContainerStarted","Data":"d13d8f6b830ecbab49962d03aacebd68e9e7aa0d0805f52230fcb76f5d50a684"} Jul 21 17:02:33.411082 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:33.411032 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-jd2gl" podStartSLOduration=1.411013915 podStartE2EDuration="1.411013915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:33.409637928 +0000 UTC m=+54.836464033" watchObservedRunningTime="2026-07-21 17:02:33.411013915 +0000 UTC m=+54.837840007" Jul 21 17:02:35.492403 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:35.492360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:35.492833 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:35.492448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:35.492833 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:35.492474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:35.492833 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:35.492505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:35.492833 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:35.492644 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:35.492833 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:35.492661 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 17:02:35.492833 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:35.492691 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:51.492676514 +0000 UTC m=+72.919502589 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : configmap references non-existent config key: service-ca.crt Jul 21 17:02:35.492833 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:35.492733 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls podName:06d7cf7a-e354-4bf0-89d3-c3440c3e9555 nodeName:}" failed. No retries permitted until 2026-07-21 17:02:51.49271339 +0000 UTC m=+72.919539476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-dchw4" (UID: "06d7cf7a-e354-4bf0-89d3-c3440c3e9555") : secret "cluster-monitoring-operator-tls" not found Jul 21 17:02:35.492833 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:35.492753 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs podName:a86149c7-2cc8-4325-8228-2224094207ce nodeName:}" failed. No retries permitted until 2026-07-21 17:02:51.49274298 +0000 UTC m=+72.919569066 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs") pod "router-default-69d6dcbc6-52rk5" (UID: "a86149c7-2cc8-4325-8228-2224094207ce") : secret "router-metrics-certs-default" not found Jul 21 17:02:35.495061 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:35.495040 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/557d6c3a-29e4-4aa1-b180-e7646476a34e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2btp9\" (UID: \"557d6c3a-29e4-4aa1-b180-e7646476a34e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:35.753140 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:35.753049 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" Jul 21 17:02:35.897857 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:35.897827 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9"] Jul 21 17:02:36.392406 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:36.392375 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" event={"ID":"557d6c3a-29e4-4aa1-b180-e7646476a34e","Type":"ContainerStarted","Data":"f360294c1e3e7e4f4b5656352e2bbd1b73928093c830a60eabcb2784159d076e"} Jul 21 17:02:37.007231 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:37.007186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:37.007658 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:37.007316 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 17:02:37.007658 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:02:37.007393 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls podName:c4a26670-77aa-4eac-afc3-f896fbf0e4ab nodeName:}" failed. No retries permitted until 2026-07-21 17:02:45.007374679 +0000 UTC m=+66.434200757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngcdm" (UID: "c4a26670-77aa-4eac-afc3-f896fbf0e4ab") : secret "insights-runtime-extractor-tls" not found Jul 21 17:02:38.402265 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:38.402225 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" event={"ID":"557d6c3a-29e4-4aa1-b180-e7646476a34e","Type":"ContainerStarted","Data":"57fe203087a7f16a7561a7103b2ca0200c11f050eb089c3a281aab5cfe103742"} Jul 21 17:02:38.403045 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:38.402280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" event={"ID":"557d6c3a-29e4-4aa1-b180-e7646476a34e","Type":"ContainerStarted","Data":"1bb19b29532864e869eaf28c5e42adad0db756137b9662da09203b2bfe89d728"} Jul 21 17:02:38.436308 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:38.436256 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2btp9" podStartSLOduration=17.345189079 podStartE2EDuration="19.436239091s" totalImagesPullingTime="2.091050012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:38.434439082 +0000 UTC m=+59.861265175" watchObservedRunningTime="2026-07-21 17:02:38.436239091 +0000 UTC m=+59.863065184" Jul 21 17:02:40.267589 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:40.267555 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-52kzf" Jul 21 17:02:44.780181 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.780140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:44.783542 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.783506 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 17:02:44.793612 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.793578 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5-metrics-certs\") pod \"network-metrics-daemon-mmld6\" (UID: \"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5\") " pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:44.881211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.881176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:44.881419 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.881279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxvp\" (UniqueName: \"kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp\") pod \"network-check-target-9dw5f\" (UID: \"49ef420e-de57-415f-aa1d-6351ccda544e\") " pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:44.883878 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.883849 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgxvp\" (UniqueName: \"kubernetes.io/projected/49ef420e-de57-415f-aa1d-6351ccda544e-kube-api-access-tgxvp\") pod \"network-check-target-9dw5f\" (UID: \"49ef420e-de57-415f-aa1d-6351ccda544e\") " pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:44.884355 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.884337 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 17:02:44.893974 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.893951 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2bb9fc30-3e5e-41bb-abfc-11d27086161b-original-pull-secret\") pod \"global-pull-secret-syncer-9wmh5\" (UID: \"2bb9fc30-3e5e-41bb-abfc-11d27086161b\") " pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:44.925967 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.925932 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59btl\"" Jul 21 17:02:44.932947 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.932918 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5l8sr\"" Jul 21 17:02:44.933947 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.933931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:44.936007 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.935988 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9wmh5" Jul 21 17:02:44.940510 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:44.940484 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mmld6" Jul 21 17:02:45.082716 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.082412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:45.085750 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.085681 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4a26670-77aa-4eac-afc3-f896fbf0e4ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngcdm\" (UID: \"c4a26670-77aa-4eac-afc3-f896fbf0e4ab\") " pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:45.106095 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.106058 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9dw5f"] Jul 21 17:02:45.109285 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:45.109256 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ef420e_de57_415f_aa1d_6351ccda544e.slice/crio-94b78e62ad624c7555710eac26bd2a7498cf2eed99d4887137c4b3a340a345cc WatchSource:0}: Error finding container 94b78e62ad624c7555710eac26bd2a7498cf2eed99d4887137c4b3a340a345cc: Status 404 returned error can't find the container with id 94b78e62ad624c7555710eac26bd2a7498cf2eed99d4887137c4b3a340a345cc Jul 21 17:02:45.124226 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.124159 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mmld6"] Jul 21 17:02:45.126231 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:45.126190 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2bc1e14_f1ca_40d5_a1bd_e2880baec8c5.slice/crio-247e531f888f0da0f08d48d8fb29d60adb25101d262f2a10aad7fa84e32a76df WatchSource:0}: Error finding container 247e531f888f0da0f08d48d8fb29d60adb25101d262f2a10aad7fa84e32a76df: Status 404 returned error can't find the container with id 247e531f888f0da0f08d48d8fb29d60adb25101d262f2a10aad7fa84e32a76df Jul 21 17:02:45.143112 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.142971 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9wmh5"] Jul 21 17:02:45.144802 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.144772 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ntxgg\"" Jul 21 17:02:45.152629 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.152588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ngcdm" Jul 21 17:02:45.153606 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:45.153577 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb9fc30_3e5e_41bb_abfc_11d27086161b.slice/crio-51e74e29c590e6d28124456c596a65a2f1c96d5feeba7bab8397d9d7e627c1ee WatchSource:0}: Error finding container 51e74e29c590e6d28124456c596a65a2f1c96d5feeba7bab8397d9d7e627c1ee: Status 404 returned error can't find the container with id 51e74e29c590e6d28124456c596a65a2f1c96d5feeba7bab8397d9d7e627c1ee Jul 21 17:02:45.291694 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.291548 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ngcdm"] Jul 21 17:02:45.294246 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:45.294222 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a26670_77aa_4eac_afc3_f896fbf0e4ab.slice/crio-20be4fc33b5ac34eed1a799a53b83a9ff90fe3cb8d334d7d8bf680c03dfac6e1 WatchSource:0}: Error finding container 20be4fc33b5ac34eed1a799a53b83a9ff90fe3cb8d334d7d8bf680c03dfac6e1: Status 404 returned error can't find the container with id 20be4fc33b5ac34eed1a799a53b83a9ff90fe3cb8d334d7d8bf680c03dfac6e1 Jul 21 17:02:45.425219 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.425178 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ngcdm" event={"ID":"c4a26670-77aa-4eac-afc3-f896fbf0e4ab","Type":"ContainerStarted","Data":"20be4fc33b5ac34eed1a799a53b83a9ff90fe3cb8d334d7d8bf680c03dfac6e1"} Jul 21 17:02:45.426466 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.426440 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mmld6" event={"ID":"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5","Type":"ContainerStarted","Data":"247e531f888f0da0f08d48d8fb29d60adb25101d262f2a10aad7fa84e32a76df"} Jul 21 17:02:45.427545 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.427505 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9wmh5" event={"ID":"2bb9fc30-3e5e-41bb-abfc-11d27086161b","Type":"ContainerStarted","Data":"51e74e29c590e6d28124456c596a65a2f1c96d5feeba7bab8397d9d7e627c1ee"} Jul 21 17:02:45.428936 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.428914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9dw5f" event={"ID":"49ef420e-de57-415f-aa1d-6351ccda544e","Type":"ContainerStarted","Data":"a0835b465910f6b580e93c27b18b8aeef95d4159fea9f9aed88e599ee2e52dcc"} Jul 21 17:02:45.429075 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.428949 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9dw5f" event={"ID":"49ef420e-de57-415f-aa1d-6351ccda544e","Type":"ContainerStarted","Data":"94b78e62ad624c7555710eac26bd2a7498cf2eed99d4887137c4b3a340a345cc"} Jul 21 17:02:45.429075 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.429040 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:02:45.449284 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:45.449230 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9dw5f" podStartSLOduration=66.449210804 podStartE2EDuration="1m6.449210804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:45.447976532 +0000 UTC m=+66.874802625" watchObservedRunningTime="2026-07-21 17:02:45.449210804 +0000 UTC m=+66.876036896" Jul 21 17:02:46.109704 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:46.109668 2562 scope.go:117] "RemoveContainer" containerID="d46b2853ab34212ca2a87e11efa90bedcf2c7678617a226ae4a6dc0a0c33f1d4" Jul 21 17:02:46.440417 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:46.440342 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:02:46.441189 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:46.440823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" event={"ID":"8974afe7-625b-40f6-bb4a-5c9d82359cdc","Type":"ContainerStarted","Data":"2dc2063e8bf929585955f84d4108dfd4a0af223f2cad06929e2091d6fbcef7a7"} Jul 21 17:02:46.441189 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:46.441163 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:46.444732 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:46.442724 2562 patch_prober.go:28] interesting pod/console-operator-565b7b569d-zlwt2 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body= Jul 21 17:02:46.444732 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:46.442780 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" podUID="8974afe7-625b-40f6-bb4a-5c9d82359cdc" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused" Jul 21 17:02:46.471149 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:46.471088 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" podStartSLOduration=20.609159125 podStartE2EDuration="27.471063669s" totalImagesPullingTime="6.861904544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:46.469714565 +0000 UTC m=+67.896540672" watchObservedRunningTime="2026-07-21 17:02:46.471063669 +0000 UTC m=+67.897889763" Jul 21 17:02:47.450253 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.450212 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mmld6" event={"ID":"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5","Type":"ContainerStarted","Data":"6b301480de63d361fe94841179a7edad821990cb4aa353a57e66a6ec6bdd4219"} Jul 21 17:02:47.450719 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.450274 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mmld6" event={"ID":"e2bc1e14-f1ca-40d5-a1bd-e2880baec8c5","Type":"ContainerStarted","Data":"b420fd14ec8629274f02eb806f2feb44373f82a376b79a470624a3edd1eeb3cf"} Jul 21 17:02:47.455647 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.455572 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-zlwt2" Jul 21 17:02:47.470753 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.470699 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mmld6" podStartSLOduration=67.21635579 podStartE2EDuration="1m8.470683496s" totalImagesPullingTime="1.254327706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:47.469796833 +0000 UTC m=+68.896622926" watchObservedRunningTime="2026-07-21 17:02:47.470683496 +0000 UTC m=+68.897509590" Jul 21 17:02:47.708728 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.708614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:47.711874 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.711796 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") pod \"image-registry-6db68fc5c-vmjrb\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:47.810211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.810165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:47.813284 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.813244 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74f5d180-f2a1-4374-9f31-871aa10b67cb-metrics-tls\") pod \"dns-default-ntx42\" (UID: \"74f5d180-f2a1-4374-9f31-871aa10b67cb\") " pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:47.916784 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.916750 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fjqct\"" Jul 21 17:02:47.924382 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.924346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:47.932650 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.932612 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhhmq\"" Jul 21 17:02:47.940873 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:47.940568 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:51.556479 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.556442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:51.556923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.556486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:51.556923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.556510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:51.557312 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.557253 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a86149c7-2cc8-4325-8228-2224094207ce-service-ca-bundle\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:51.559104 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.559080 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86149c7-2cc8-4325-8228-2224094207ce-metrics-certs\") pod \"router-default-69d6dcbc6-52rk5\" (UID: \"a86149c7-2cc8-4325-8228-2224094207ce\") " pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:51.559458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.559433 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06d7cf7a-e354-4bf0-89d3-c3440c3e9555-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-dchw4\" (UID: \"06d7cf7a-e354-4bf0-89d3-c3440c3e9555\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:51.665016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.664957 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-thl5j\"" Jul 21 17:02:51.669344 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.669277 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jdtws\"" Jul 21 17:02:51.671466 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.671438 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" Jul 21 17:02:51.677832 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.677803 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:51.722374 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:51.722209 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db68fc5c-vmjrb"] Jul 21 17:02:51.979225 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:51.979154 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30514292_2e10_4f03_bb6b_477468668f13.slice/crio-82ec2af32a7576df8f4e61105d9057680fe85e205d0d58f3287f639f8bdb276f WatchSource:0}: Error finding container 82ec2af32a7576df8f4e61105d9057680fe85e205d0d58f3287f639f8bdb276f: Status 404 returned error can't find the container with id 82ec2af32a7576df8f4e61105d9057680fe85e205d0d58f3287f639f8bdb276f Jul 21 17:02:52.116258 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:52.116223 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ntx42"] Jul 21 17:02:52.328954 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:52.328922 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f5d180_f2a1_4374_9f31_871aa10b67cb.slice/crio-9d9229d92eb38b083bba790a10c99ddebbd17b47c28b5765c0d5c984294e1790 WatchSource:0}: Error finding container 9d9229d92eb38b083bba790a10c99ddebbd17b47c28b5765c0d5c984294e1790: Status 404 returned error can't find the container with id 9d9229d92eb38b083bba790a10c99ddebbd17b47c28b5765c0d5c984294e1790 Jul 21 17:02:52.475869 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:52.475738 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntx42" event={"ID":"74f5d180-f2a1-4374-9f31-871aa10b67cb","Type":"ContainerStarted","Data":"9d9229d92eb38b083bba790a10c99ddebbd17b47c28b5765c0d5c984294e1790"} Jul 21 17:02:52.478542 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:52.478333 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" event={"ID":"30514292-2e10-4f03-bb6b-477468668f13","Type":"ContainerStarted","Data":"412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04"} Jul 21 17:02:52.478786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:52.478715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" event={"ID":"30514292-2e10-4f03-bb6b-477468668f13","Type":"ContainerStarted","Data":"82ec2af32a7576df8f4e61105d9057680fe85e205d0d58f3287f639f8bdb276f"} Jul 21 17:02:52.478786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:52.478747 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:02:52.499245 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:52.499214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69d6dcbc6-52rk5"] Jul 21 17:02:52.503019 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:52.502988 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86149c7_2cc8_4325_8228_2224094207ce.slice/crio-1e29b60d111f6f996a79b17c8eeb53e515dcfe720d74c1be954c9084ae377962 WatchSource:0}: Error finding container 1e29b60d111f6f996a79b17c8eeb53e515dcfe720d74c1be954c9084ae377962: Status 404 returned error can't find the container with id 1e29b60d111f6f996a79b17c8eeb53e515dcfe720d74c1be954c9084ae377962 Jul 21 17:02:52.504363 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:52.504317 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" podStartSLOduration=72.50429973 podStartE2EDuration="1m12.50429973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:52.501793142 +0000 UTC m=+73.928619248" watchObservedRunningTime="2026-07-21 17:02:52.50429973 +0000 UTC m=+73.931125823" Jul 21 17:02:52.517659 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:52.517630 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4"] Jul 21 17:02:52.522918 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:52.522889 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d7cf7a_e354_4bf0_89d3_c3440c3e9555.slice/crio-66728c04ddb3990ca1e2a3527068b51934f5994a879ee6a0fcb17eb89381f235 WatchSource:0}: Error finding container 66728c04ddb3990ca1e2a3527068b51934f5994a879ee6a0fcb17eb89381f235: Status 404 returned error can't find the container with id 66728c04ddb3990ca1e2a3527068b51934f5994a879ee6a0fcb17eb89381f235 Jul 21 17:02:53.487075 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:53.487033 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ngcdm" event={"ID":"c4a26670-77aa-4eac-afc3-f896fbf0e4ab","Type":"ContainerStarted","Data":"b2b841459d8e3561aaaa94aa0333a2f803a2d7c587af30fd1bcdb9460b6651ad"} Jul 21 17:02:53.489934 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:53.489895 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69d6dcbc6-52rk5" event={"ID":"a86149c7-2cc8-4325-8228-2224094207ce","Type":"ContainerStarted","Data":"9039fbc4be492ddde458225e3bff41d5358834c31a050671d32e74704dd11a02"} Jul 21 17:02:53.490093 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:53.489955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69d6dcbc6-52rk5" event={"ID":"a86149c7-2cc8-4325-8228-2224094207ce","Type":"ContainerStarted","Data":"1e29b60d111f6f996a79b17c8eeb53e515dcfe720d74c1be954c9084ae377962"} Jul 21 17:02:53.492071 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:53.492003 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" event={"ID":"06d7cf7a-e354-4bf0-89d3-c3440c3e9555","Type":"ContainerStarted","Data":"66728c04ddb3990ca1e2a3527068b51934f5994a879ee6a0fcb17eb89381f235"} Jul 21 17:02:53.495579 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:53.495540 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9wmh5" event={"ID":"2bb9fc30-3e5e-41bb-abfc-11d27086161b","Type":"ContainerStarted","Data":"120ea0cc222d6963e0e7b75bbdd68ffde0c43b0ed80944c79ac716eeecaf4b8b"} Jul 21 17:02:53.517757 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:53.517452 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-69d6dcbc6-52rk5" podStartSLOduration=34.517411746 podStartE2EDuration="34.517411746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:53.515449597 +0000 UTC m=+74.942275692" watchObservedRunningTime="2026-07-21 17:02:53.517411746 +0000 UTC m=+74.944237842" Jul 21 17:02:53.534543 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:53.534459 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9wmh5" podStartSLOduration=66.359169521 podStartE2EDuration="1m13.534437232s" totalImagesPullingTime="7.175267711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:53.533959136 +0000 UTC m=+74.960785231" watchObservedRunningTime="2026-07-21 17:02:53.534437232 +0000 UTC m=+74.961263325" Jul 21 17:02:53.678060 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:53.678010 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:53.687429 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:53.687401 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:54.063406 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.061563 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78"] Jul 21 17:02:54.068004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.067636 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg"] Jul 21 17:02:54.069174 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.069002 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" Jul 21 17:02:54.075257 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.074769 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 21 17:02:54.077495 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.077385 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d"] Jul 21 17:02:54.082329 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.082299 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7thql\"" Jul 21 17:02:54.082750 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.082732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" Jul 21 17:02:54.087706 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.087665 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 21 17:02:54.092269 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.090909 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xpfn7\"" Jul 21 17:02:54.092269 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.091299 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 21 17:02:54.092269 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.091422 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 21 17:02:54.092269 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.091571 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 21 17:02:54.092269 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.091625 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 21 17:02:54.092269 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.091931 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b"] Jul 21 17:02:54.092783 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.092768 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.097134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.095413 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78"] Jul 21 17:02:54.097134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.095454 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d"] Jul 21 17:02:54.097134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.095474 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg"] Jul 21 17:02:54.097134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.095593 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.099259 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.099235 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 21 17:02:54.101747 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.101715 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b"] Jul 21 17:02:54.102207 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.102184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 21 17:02:54.102610 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.102591 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 21 17:02:54.102898 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.102874 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 21 17:02:54.103147 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.103129 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 21 17:02:54.178142 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.178088 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b99756779-5smvr"] Jul 21 17:02:54.181784 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.181754 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.181968 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.181904 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-7d9vn"] Jul 21 17:02:54.185150 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.185124 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 17:02:54.185376 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.185355 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-7d9vn" Jul 21 17:02:54.185451 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.185124 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 17:02:54.186001 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.185952 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 17:02:54.186185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.186161 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 17:02:54.186250 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.186197 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 17:02:54.186418 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.186399 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7wcjw\"" Jul 21 17:02:54.186684 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.186665 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 17:02:54.186752 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.186665 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 17:02:54.188339 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.188310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37365c91-f747-4023-bc82-3fcdf8749a15-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-n7w78\" (UID: \"37365c91-f747-4023-bc82-3fcdf8749a15\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" Jul 21 17:02:54.188435 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.188378 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdk9p\" (UniqueName: \"kubernetes.io/projected/e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6-kube-api-access-fdk9p\") pod \"managed-serviceaccount-addon-agent-6c477bdc76-q7wdg\" (UID: \"e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" Jul 21 17:02:54.188435 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.188408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37365c91-f747-4023-bc82-3fcdf8749a15-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-n7w78\" (UID: \"37365c91-f747-4023-bc82-3fcdf8749a15\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" Jul 21 17:02:54.188530 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.188434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c477bdc76-q7wdg\" (UID: \"e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" Jul 21 17:02:54.190765 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.190605 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jkgnm\"" Jul 21 17:02:54.212321 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.212231 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b99756779-5smvr"] Jul 21 17:02:54.213330 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.213289 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-7d9vn"] Jul 21 17:02:54.289617 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66-klusterlet-config\") pod \"klusterlet-addon-workmgr-57685c466c-r7g6d\" (UID: \"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.289805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-oauth-config\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.289805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-hub\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.289805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8fts\" (UniqueName: \"kubernetes.io/projected/f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66-kube-api-access-s8fts\") pod \"klusterlet-addon-workmgr-57685c466c-r7g6d\" (UID: \"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.289805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66-tmp\") pod \"klusterlet-addon-workmgr-57685c466c-r7g6d\" (UID: \"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.289805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk8t5\" (UniqueName: \"kubernetes.io/projected/2dc16e5e-8eaf-4157-9c55-80d0e9b50a74-kube-api-access-kk8t5\") pod \"downloads-5bc67dcd46-7d9vn\" (UID: \"2dc16e5e-8eaf-4157-9c55-80d0e9b50a74\") " pod="openshift-console/downloads-5bc67dcd46-7d9vn" Jul 21 17:02:54.289805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-ca\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.289805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.290148 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37365c91-f747-4023-bc82-3fcdf8749a15-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-n7w78\" (UID: \"37365c91-f747-4023-bc82-3fcdf8749a15\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" Jul 21 17:02:54.290148 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49lxf\" (UniqueName: \"kubernetes.io/projected/25891855-8115-4873-97ca-f73e798e2c3e-kube-api-access-49lxf\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.290148 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jkj\" (UniqueName: \"kubernetes.io/projected/fe32da88-2ead-417a-a38b-70a5eee896d1-kube-api-access-r2jkj\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.290148 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.290148 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.289984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdk9p\" (UniqueName: \"kubernetes.io/projected/e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6-kube-api-access-fdk9p\") pod \"managed-serviceaccount-addon-agent-6c477bdc76-q7wdg\" (UID: \"e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" Jul 21 17:02:54.290148 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.290009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37365c91-f747-4023-bc82-3fcdf8749a15-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-n7w78\" (UID: \"37365c91-f747-4023-bc82-3fcdf8749a15\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" Jul 21 17:02:54.290148 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.290046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c477bdc76-q7wdg\" (UID: \"e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" Jul 21 17:02:54.290148 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.290073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-service-ca\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.290148 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.290111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-console-config\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.290148 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.290143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-oauth-serving-cert\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.290463 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.290180 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/25891855-8115-4873-97ca-f73e798e2c3e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.290463 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.290205 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-serving-cert\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.291223 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.291192 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37365c91-f747-4023-bc82-3fcdf8749a15-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-n7w78\" (UID: \"37365c91-f747-4023-bc82-3fcdf8749a15\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" Jul 21 17:02:54.294906 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.294856 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c477bdc76-q7wdg\" (UID: \"e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" Jul 21 17:02:54.297440 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.297402 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37365c91-f747-4023-bc82-3fcdf8749a15-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-n7w78\" (UID: \"37365c91-f747-4023-bc82-3fcdf8749a15\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" Jul 21 17:02:54.315481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.315379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdk9p\" (UniqueName: \"kubernetes.io/projected/e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6-kube-api-access-fdk9p\") pod \"managed-serviceaccount-addon-agent-6c477bdc76-q7wdg\" (UID: \"e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk8t5\" (UniqueName: \"kubernetes.io/projected/2dc16e5e-8eaf-4157-9c55-80d0e9b50a74-kube-api-access-kk8t5\") pod \"downloads-5bc67dcd46-7d9vn\" (UID: \"2dc16e5e-8eaf-4157-9c55-80d0e9b50a74\") " pod="openshift-console/downloads-5bc67dcd46-7d9vn" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-ca\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49lxf\" (UniqueName: \"kubernetes.io/projected/25891855-8115-4873-97ca-f73e798e2c3e-kube-api-access-49lxf\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jkj\" (UniqueName: \"kubernetes.io/projected/fe32da88-2ead-417a-a38b-70a5eee896d1-kube-api-access-r2jkj\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-service-ca\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-console-config\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-oauth-serving-cert\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/25891855-8115-4873-97ca-f73e798e2c3e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-serving-cert\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66-klusterlet-config\") pod \"klusterlet-addon-workmgr-57685c466c-r7g6d\" (UID: \"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-oauth-config\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-hub\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fts\" (UniqueName: \"kubernetes.io/projected/f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66-kube-api-access-s8fts\") pod \"klusterlet-addon-workmgr-57685c466c-r7g6d\" (UID: \"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.392554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.391821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66-tmp\") pod \"klusterlet-addon-workmgr-57685c466c-r7g6d\" (UID: \"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.393580 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.392301 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66-tmp\") pod \"klusterlet-addon-workmgr-57685c466c-r7g6d\" (UID: \"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.396883 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.396020 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-console-config\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.396883 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.396033 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-service-ca\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.396883 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.396731 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-oauth-serving-cert\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.396883 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.396842 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" Jul 21 17:02:54.396883 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.396843 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/25891855-8115-4873-97ca-f73e798e2c3e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.399700 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.399654 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-oauth-config\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.400546 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.400501 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66-klusterlet-config\") pod \"klusterlet-addon-workmgr-57685c466c-r7g6d\" (UID: \"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.400907 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.400860 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.402088 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.402026 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-hub\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.402088 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.402037 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-ca\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.402330 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.402305 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/25891855-8115-4873-97ca-f73e798e2c3e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.403943 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.403882 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-serving-cert\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.415161 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.415127 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jkj\" (UniqueName: \"kubernetes.io/projected/fe32da88-2ead-417a-a38b-70a5eee896d1-kube-api-access-r2jkj\") pod \"console-7b99756779-5smvr\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.417185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.417104 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8fts\" (UniqueName: \"kubernetes.io/projected/f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66-kube-api-access-s8fts\") pod \"klusterlet-addon-workmgr-57685c466c-r7g6d\" (UID: \"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.417379 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.417340 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk8t5\" (UniqueName: \"kubernetes.io/projected/2dc16e5e-8eaf-4157-9c55-80d0e9b50a74-kube-api-access-kk8t5\") pod \"downloads-5bc67dcd46-7d9vn\" (UID: \"2dc16e5e-8eaf-4157-9c55-80d0e9b50a74\") " pod="openshift-console/downloads-5bc67dcd46-7d9vn" Jul 21 17:02:54.418873 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.418846 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49lxf\" (UniqueName: \"kubernetes.io/projected/25891855-8115-4873-97ca-f73e798e2c3e-kube-api-access-49lxf\") pod \"cluster-proxy-proxy-agent-6d5bb89b84-v2b4b\" (UID: \"25891855-8115-4873-97ca-f73e798e2c3e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.437784 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.437747 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" Jul 21 17:02:54.448818 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.448778 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:02:54.456609 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.456327 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" Jul 21 17:02:54.500580 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.500549 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:54.501650 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.501629 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69d6dcbc6-52rk5" Jul 21 17:02:54.508203 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.508010 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:02:54.520737 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:54.520702 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-7d9vn" Jul 21 17:02:55.116429 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.116397 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7786544f67-n6vjg"] Jul 21 17:02:55.121028 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.120330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.129421 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.129396 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 21 17:02:55.133255 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.133116 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7786544f67-n6vjg"] Jul 21 17:02:55.301035 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.300616 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-oauth-serving-cert\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.301035 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.300685 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hskx4\" (UniqueName: \"kubernetes.io/projected/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-kube-api-access-hskx4\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.301035 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.300704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-serving-cert\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.301035 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.300760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-oauth-config\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.301035 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.300775 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-service-ca\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.301035 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.300807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-trusted-ca-bundle\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.301035 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.300842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-config\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.401458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.401360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-trusted-ca-bundle\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.401458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.401424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-config\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.401458 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.401454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-oauth-serving-cert\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.401801 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.401473 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hskx4\" (UniqueName: \"kubernetes.io/projected/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-kube-api-access-hskx4\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.401801 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.401536 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-serving-cert\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.401801 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.401609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-oauth-config\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.401801 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.401644 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-service-ca\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.402741 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.402708 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-config\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.403419 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.403391 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-service-ca\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.403563 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.403433 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-oauth-serving-cert\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.403563 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.403546 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-trusted-ca-bundle\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.406504 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.406474 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-oauth-config\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.406648 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.406484 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-serving-cert\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.416602 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.416571 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hskx4\" (UniqueName: \"kubernetes.io/projected/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-kube-api-access-hskx4\") pod \"console-7786544f67-n6vjg\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:55.432571 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:55.432502 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:02:56.856376 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:56.856348 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78"] Jul 21 17:02:57.634195 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:57.634154 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37365c91_f747_4023_bc82_3fcdf8749a15.slice/crio-2faada716115d43c41b6a15d7d5f37288f2561e907d63a12d2e7eb4c81303fed WatchSource:0}: Error finding container 2faada716115d43c41b6a15d7d5f37288f2561e907d63a12d2e7eb4c81303fed: Status 404 returned error can't find the container with id 2faada716115d43c41b6a15d7d5f37288f2561e907d63a12d2e7eb4c81303fed Jul 21 17:02:57.821869 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:57.821838 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7786544f67-n6vjg"] Jul 21 17:02:57.837284 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:57.837253 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg"] Jul 21 17:02:57.839351 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:57.839322 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d"] Jul 21 17:02:57.854397 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:57.854358 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a53b851_d0a3_4ab3_9f1a_c254ea624e3e.slice/crio-39b783a15723a452c62af2b187e7b971072b930b06fe382e58cd2c2c80181b75 WatchSource:0}: Error finding container 39b783a15723a452c62af2b187e7b971072b930b06fe382e58cd2c2c80181b75: Status 404 returned error can't find the container with id 39b783a15723a452c62af2b187e7b971072b930b06fe382e58cd2c2c80181b75 Jul 21 17:02:57.859366 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:57.859337 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode83bce4f_1ccb_4e37_ba23_abc0fd6e48c6.slice/crio-33d3c0b8737f795fb56edd5cad13f4a05094a89b90388dac5a792c4d1018345e WatchSource:0}: Error finding container 33d3c0b8737f795fb56edd5cad13f4a05094a89b90388dac5a792c4d1018345e: Status 404 returned error can't find the container with id 33d3c0b8737f795fb56edd5cad13f4a05094a89b90388dac5a792c4d1018345e Jul 21 17:02:57.876566 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:57.873403 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-7d9vn"] Jul 21 17:02:57.878939 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:57.878915 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc16e5e_8eaf_4157_9c55_80d0e9b50a74.slice/crio-095215140e13e0e2e13fa051bd1c67a3bca9a0fe0fb5393d06254f30dc938f68 WatchSource:0}: Error finding container 095215140e13e0e2e13fa051bd1c67a3bca9a0fe0fb5393d06254f30dc938f68: Status 404 returned error can't find the container with id 095215140e13e0e2e13fa051bd1c67a3bca9a0fe0fb5393d06254f30dc938f68 Jul 21 17:02:58.043601 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.043550 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b99756779-5smvr"] Jul 21 17:02:58.069276 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.069238 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b"] Jul 21 17:02:58.092363 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:58.092328 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe32da88_2ead_417a_a38b_70a5eee896d1.slice/crio-143c1e912b4ea15b2934dc1d0d1f68efa4f557ec937dab01e84e82b2d57c7341 WatchSource:0}: Error finding container 143c1e912b4ea15b2934dc1d0d1f68efa4f557ec937dab01e84e82b2d57c7341: Status 404 returned error can't find the container with id 143c1e912b4ea15b2934dc1d0d1f68efa4f557ec937dab01e84e82b2d57c7341 Jul 21 17:02:58.092702 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:02:58.092611 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25891855_8115_4873_97ca_f73e798e2c3e.slice/crio-7597f5993389b7b88f9089a6ac0ce2d56324dd1eadaaa09784c2b07efa48ed1e WatchSource:0}: Error finding container 7597f5993389b7b88f9089a6ac0ce2d56324dd1eadaaa09784c2b07efa48ed1e: Status 404 returned error can't find the container with id 7597f5993389b7b88f9089a6ac0ce2d56324dd1eadaaa09784c2b07efa48ed1e Jul 21 17:02:58.517398 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.517364 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" event={"ID":"06d7cf7a-e354-4bf0-89d3-c3440c3e9555","Type":"ContainerStarted","Data":"a5569d0d0185e410529c4a6555745b500ccf073d2fad75a53f1366cd4a5e4f8d"} Jul 21 17:02:58.518734 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.518704 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" event={"ID":"e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6","Type":"ContainerStarted","Data":"33d3c0b8737f795fb56edd5cad13f4a05094a89b90388dac5a792c4d1018345e"} Jul 21 17:02:58.520495 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.520456 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntx42" event={"ID":"74f5d180-f2a1-4374-9f31-871aa10b67cb","Type":"ContainerStarted","Data":"02ee3b46f6e64385a68396b6815df925b3262a34b791f4575ca379334e1960fe"} Jul 21 17:02:58.520648 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.520508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntx42" event={"ID":"74f5d180-f2a1-4374-9f31-871aa10b67cb","Type":"ContainerStarted","Data":"f42ea9f3d690b9ce1349dbee7ef849973d9b141762a652ba77ac6090d3a0514d"} Jul 21 17:02:58.520648 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.520577 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ntx42" Jul 21 17:02:58.522449 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.522415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ngcdm" event={"ID":"c4a26670-77aa-4eac-afc3-f896fbf0e4ab","Type":"ContainerStarted","Data":"2869aad097f641ff2165653cdc6edf4dd9eee72c55d8eb814d9bb9bcf2190b34"} Jul 21 17:02:58.523728 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.523703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" event={"ID":"25891855-8115-4873-97ca-f73e798e2c3e","Type":"ContainerStarted","Data":"7597f5993389b7b88f9089a6ac0ce2d56324dd1eadaaa09784c2b07efa48ed1e"} Jul 21 17:02:58.525053 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.525031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" event={"ID":"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66","Type":"ContainerStarted","Data":"ee54fc04561182e4eb5516c72da47d843240db42a673d2120aa73f2b279a8b8c"} Jul 21 17:02:58.526198 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.526175 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-7d9vn" event={"ID":"2dc16e5e-8eaf-4157-9c55-80d0e9b50a74","Type":"ContainerStarted","Data":"095215140e13e0e2e13fa051bd1c67a3bca9a0fe0fb5393d06254f30dc938f68"} Jul 21 17:02:58.527377 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.527354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" event={"ID":"37365c91-f747-4023-bc82-3fcdf8749a15","Type":"ContainerStarted","Data":"2faada716115d43c41b6a15d7d5f37288f2561e907d63a12d2e7eb4c81303fed"} Jul 21 17:02:58.528948 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.528921 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7786544f67-n6vjg" event={"ID":"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e","Type":"ContainerStarted","Data":"39b783a15723a452c62af2b187e7b971072b930b06fe382e58cd2c2c80181b75"} Jul 21 17:02:58.530110 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.530088 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b99756779-5smvr" event={"ID":"fe32da88-2ead-417a-a38b-70a5eee896d1","Type":"ContainerStarted","Data":"143c1e912b4ea15b2934dc1d0d1f68efa4f557ec937dab01e84e82b2d57c7341"} Jul 21 17:02:58.538266 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.538221 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-dchw4" podStartSLOduration=34.429895187 podStartE2EDuration="39.538200913s" totalImagesPullingTime="5.108305726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:58.537671479 +0000 UTC m=+79.964497573" watchObservedRunningTime="2026-07-21 17:02:58.538200913 +0000 UTC m=+79.965026985" Jul 21 17:02:58.561771 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:02:58.561706 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ntx42" podStartSLOduration=38.258201629 podStartE2EDuration="43.561680512s" totalImagesPullingTime="5.303478883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:02:58.560510258 +0000 UTC m=+79.987336353" watchObservedRunningTime="2026-07-21 17:02:58.561680512 +0000 UTC m=+79.988506606" Jul 21 17:03:01.567413 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:01.567367 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" event={"ID":"37365c91-f747-4023-bc82-3fcdf8749a15","Type":"ContainerStarted","Data":"6e9a652f4c0bf55407d084acdb1e95f7138a7a0e98da27f86a29ef8d2c6b1c9e"} Jul 21 17:03:07.930245 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:07.930157 2562 patch_prober.go:28] interesting pod/image-registry-6db68fc5c-vmjrb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 21 17:03:07.930768 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:07.930268 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" podUID="30514292-2e10-4f03-bb6b-477468668f13" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 17:03:08.539304 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:08.539270 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ntx42" Jul 21 17:03:08.563918 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:08.563857 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-n7w78" podStartSLOduration=11.590050796 podStartE2EDuration="14.56383295s" totalImagesPullingTime="2.973782154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:01.588901958 +0000 UTC m=+83.015728049" watchObservedRunningTime="2026-07-21 17:03:08.56383295 +0000 UTC m=+89.990659047" Jul 21 17:03:11.624428 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.624385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ngcdm" event={"ID":"c4a26670-77aa-4eac-afc3-f896fbf0e4ab","Type":"ContainerStarted","Data":"b705cdb085d0ee7a18a2bef4b9aa79c32a61c71ff264a03ea003ca5e28e7e43e"} Jul 21 17:03:11.627242 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.627207 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" event={"ID":"25891855-8115-4873-97ca-f73e798e2c3e","Type":"ContainerStarted","Data":"f1692202b75178f474082341cb1fcf5306a712a3e4052cfd8f2fa3f4f1ef926f"} Jul 21 17:03:11.627398 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.627273 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" event={"ID":"25891855-8115-4873-97ca-f73e798e2c3e","Type":"ContainerStarted","Data":"8f01557196718fa2b0ed078e21688e5f100ed1851ab0890cda897eedade5c817"} Jul 21 17:03:11.627398 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.627296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" event={"ID":"25891855-8115-4873-97ca-f73e798e2c3e","Type":"ContainerStarted","Data":"0f9ea0e45a6731b85f4b68d1f6e5e6d3a704f7434487096dc8edefe81794245f"} Jul 21 17:03:11.629045 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.629011 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" event={"ID":"f0f7d49d-1c5a-4b10-b3ce-a106e02bcc66","Type":"ContainerStarted","Data":"573cbc04079a615cad14bb8615daf54102e5029e5608006cf342c4941ce8e626"} Jul 21 17:03:11.629202 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.629184 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:03:11.631024 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.630956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7786544f67-n6vjg" event={"ID":"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e","Type":"ContainerStarted","Data":"1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a"} Jul 21 17:03:11.631142 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.631075 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" Jul 21 17:03:11.632806 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.632781 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b99756779-5smvr" event={"ID":"fe32da88-2ead-417a-a38b-70a5eee896d1","Type":"ContainerStarted","Data":"435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0"} Jul 21 17:03:11.634421 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.634394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" event={"ID":"e83bce4f-1ccb-4e37-ba23-abc0fd6e48c6","Type":"ContainerStarted","Data":"e93b9eda9a5db2984dae8085722aaba5a2f161d44f818bf9cba3a3b65e650729"} Jul 21 17:03:11.644204 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.644153 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ngcdm" podStartSLOduration=17.499802850000002 podStartE2EDuration="42.644139043s" totalImagesPullingTime="25.144336193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:02:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:11.64318963 +0000 UTC m=+93.070015725" watchObservedRunningTime="2026-07-21 17:03:11.644139043 +0000 UTC m=+93.070965135" Jul 21 17:03:11.660207 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.660143 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57685c466c-r7g6d" podStartSLOduration=4.858673319 podStartE2EDuration="17.660125812s" totalImagesPullingTime="12.801452493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:11.659705541 +0000 UTC m=+93.086531637" watchObservedRunningTime="2026-07-21 17:03:11.660125812 +0000 UTC m=+93.086951908" Jul 21 17:03:11.677637 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.677492 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c477bdc76-q7wdg" podStartSLOduration=4.900923341 podStartE2EDuration="17.677469134s" totalImagesPullingTime="12.776545793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:11.676450095 +0000 UTC m=+93.103276190" watchObservedRunningTime="2026-07-21 17:03:11.677469134 +0000 UTC m=+93.104295228" Jul 21 17:03:11.697198 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.697141 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d5bb89b84-v2b4b" podStartSLOduration=5.159151122 podStartE2EDuration="17.697118436s" totalImagesPullingTime="12.537967314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:11.695909048 +0000 UTC m=+93.122735141" watchObservedRunningTime="2026-07-21 17:03:11.697118436 +0000 UTC m=+93.123944529" Jul 21 17:03:11.715580 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.715501 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7786544f67-n6vjg" podStartSLOduration=3.936978298 podStartE2EDuration="16.71548195s" totalImagesPullingTime="12.778503652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:11.713339423 +0000 UTC m=+93.140165517" watchObservedRunningTime="2026-07-21 17:03:11.71548195 +0000 UTC m=+93.142308042" Jul 21 17:03:11.733253 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:11.733186 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b99756779-5smvr" podStartSLOduration=5.194502039 podStartE2EDuration="17.733167176s" totalImagesPullingTime="12.538665137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:11.730966817 +0000 UTC m=+93.157792911" watchObservedRunningTime="2026-07-21 17:03:11.733167176 +0000 UTC m=+93.159993269" Jul 21 17:03:12.996577 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:12.994741 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5z2qw"] Jul 21 17:03:13.000318 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.000284 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.004151 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.004076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 17:03:13.008227 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.007158 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fks9h\"" Jul 21 17:03:13.008227 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.008108 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 17:03:13.008561 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.008510 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 17:03:13.008802 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.008783 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 17:03:13.081387 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.081339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.081601 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.081395 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95211389-a5a3-4793-bb85-3d20b1ee8ae1-sys\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.081601 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.081420 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95211389-a5a3-4793-bb85-3d20b1ee8ae1-root\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.081601 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.081460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4z44\" (UniqueName: \"kubernetes.io/projected/95211389-a5a3-4793-bb85-3d20b1ee8ae1-kube-api-access-l4z44\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.081601 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.081485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-textfile\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.081601 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.081536 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-tls\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.081601 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.081587 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-wtmp\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.081906 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.081622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95211389-a5a3-4793-bb85-3d20b1ee8ae1-metrics-client-ca\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.081906 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.081656 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-accelerators-collector-config\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.182145 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.182099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95211389-a5a3-4793-bb85-3d20b1ee8ae1-metrics-client-ca\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.182332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.182163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-accelerators-collector-config\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.182332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.182204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.182332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.182234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95211389-a5a3-4793-bb85-3d20b1ee8ae1-sys\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.182332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.182259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95211389-a5a3-4793-bb85-3d20b1ee8ae1-root\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.182332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.182302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4z44\" (UniqueName: \"kubernetes.io/projected/95211389-a5a3-4793-bb85-3d20b1ee8ae1-kube-api-access-l4z44\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.182332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.182329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-textfile\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.182722 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.182364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-tls\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.182722 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.182435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-wtmp\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.182722 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.182629 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-wtmp\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.183570 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.183178 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95211389-a5a3-4793-bb85-3d20b1ee8ae1-sys\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.183570 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.183225 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95211389-a5a3-4793-bb85-3d20b1ee8ae1-metrics-client-ca\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.183570 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:03:13.183322 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 21 17:03:13.183570 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:03:13.183388 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-tls podName:95211389-a5a3-4793-bb85-3d20b1ee8ae1 nodeName:}" failed. No retries permitted until 2026-07-21 17:03:13.683369687 +0000 UTC m=+95.110195762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-tls") pod "node-exporter-5z2qw" (UID: "95211389-a5a3-4793-bb85-3d20b1ee8ae1") : secret "node-exporter-tls" not found Jul 21 17:03:13.184100 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.184074 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-accelerators-collector-config\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.184223 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.184207 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/95211389-a5a3-4793-bb85-3d20b1ee8ae1-root\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.184547 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.184477 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-textfile\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.189506 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.189455 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.199413 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.199204 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4z44\" (UniqueName: \"kubernetes.io/projected/95211389-a5a3-4793-bb85-3d20b1ee8ae1-kube-api-access-l4z44\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.502403 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.502369 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:03:13.689441 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.689406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-tls\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.693923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.693801 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/95211389-a5a3-4793-bb85-3d20b1ee8ae1-node-exporter-tls\") pod \"node-exporter-5z2qw\" (UID: \"95211389-a5a3-4793-bb85-3d20b1ee8ae1\") " pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:13.918992 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:13.918955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5z2qw" Jul 21 17:03:14.509146 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:14.509112 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:03:14.509660 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:14.509196 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:03:14.515294 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:14.515266 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:03:14.659446 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:14.659411 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:03:15.433700 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:15.433659 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:03:15.433890 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:15.433732 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:03:15.439565 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:15.439532 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:03:15.665485 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:15.665455 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:03:15.717773 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:15.717688 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b99756779-5smvr"] Jul 21 17:03:16.444038 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:16.444003 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9dw5f" Jul 21 17:03:18.868555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:18.868236 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db68fc5c-vmjrb"] Jul 21 17:03:19.317691 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:03:19.317652 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95211389_a5a3_4793_bb85_3d20b1ee8ae1.slice/crio-ef297da6cbb98a1c3eb787ffae79ba8927d6fde04c9671ff1fc1e54b1a172233 WatchSource:0}: Error finding container ef297da6cbb98a1c3eb787ffae79ba8927d6fde04c9671ff1fc1e54b1a172233: Status 404 returned error can't find the container with id ef297da6cbb98a1c3eb787ffae79ba8927d6fde04c9671ff1fc1e54b1a172233 Jul 21 17:03:19.683431 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:19.683315 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z2qw" event={"ID":"95211389-a5a3-4793-bb85-3d20b1ee8ae1","Type":"ContainerStarted","Data":"ef297da6cbb98a1c3eb787ffae79ba8927d6fde04c9671ff1fc1e54b1a172233"} Jul 21 17:03:20.690554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:20.690498 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-7d9vn" event={"ID":"2dc16e5e-8eaf-4157-9c55-80d0e9b50a74","Type":"ContainerStarted","Data":"6410b44d90869474bafeea3586fa9881d64ff84ddc8541e83aaaafb699817850"} Jul 21 17:03:20.691017 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:20.690724 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-7d9vn" Jul 21 17:03:20.710807 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:20.710731 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-7d9vn" podStartSLOduration=4.8934528440000005 podStartE2EDuration="26.710714934s" totalImagesPullingTime="21.81726209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:20.710261412 +0000 UTC m=+102.137087506" watchObservedRunningTime="2026-07-21 17:03:20.710714934 +0000 UTC m=+102.137541028" Jul 21 17:03:20.711911 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:20.711886 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-7d9vn" Jul 21 17:03:21.697835 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:21.697800 2562 generic.go:356] "Generic (PLEG): container finished" podID="95211389-a5a3-4793-bb85-3d20b1ee8ae1" containerID="3240550d60a5954a13f9217b66507d870ed478318374146b9837687768e96367" exitCode=0 Jul 21 17:03:21.698318 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:21.697898 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z2qw" event={"ID":"95211389-a5a3-4793-bb85-3d20b1ee8ae1","Type":"ContainerDied","Data":"3240550d60a5954a13f9217b66507d870ed478318374146b9837687768e96367"} Jul 21 17:03:22.707849 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:22.707805 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z2qw" event={"ID":"95211389-a5a3-4793-bb85-3d20b1ee8ae1","Type":"ContainerStarted","Data":"b5193a170f7ada53cade8114f46b48294b74694c82f67f79a81b35f62deb8c4f"} Jul 21 17:03:22.708394 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:22.707909 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z2qw" event={"ID":"95211389-a5a3-4793-bb85-3d20b1ee8ae1","Type":"ContainerStarted","Data":"9aeddd126b1b81c58e3889d206ebe83f0a911caa4bb30c038d0586c7e8d14dac"} Jul 21 17:03:22.734674 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:22.734616 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5z2qw" podStartSLOduration=9.191692604 podStartE2EDuration="10.734596622s" totalImagesPullingTime="1.423366446s" totalInitContainerRuntime="119.537572ms" isStatefulPod=true podCreationTimestamp="2026-07-21 17:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:03:22.73295069 +0000 UTC m=+104.159776783" watchObservedRunningTime="2026-07-21 17:03:22.734596622 +0000 UTC m=+104.161422717" Jul 21 17:03:36.046248 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:36.046208 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7786544f67-n6vjg"] Jul 21 17:03:42.704395 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:42.704326 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b99756779-5smvr" podUID="fe32da88-2ead-417a-a38b-70a5eee896d1" containerName="console" containerID="cri-o://435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0" gracePeriod=15 Jul 21 17:03:42.994290 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:42.994258 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:03:43.059877 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.059844 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-oauth-serving-cert\") pod \"fe32da88-2ead-417a-a38b-70a5eee896d1\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " Jul 21 17:03:43.059877 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.059893 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2jkj\" (UniqueName: \"kubernetes.io/projected/fe32da88-2ead-417a-a38b-70a5eee896d1-kube-api-access-r2jkj\") pod \"fe32da88-2ead-417a-a38b-70a5eee896d1\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " Jul 21 17:03:43.060099 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.059921 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-service-ca\") pod \"fe32da88-2ead-417a-a38b-70a5eee896d1\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " Jul 21 17:03:43.060099 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.059960 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-serving-cert\") pod \"fe32da88-2ead-417a-a38b-70a5eee896d1\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " Jul 21 17:03:43.060099 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.060033 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-oauth-config\") pod \"fe32da88-2ead-417a-a38b-70a5eee896d1\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " Jul 21 17:03:43.060099 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.060064 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-console-config\") pod \"fe32da88-2ead-417a-a38b-70a5eee896d1\" (UID: \"fe32da88-2ead-417a-a38b-70a5eee896d1\") " Jul 21 17:03:43.060373 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.060344 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fe32da88-2ead-417a-a38b-70a5eee896d1" (UID: "fe32da88-2ead-417a-a38b-70a5eee896d1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:03:43.060501 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.060361 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-service-ca" (OuterVolumeSpecName: "service-ca") pod "fe32da88-2ead-417a-a38b-70a5eee896d1" (UID: "fe32da88-2ead-417a-a38b-70a5eee896d1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:03:43.060593 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.060546 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-console-config" (OuterVolumeSpecName: "console-config") pod "fe32da88-2ead-417a-a38b-70a5eee896d1" (UID: "fe32da88-2ead-417a-a38b-70a5eee896d1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:03:43.062468 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.062442 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fe32da88-2ead-417a-a38b-70a5eee896d1" (UID: "fe32da88-2ead-417a-a38b-70a5eee896d1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:03:43.062585 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.062488 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe32da88-2ead-417a-a38b-70a5eee896d1-kube-api-access-r2jkj" (OuterVolumeSpecName: "kube-api-access-r2jkj") pod "fe32da88-2ead-417a-a38b-70a5eee896d1" (UID: "fe32da88-2ead-417a-a38b-70a5eee896d1"). InnerVolumeSpecName "kube-api-access-r2jkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:03:43.062585 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.062501 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fe32da88-2ead-417a-a38b-70a5eee896d1" (UID: "fe32da88-2ead-417a-a38b-70a5eee896d1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:03:43.161280 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.161242 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-serving-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:43.161280 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.161274 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe32da88-2ead-417a-a38b-70a5eee896d1-console-oauth-config\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:43.161280 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.161284 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-console-config\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:43.161501 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.161298 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-oauth-serving-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:43.161501 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.161310 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2jkj\" (UniqueName: \"kubernetes.io/projected/fe32da88-2ead-417a-a38b-70a5eee896d1-kube-api-access-r2jkj\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:43.161501 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.161319 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe32da88-2ead-417a-a38b-70a5eee896d1-service-ca\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:43.802728 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.802696 2562 generic.go:356] "Generic (PLEG): container finished" podID="fe32da88-2ead-417a-a38b-70a5eee896d1" containerID="435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0" exitCode=0 Jul 21 17:03:43.803137 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.802749 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b99756779-5smvr" Jul 21 17:03:43.803137 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.802777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b99756779-5smvr" event={"ID":"fe32da88-2ead-417a-a38b-70a5eee896d1","Type":"ContainerDied","Data":"435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0"} Jul 21 17:03:43.803137 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.802828 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b99756779-5smvr" event={"ID":"fe32da88-2ead-417a-a38b-70a5eee896d1","Type":"ContainerDied","Data":"143c1e912b4ea15b2934dc1d0d1f68efa4f557ec937dab01e84e82b2d57c7341"} Jul 21 17:03:43.803137 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.802851 2562 scope.go:117] "RemoveContainer" containerID="435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0" Jul 21 17:03:43.811438 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.811421 2562 scope.go:117] "RemoveContainer" containerID="435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0" Jul 21 17:03:43.811770 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:03:43.811749 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0\": container with ID starting with 435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0 not found: ID does not exist" containerID="435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0" Jul 21 17:03:43.811826 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.811781 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0"} err="failed to get container status \"435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0\": rpc error: code = NotFound desc = could not find container \"435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0\": container with ID starting with 435aa335bb30f566efc652857a6335cc922df8298e50c91dde364402362713f0 not found: ID does not exist" Jul 21 17:03:43.821532 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.821494 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b99756779-5smvr"] Jul 21 17:03:43.826076 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.826044 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b99756779-5smvr"] Jul 21 17:03:43.901934 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:43.901895 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" podUID="30514292-2e10-4f03-bb6b-477468668f13" containerName="registry" containerID="cri-o://412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04" gracePeriod=30 Jul 21 17:03:44.184703 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.184672 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:03:44.272432 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.272401 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") pod \"30514292-2e10-4f03-bb6b-477468668f13\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " Jul 21 17:03:44.272667 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.272449 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sxd5\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-kube-api-access-9sxd5\") pod \"30514292-2e10-4f03-bb6b-477468668f13\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " Jul 21 17:03:44.272667 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.272475 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-trusted-ca\") pod \"30514292-2e10-4f03-bb6b-477468668f13\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " Jul 21 17:03:44.272667 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.272504 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30514292-2e10-4f03-bb6b-477468668f13-ca-trust-extracted\") pod \"30514292-2e10-4f03-bb6b-477468668f13\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " Jul 21 17:03:44.272835 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.272727 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-registry-certificates\") pod \"30514292-2e10-4f03-bb6b-477468668f13\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " Jul 21 17:03:44.272893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.272841 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-bound-sa-token\") pod \"30514292-2e10-4f03-bb6b-477468668f13\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " Jul 21 17:03:44.272893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.272887 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-image-registry-private-configuration\") pod \"30514292-2e10-4f03-bb6b-477468668f13\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " Jul 21 17:03:44.272988 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.272939 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-installation-pull-secrets\") pod \"30514292-2e10-4f03-bb6b-477468668f13\" (UID: \"30514292-2e10-4f03-bb6b-477468668f13\") " Jul 21 17:03:44.273578 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.273297 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "30514292-2e10-4f03-bb6b-477468668f13" (UID: "30514292-2e10-4f03-bb6b-477468668f13"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:03:44.273578 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.273504 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "30514292-2e10-4f03-bb6b-477468668f13" (UID: "30514292-2e10-4f03-bb6b-477468668f13"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:03:44.276117 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.276062 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "30514292-2e10-4f03-bb6b-477468668f13" (UID: "30514292-2e10-4f03-bb6b-477468668f13"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:03:44.276293 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.276261 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "30514292-2e10-4f03-bb6b-477468668f13" (UID: "30514292-2e10-4f03-bb6b-477468668f13"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:03:44.276429 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.276398 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "30514292-2e10-4f03-bb6b-477468668f13" (UID: "30514292-2e10-4f03-bb6b-477468668f13"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:03:44.276497 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.276453 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "30514292-2e10-4f03-bb6b-477468668f13" (UID: "30514292-2e10-4f03-bb6b-477468668f13"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:03:44.276607 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.276580 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-kube-api-access-9sxd5" (OuterVolumeSpecName: "kube-api-access-9sxd5") pod "30514292-2e10-4f03-bb6b-477468668f13" (UID: "30514292-2e10-4f03-bb6b-477468668f13"). InnerVolumeSpecName "kube-api-access-9sxd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:03:44.283690 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.282590 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30514292-2e10-4f03-bb6b-477468668f13-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "30514292-2e10-4f03-bb6b-477468668f13" (UID: "30514292-2e10-4f03-bb6b-477468668f13"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:03:44.374064 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.373972 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sxd5\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-kube-api-access-9sxd5\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:44.374064 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.374005 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-trusted-ca\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:44.374064 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.374017 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30514292-2e10-4f03-bb6b-477468668f13-ca-trust-extracted\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:44.374064 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.374029 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30514292-2e10-4f03-bb6b-477468668f13-registry-certificates\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:44.374064 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.374040 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-bound-sa-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:44.374064 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.374054 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-image-registry-private-configuration\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:44.374064 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.374066 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30514292-2e10-4f03-bb6b-477468668f13-installation-pull-secrets\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:44.374405 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.374078 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30514292-2e10-4f03-bb6b-477468668f13-registry-tls\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:03:44.809723 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.809690 2562 generic.go:356] "Generic (PLEG): container finished" podID="30514292-2e10-4f03-bb6b-477468668f13" containerID="412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04" exitCode=0 Jul 21 17:03:44.810247 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.809738 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" Jul 21 17:03:44.810247 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.809790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" event={"ID":"30514292-2e10-4f03-bb6b-477468668f13","Type":"ContainerDied","Data":"412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04"} Jul 21 17:03:44.810247 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.809889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db68fc5c-vmjrb" event={"ID":"30514292-2e10-4f03-bb6b-477468668f13","Type":"ContainerDied","Data":"82ec2af32a7576df8f4e61105d9057680fe85e205d0d58f3287f639f8bdb276f"} Jul 21 17:03:44.810247 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.809920 2562 scope.go:117] "RemoveContainer" containerID="412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04" Jul 21 17:03:44.818925 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.818907 2562 scope.go:117] "RemoveContainer" containerID="412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04" Jul 21 17:03:44.819245 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:03:44.819226 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04\": container with ID starting with 412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04 not found: ID does not exist" containerID="412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04" Jul 21 17:03:44.819322 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.819255 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04"} err="failed to get container status \"412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04\": rpc error: code = NotFound desc = could not find container \"412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04\": container with ID starting with 412251d718cae5f5f485c7f61cc774dfa3a90f341f3281ba7b033f345d50ca04 not found: ID does not exist" Jul 21 17:03:44.833762 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.833726 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db68fc5c-vmjrb"] Jul 21 17:03:44.839855 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:44.839824 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6db68fc5c-vmjrb"] Jul 21 17:03:45.113956 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:45.113878 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30514292-2e10-4f03-bb6b-477468668f13" path="/var/lib/kubelet/pods/30514292-2e10-4f03-bb6b-477468668f13/volumes" Jul 21 17:03:45.114253 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:45.114240 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe32da88-2ead-417a-a38b-70a5eee896d1" path="/var/lib/kubelet/pods/fe32da88-2ead-417a-a38b-70a5eee896d1/volumes" Jul 21 17:03:48.830351 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:48.830317 2562 generic.go:356] "Generic (PLEG): container finished" podID="1997ec8d-0dca-46b0-99da-b416ea6c50ec" containerID="8592babeb6c4afcbd80c6eef013c74c15bf4766a0069bddab2a2426afb48c6bb" exitCode=0 Jul 21 17:03:48.830830 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:48.830393 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v5cw2" event={"ID":"1997ec8d-0dca-46b0-99da-b416ea6c50ec","Type":"ContainerDied","Data":"8592babeb6c4afcbd80c6eef013c74c15bf4766a0069bddab2a2426afb48c6bb"} Jul 21 17:03:48.830884 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:48.830831 2562 scope.go:117] "RemoveContainer" containerID="8592babeb6c4afcbd80c6eef013c74c15bf4766a0069bddab2a2426afb48c6bb" Jul 21 17:03:48.832231 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:48.832116 2562 generic.go:356] "Generic (PLEG): container finished" podID="105321d0-98bd-4ecf-b05b-162f7cde46f4" containerID="53cf904c50e69f433e7166bac992a98cb930870b718c2a09f67107fe10457556" exitCode=0 Jul 21 17:03:48.832231 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:48.832169 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" event={"ID":"105321d0-98bd-4ecf-b05b-162f7cde46f4","Type":"ContainerDied","Data":"53cf904c50e69f433e7166bac992a98cb930870b718c2a09f67107fe10457556"} Jul 21 17:03:48.832428 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:48.832404 2562 scope.go:117] "RemoveContainer" containerID="53cf904c50e69f433e7166bac992a98cb930870b718c2a09f67107fe10457556" Jul 21 17:03:49.838881 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:49.838838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p5lk7" event={"ID":"105321d0-98bd-4ecf-b05b-162f7cde46f4","Type":"ContainerStarted","Data":"1df7280e2af1b6201ec532e536bdbceda887ff203b6649f817d3f5bbcea01cdb"} Jul 21 17:03:49.840756 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:49.840721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v5cw2" event={"ID":"1997ec8d-0dca-46b0-99da-b416ea6c50ec","Type":"ContainerStarted","Data":"4a7829ed09b73866765131fb1e05fd1207372d41bb66d1f1b8fe46321775aff2"} Jul 21 17:03:58.880257 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:58.880219 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d375130-c287-41c1-902d-068410ff6bcd" containerID="8275740f5fdad3a16e44aba17193ee6d36a9ab733f79336858984d0e087eb4b9" exitCode=0 Jul 21 17:03:58.880692 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:58.880287 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" event={"ID":"6d375130-c287-41c1-902d-068410ff6bcd","Type":"ContainerDied","Data":"8275740f5fdad3a16e44aba17193ee6d36a9ab733f79336858984d0e087eb4b9"} Jul 21 17:03:58.880692 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:58.880661 2562 scope.go:117] "RemoveContainer" containerID="8275740f5fdad3a16e44aba17193ee6d36a9ab733f79336858984d0e087eb4b9" Jul 21 17:03:59.886807 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:03:59.886773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-74g4k" event={"ID":"6d375130-c287-41c1-902d-068410ff6bcd","Type":"ContainerStarted","Data":"9ee31fc959badf37f996537f41c476d002c46a47555e2478a8335d53882e0fc8"} Jul 21 17:04:01.068068 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.068000 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7786544f67-n6vjg" podUID="7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" containerName="console" containerID="cri-o://1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a" gracePeriod=15 Jul 21 17:04:01.368739 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.368701 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:04:01.426511 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.426473 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hskx4\" (UniqueName: \"kubernetes.io/projected/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-kube-api-access-hskx4\") pod \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " Jul 21 17:04:01.426511 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.426508 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-trusted-ca-bundle\") pod \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " Jul 21 17:04:01.426786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.426567 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-config\") pod \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " Jul 21 17:04:01.426786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.426589 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-oauth-serving-cert\") pod \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " Jul 21 17:04:01.426786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.426613 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-serving-cert\") pod \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " Jul 21 17:04:01.426786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.426682 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-oauth-config\") pod \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " Jul 21 17:04:01.426786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.426745 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-service-ca\") pod \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\" (UID: \"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e\") " Jul 21 17:04:01.427045 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.427009 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-config" (OuterVolumeSpecName: "console-config") pod "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" (UID: "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:04:01.427045 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.427028 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" (UID: "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:04:01.427147 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.427051 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" (UID: "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:04:01.427299 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.427278 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-service-ca" (OuterVolumeSpecName: "service-ca") pod "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" (UID: "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:04:01.428923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.428898 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-kube-api-access-hskx4" (OuterVolumeSpecName: "kube-api-access-hskx4") pod "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" (UID: "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e"). InnerVolumeSpecName "kube-api-access-hskx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:04:01.429020 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.428957 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" (UID: "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:04:01.429154 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.429139 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" (UID: "7a53b851-d0a3-4ab3-9f1a-c254ea624e3e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:04:01.527607 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.527570 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-service-ca\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:04:01.527607 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.527600 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hskx4\" (UniqueName: \"kubernetes.io/projected/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-kube-api-access-hskx4\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:04:01.527607 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.527613 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-trusted-ca-bundle\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:04:01.527843 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.527621 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-config\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:04:01.527843 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.527630 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-oauth-serving-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:04:01.527843 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.527638 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-serving-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:04:01.527843 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.527648 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e-console-oauth-config\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:04:01.896596 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.896559 2562 generic.go:356] "Generic (PLEG): container finished" podID="7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" containerID="1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a" exitCode=0 Jul 21 17:04:01.896820 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.896610 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7786544f67-n6vjg" Jul 21 17:04:01.896820 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.896613 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7786544f67-n6vjg" event={"ID":"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e","Type":"ContainerDied","Data":"1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a"} Jul 21 17:04:01.896820 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.896669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7786544f67-n6vjg" event={"ID":"7a53b851-d0a3-4ab3-9f1a-c254ea624e3e","Type":"ContainerDied","Data":"39b783a15723a452c62af2b187e7b971072b930b06fe382e58cd2c2c80181b75"} Jul 21 17:04:01.896820 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.896695 2562 scope.go:117] "RemoveContainer" containerID="1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a" Jul 21 17:04:01.906124 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.906101 2562 scope.go:117] "RemoveContainer" containerID="1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a" Jul 21 17:04:01.906417 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:04:01.906397 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a\": container with ID starting with 1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a not found: ID does not exist" containerID="1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a" Jul 21 17:04:01.906466 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.906428 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a"} err="failed to get container status \"1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a\": rpc error: code = NotFound desc = could not find container \"1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a\": container with ID starting with 1c68cf4923590cd00721a1cc7d81757aaf99d26b0caeecb81b8b439a1051ae9a not found: ID does not exist" Jul 21 17:04:01.920287 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.920256 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7786544f67-n6vjg"] Jul 21 17:04:01.924591 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:01.924564 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7786544f67-n6vjg"] Jul 21 17:04:03.114258 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:04:03.114218 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" path="/var/lib/kubelet/pods/7a53b851-d0a3-4ab3-9f1a-c254ea624e3e/volumes" Jul 21 17:06:39.003813 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:39.003786 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:06:39.012710 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:39.012680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:06:39.015417 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:39.015392 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 17:06:53.341490 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.341452 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45"] Jul 21 17:06:53.343893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.341787 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe32da88-2ead-417a-a38b-70a5eee896d1" containerName="console" Jul 21 17:06:53.343893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.341801 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe32da88-2ead-417a-a38b-70a5eee896d1" containerName="console" Jul 21 17:06:53.343893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.341812 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" containerName="console" Jul 21 17:06:53.343893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.341818 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" containerName="console" Jul 21 17:06:53.343893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.341826 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30514292-2e10-4f03-bb6b-477468668f13" containerName="registry" Jul 21 17:06:53.343893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.341833 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="30514292-2e10-4f03-bb6b-477468668f13" containerName="registry" Jul 21 17:06:53.343893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.341891 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe32da88-2ead-417a-a38b-70a5eee896d1" containerName="console" Jul 21 17:06:53.343893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.341898 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a53b851-d0a3-4ab3-9f1a-c254ea624e3e" containerName="console" Jul 21 17:06:53.343893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.341906 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="30514292-2e10-4f03-bb6b-477468668f13" containerName="registry" Jul 21 17:06:53.344830 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.344784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.348669 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.348642 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 21 17:06:53.349712 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.349693 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 21 17:06:53.350026 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.349998 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tgbxz\"" Jul 21 17:06:53.350121 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.350040 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 17:06:53.353762 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.353740 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 17:06:53.381286 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.381257 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45"] Jul 21 17:06:53.426702 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.426666 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.426702 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.426701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf2sn\" (UniqueName: \"kubernetes.io/projected/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-kube-api-access-qf2sn\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.426944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.426765 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-manifests\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.426944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.426801 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-tmp\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.426944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.426864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.527484 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.527448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-tmp\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.527695 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.527491 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.527695 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.527533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.527695 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.527549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf2sn\" (UniqueName: \"kubernetes.io/projected/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-kube-api-access-qf2sn\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.527695 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.527601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-manifests\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.527972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.527941 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-manifests\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.529943 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.529912 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-tmp\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.530216 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.530197 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.530289 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.530197 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.548556 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.548496 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf2sn\" (UniqueName: \"kubernetes.io/projected/37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac-kube-api-access-qf2sn\") pod \"opendatahub-operator-controller-manager-6cc55bc8b7-2gr45\" (UID: \"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.655423 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.655334 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:53.802850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.802762 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45"] Jul 21 17:06:53.805278 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:06:53.805251 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f6a5e3_5aad_4ef8_9d40_ddb299fa0cac.slice/crio-3e78977d0a301eb3903d3a0b862d235b7f551074d44abfbc9d862c4aaddf26d9 WatchSource:0}: Error finding container 3e78977d0a301eb3903d3a0b862d235b7f551074d44abfbc9d862c4aaddf26d9: Status 404 returned error can't find the container with id 3e78977d0a301eb3903d3a0b862d235b7f551074d44abfbc9d862c4aaddf26d9 Jul 21 17:06:53.807221 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:53.807207 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 17:06:54.575002 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:54.574920 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" event={"ID":"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac","Type":"ContainerStarted","Data":"3e78977d0a301eb3903d3a0b862d235b7f551074d44abfbc9d862c4aaddf26d9"} Jul 21 17:06:57.592606 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:57.592570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" event={"ID":"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac","Type":"ContainerStarted","Data":"af250718ae6c312b316ec0c6bf15640c3aae98869aaea42c31e9ab2e5783b62e"} Jul 21 17:06:58.598405 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:58.598363 2562 generic.go:356] "Generic (PLEG): container finished" podID="37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac" containerID="af250718ae6c312b316ec0c6bf15640c3aae98869aaea42c31e9ab2e5783b62e" exitCode=0 Jul 21 17:06:58.598862 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:58.598463 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" event={"ID":"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac","Type":"ContainerDied","Data":"af250718ae6c312b316ec0c6bf15640c3aae98869aaea42c31e9ab2e5783b62e"} Jul 21 17:06:59.604916 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:59.604882 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" event={"ID":"37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac","Type":"ContainerStarted","Data":"accbda9a14f86a67ad356656a6e095d2d968a8539342bb1fac3aebc94b88f557"} Jul 21 17:06:59.605306 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:59.604985 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:06:59.632082 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:06:59.632022 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" podStartSLOduration=1.752086814 podStartE2EDuration="6.632005907s" totalImagesPullingTime="3.785027218s" totalInitContainerRuntime="1.094891875s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:06:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:06:59.630403079 +0000 UTC m=+321.057229172" watchObservedRunningTime="2026-07-21 17:06:59.632005907 +0000 UTC m=+321.058831999" Jul 21 17:07:10.612412 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:10.612382 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cc55bc8b7-2gr45" Jul 21 17:07:20.689055 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.689015 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2"] Jul 21 17:07:20.701868 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.701841 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.706134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.705971 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 21 17:07:20.706134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.706023 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vlbxl\"" Jul 21 17:07:20.706134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.706079 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 21 17:07:20.706134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.706061 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 21 17:07:20.706134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.706133 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 21 17:07:20.706869 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.706608 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 21 17:07:20.708488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.708456 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2"] Jul 21 17:07:20.858107 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.858067 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-metrics-cert\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.858107 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.858107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-cert\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.858310 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.858189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-manager-config\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.858310 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.858244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbmfq\" (UniqueName: \"kubernetes.io/projected/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-kube-api-access-pbmfq\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.959305 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.959211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-metrics-cert\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.959305 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.959247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-cert\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.959305 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.959287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-manager-config\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.959642 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.959317 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbmfq\" (UniqueName: \"kubernetes.io/projected/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-kube-api-access-pbmfq\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.960109 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.960085 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-manager-config\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.961999 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.961969 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-metrics-cert\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.962081 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.962002 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-cert\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:20.977380 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:20.977350 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbmfq\" (UniqueName: \"kubernetes.io/projected/0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b-kube-api-access-pbmfq\") pod \"lws-controller-manager-5f64fdf99-tj2l2\" (UID: \"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b\") " pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:21.012418 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:21.012374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:21.163183 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:21.163002 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2"] Jul 21 17:07:21.166002 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:07:21.165973 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff421c9_33bb_43d4_bbd0_9f529b2c8f6b.slice/crio-2ef77ca10b6ab59d347709f7e7725f75e44b48382c2eee17d94d0875f5de0985 WatchSource:0}: Error finding container 2ef77ca10b6ab59d347709f7e7725f75e44b48382c2eee17d94d0875f5de0985: Status 404 returned error can't find the container with id 2ef77ca10b6ab59d347709f7e7725f75e44b48382c2eee17d94d0875f5de0985 Jul 21 17:07:21.702031 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:21.701997 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" event={"ID":"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b","Type":"ContainerStarted","Data":"2ef77ca10b6ab59d347709f7e7725f75e44b48382c2eee17d94d0875f5de0985"} Jul 21 17:07:22.778490 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.778456 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm"] Jul 21 17:07:22.782166 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.782138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.785037 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.784907 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hpskb\"" Jul 21 17:07:22.785708 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.785508 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 21 17:07:22.804117 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.804080 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm"] Jul 21 17:07:22.877606 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.877568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.877606 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.877609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.877853 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.877636 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.877853 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.877695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.877853 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.877754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cec55c52-727e-4062-a3a7-aa573d9cdfba-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.877853 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.877805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.878121 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.877874 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.878121 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.877966 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsgwc\" (UniqueName: \"kubernetes.io/projected/cec55c52-727e-4062-a3a7-aa573d9cdfba-kube-api-access-fsgwc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.878121 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.877990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.978879 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.978847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.979050 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.978899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsgwc\" (UniqueName: \"kubernetes.io/projected/cec55c52-727e-4062-a3a7-aa573d9cdfba-kube-api-access-fsgwc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.979188 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.979254 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.979308 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.979308 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.979408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.979408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cec55c52-727e-4062-a3a7-aa573d9cdfba-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.979510 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.980016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979616 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.980016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979645 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.980016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979742 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.980016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.979977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.980475 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.980320 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cec55c52-727e-4062-a3a7-aa573d9cdfba-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.982184 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.982156 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.982334 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.982299 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.994868 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.994831 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsgwc\" (UniqueName: \"kubernetes.io/projected/cec55c52-727e-4062-a3a7-aa573d9cdfba-kube-api-access-fsgwc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:22.994999 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:22.994868 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cec55c52-727e-4062-a3a7-aa573d9cdfba-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g6rgm\" (UID: \"cec55c52-727e-4062-a3a7-aa573d9cdfba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:23.097256 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:23.097213 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:24.218279 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:07:24.218247 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec55c52_727e_4062_a3a7_aa573d9cdfba.slice/crio-41b59f4ff04d7d25afeb73cd29ee6350cea5e399e38753d826ba7133ea16c645 WatchSource:0}: Error finding container 41b59f4ff04d7d25afeb73cd29ee6350cea5e399e38753d826ba7133ea16c645: Status 404 returned error can't find the container with id 41b59f4ff04d7d25afeb73cd29ee6350cea5e399e38753d826ba7133ea16c645 Jul 21 17:07:24.219707 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:24.219680 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm"] Jul 21 17:07:24.717110 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:24.717071 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" event={"ID":"cec55c52-727e-4062-a3a7-aa573d9cdfba","Type":"ContainerStarted","Data":"41b59f4ff04d7d25afeb73cd29ee6350cea5e399e38753d826ba7133ea16c645"} Jul 21 17:07:24.718412 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:24.718381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" event={"ID":"0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b","Type":"ContainerStarted","Data":"3234b07f5f5a1794d8a85a4620c2a0b29d5726fbb8893f7e2a24a69b336527f9"} Jul 21 17:07:24.718562 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:24.718542 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:07:24.750151 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:24.750091 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" podStartSLOduration=1.7961337990000001 podStartE2EDuration="4.750072881s" totalImagesPullingTime="2.953939082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:24.749658766 +0000 UTC m=+346.176484873" watchObservedRunningTime="2026-07-21 17:07:24.750072881 +0000 UTC m=+346.176898974" Jul 21 17:07:25.011288 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.011198 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jq58n"] Jul 21 17:07:25.014681 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.014661 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" Jul 21 17:07:25.018073 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.018051 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8xqgb\"" Jul 21 17:07:25.018506 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.018491 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 21 17:07:25.031545 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.031501 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jq58n"] Jul 21 17:07:25.099629 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.099586 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwb9t\" (UniqueName: \"kubernetes.io/projected/65e9c902-08f4-4ead-b81e-f45df067c321-kube-api-access-gwb9t\") pod \"kserve-controller-manager-d6f4b65b8-jq58n\" (UID: \"65e9c902-08f4-4ead-b81e-f45df067c321\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" Jul 21 17:07:25.099807 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.099644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65e9c902-08f4-4ead-b81e-f45df067c321-cert\") pod \"kserve-controller-manager-d6f4b65b8-jq58n\" (UID: \"65e9c902-08f4-4ead-b81e-f45df067c321\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" Jul 21 17:07:25.200654 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.200606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwb9t\" (UniqueName: \"kubernetes.io/projected/65e9c902-08f4-4ead-b81e-f45df067c321-kube-api-access-gwb9t\") pod \"kserve-controller-manager-d6f4b65b8-jq58n\" (UID: \"65e9c902-08f4-4ead-b81e-f45df067c321\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" Jul 21 17:07:25.200860 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.200682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65e9c902-08f4-4ead-b81e-f45df067c321-cert\") pod \"kserve-controller-manager-d6f4b65b8-jq58n\" (UID: \"65e9c902-08f4-4ead-b81e-f45df067c321\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" Jul 21 17:07:25.203866 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.203834 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65e9c902-08f4-4ead-b81e-f45df067c321-cert\") pod \"kserve-controller-manager-d6f4b65b8-jq58n\" (UID: \"65e9c902-08f4-4ead-b81e-f45df067c321\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" Jul 21 17:07:25.211005 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.210971 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwb9t\" (UniqueName: \"kubernetes.io/projected/65e9c902-08f4-4ead-b81e-f45df067c321-kube-api-access-gwb9t\") pod \"kserve-controller-manager-d6f4b65b8-jq58n\" (UID: \"65e9c902-08f4-4ead-b81e-f45df067c321\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" Jul 21 17:07:25.325640 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.325556 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" Jul 21 17:07:25.580796 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.580753 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jq58n"] Jul 21 17:07:25.663108 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:07:25.663073 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e9c902_08f4_4ead_b81e_f45df067c321.slice/crio-4ad01858682e5386d3466660b9ab752592a9e566f4e33567964b7aa4d52848e0 WatchSource:0}: Error finding container 4ad01858682e5386d3466660b9ab752592a9e566f4e33567964b7aa4d52848e0: Status 404 returned error can't find the container with id 4ad01858682e5386d3466660b9ab752592a9e566f4e33567964b7aa4d52848e0 Jul 21 17:07:25.725424 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:25.725380 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" event={"ID":"65e9c902-08f4-4ead-b81e-f45df067c321","Type":"ContainerStarted","Data":"4ad01858682e5386d3466660b9ab752592a9e566f4e33567964b7aa4d52848e0"} Jul 21 17:07:27.111581 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:27.111536 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:07:27.111946 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:27.111622 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:07:27.111946 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:27.111688 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:07:27.737046 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:27.737000 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" event={"ID":"cec55c52-727e-4062-a3a7-aa573d9cdfba","Type":"ContainerStarted","Data":"d96073c27fc38f285a2f98066bfd8a1704ba06e26dfb54748a76231f27697e85"} Jul 21 17:07:28.098050 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:28.098010 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:28.102806 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:28.102782 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:28.237438 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:28.237379 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" podStartSLOduration=3.346583704 podStartE2EDuration="6.237361684s" totalImagesPullingTime="2.89077798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:27.904568132 +0000 UTC m=+349.331394225" watchObservedRunningTime="2026-07-21 17:07:28.237361684 +0000 UTC m=+349.664187776" Jul 21 17:07:28.743115 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:28.743075 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:28.744398 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:28.744372 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g6rgm" Jul 21 17:07:29.748787 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:29.748745 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" event={"ID":"65e9c902-08f4-4ead-b81e-f45df067c321","Type":"ContainerStarted","Data":"3524a238cb9f338a5f744dd430622cedee4a76cae711e7a5c08b25298250ce32"} Jul 21 17:07:29.749175 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:29.748969 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" Jul 21 17:07:29.771488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:29.771433 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" podStartSLOduration=2.172340977 podStartE2EDuration="5.771415195s" totalImagesPullingTime="3.599074218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:29.770828082 +0000 UTC m=+351.197654176" watchObservedRunningTime="2026-07-21 17:07:29.771415195 +0000 UTC m=+351.198241288" Jul 21 17:07:35.727450 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:07:35.727363 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f64fdf99-tj2l2" Jul 21 17:08:00.758979 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:00.758949 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jq58n" Jul 21 17:08:58.329649 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.329611 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx"] Jul 21 17:08:58.333063 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.333041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx" Jul 21 17:08:58.336014 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.335989 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 21 17:08:58.336014 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.335991 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 17:08:58.336195 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.336036 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tzsr7\"" Jul 21 17:08:58.336571 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.336508 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 17:08:58.344084 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.344061 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx"] Jul 21 17:08:58.412043 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.411980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxmk\" (UniqueName: \"kubernetes.io/projected/23346d36-2921-49eb-858c-23fcf7030df4-kube-api-access-kzxmk\") pod \"dns-operator-controller-manager-864dd78c4c-wprcx\" (UID: \"23346d36-2921-49eb-858c-23fcf7030df4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx" Jul 21 17:08:58.512719 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.512677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxmk\" (UniqueName: \"kubernetes.io/projected/23346d36-2921-49eb-858c-23fcf7030df4-kube-api-access-kzxmk\") pod \"dns-operator-controller-manager-864dd78c4c-wprcx\" (UID: \"23346d36-2921-49eb-858c-23fcf7030df4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx" Jul 21 17:08:58.529203 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.529167 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxmk\" (UniqueName: \"kubernetes.io/projected/23346d36-2921-49eb-858c-23fcf7030df4-kube-api-access-kzxmk\") pod \"dns-operator-controller-manager-864dd78c4c-wprcx\" (UID: \"23346d36-2921-49eb-858c-23fcf7030df4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx" Jul 21 17:08:58.644038 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.643942 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx" Jul 21 17:08:58.798065 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:58.798033 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx"] Jul 21 17:08:58.801427 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:08:58.801397 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23346d36_2921_49eb_858c_23fcf7030df4.slice/crio-0f922740be2dfedbef1f7eed55ee77155b430c00f078c24ffd6f23278b134866 WatchSource:0}: Error finding container 0f922740be2dfedbef1f7eed55ee77155b430c00f078c24ffd6f23278b134866: Status 404 returned error can't find the container with id 0f922740be2dfedbef1f7eed55ee77155b430c00f078c24ffd6f23278b134866 Jul 21 17:08:59.158230 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:08:59.158192 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx" event={"ID":"23346d36-2921-49eb-858c-23fcf7030df4","Type":"ContainerStarted","Data":"0f922740be2dfedbef1f7eed55ee77155b430c00f078c24ffd6f23278b134866"} Jul 21 17:09:02.172580 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:02.172498 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx" event={"ID":"23346d36-2921-49eb-858c-23fcf7030df4","Type":"ContainerStarted","Data":"c5e8b6f4e9ac72862aaa6ae0383b4d76199d4b7d0e4f3454964b7f017f172bfb"} Jul 21 17:09:02.173034 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:02.172618 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx" Jul 21 17:09:02.211309 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:02.211256 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx" podStartSLOduration=1.8789429 podStartE2EDuration="4.211238537s" totalImagesPullingTime="2.332295637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:02.209396971 +0000 UTC m=+443.636223053" watchObservedRunningTime="2026-07-21 17:09:02.211238537 +0000 UTC m=+443.638064630" Jul 21 17:09:13.179317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:13.179282 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wprcx" Jul 21 17:09:15.437635 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.437598 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9"] Jul 21 17:09:15.440999 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.440980 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:15.444326 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.444301 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bc4hz\"" Jul 21 17:09:15.453581 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.453553 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9"] Jul 21 17:09:15.564737 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.564689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj786\" (UniqueName: \"kubernetes.io/projected/54f05a9f-0a6c-4385-af96-a8c1b86087c7-kube-api-access-nj786\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" (UID: \"54f05a9f-0a6c-4385-af96-a8c1b86087c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:15.564737 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.564743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f05a9f-0a6c-4385-af96-a8c1b86087c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" (UID: \"54f05a9f-0a6c-4385-af96-a8c1b86087c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:15.665983 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.665940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj786\" (UniqueName: \"kubernetes.io/projected/54f05a9f-0a6c-4385-af96-a8c1b86087c7-kube-api-access-nj786\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" (UID: \"54f05a9f-0a6c-4385-af96-a8c1b86087c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:15.665983 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.665986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f05a9f-0a6c-4385-af96-a8c1b86087c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" (UID: \"54f05a9f-0a6c-4385-af96-a8c1b86087c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:15.666373 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.666354 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f05a9f-0a6c-4385-af96-a8c1b86087c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" (UID: \"54f05a9f-0a6c-4385-af96-a8c1b86087c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:15.679470 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.679434 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj786\" (UniqueName: \"kubernetes.io/projected/54f05a9f-0a6c-4385-af96-a8c1b86087c7-kube-api-access-nj786\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" (UID: \"54f05a9f-0a6c-4385-af96-a8c1b86087c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:15.751617 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.751491 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:15.902385 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:15.902355 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9"] Jul 21 17:09:15.904942 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:09:15.904900 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f05a9f_0a6c_4385_af96_a8c1b86087c7.slice/crio-8bcb646137ed1972458f2ed38aaff9365260755df11a7253f709ab15ee7135b0 WatchSource:0}: Error finding container 8bcb646137ed1972458f2ed38aaff9365260755df11a7253f709ab15ee7135b0: Status 404 returned error can't find the container with id 8bcb646137ed1972458f2ed38aaff9365260755df11a7253f709ab15ee7135b0 Jul 21 17:09:16.091917 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.091877 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9"] Jul 21 17:09:16.097634 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.097605 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9"] Jul 21 17:09:16.123495 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.123457 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g"] Jul 21 17:09:16.128055 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.128029 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:16.150372 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.150336 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g"] Jul 21 17:09:16.271894 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.271854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2b5f\" (UniqueName: \"kubernetes.io/projected/3082e860-5ce5-4b98-b68f-ed5499645fb1-kube-api-access-l2b5f\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m9z7g\" (UID: \"3082e860-5ce5-4b98-b68f-ed5499645fb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:16.272090 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.271919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3082e860-5ce5-4b98-b68f-ed5499645fb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m9z7g\" (UID: \"3082e860-5ce5-4b98-b68f-ed5499645fb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:16.372878 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.372793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2b5f\" (UniqueName: \"kubernetes.io/projected/3082e860-5ce5-4b98-b68f-ed5499645fb1-kube-api-access-l2b5f\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m9z7g\" (UID: \"3082e860-5ce5-4b98-b68f-ed5499645fb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:16.372878 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.372850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3082e860-5ce5-4b98-b68f-ed5499645fb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m9z7g\" (UID: \"3082e860-5ce5-4b98-b68f-ed5499645fb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:16.373221 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.373202 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3082e860-5ce5-4b98-b68f-ed5499645fb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m9z7g\" (UID: \"3082e860-5ce5-4b98-b68f-ed5499645fb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:16.387441 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.387408 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2b5f\" (UniqueName: \"kubernetes.io/projected/3082e860-5ce5-4b98-b68f-ed5499645fb1-kube-api-access-l2b5f\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-m9z7g\" (UID: \"3082e860-5ce5-4b98-b68f-ed5499645fb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:16.439435 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.439400 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:16.606898 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:16.606860 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g"] Jul 21 17:09:16.690598 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:09:16.690503 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3082e860_5ce5_4b98_b68f_ed5499645fb1.slice/crio-9b29b7ea006432e5af8964db18508774b19bcdf7e3089d9cdb158cc4342f447d WatchSource:0}: Error finding container 9b29b7ea006432e5af8964db18508774b19bcdf7e3089d9cdb158cc4342f447d: Status 404 returned error can't find the container with id 9b29b7ea006432e5af8964db18508774b19bcdf7e3089d9cdb158cc4342f447d Jul 21 17:09:17.242325 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:17.242289 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" event={"ID":"3082e860-5ce5-4b98-b68f-ed5499645fb1","Type":"ContainerStarted","Data":"9b29b7ea006432e5af8964db18508774b19bcdf7e3089d9cdb158cc4342f447d"} Jul 21 17:09:21.265917 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.265873 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" podUID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" containerName="manager" containerID="cri-o://85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66" gracePeriod=2 Jul 21 17:09:21.267671 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.267645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" event={"ID":"3082e860-5ce5-4b98-b68f-ed5499645fb1","Type":"ContainerStarted","Data":"314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6"} Jul 21 17:09:21.267776 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.267708 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:21.269281 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:09:21.269249 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" is forbidden: User \"system:node:ip-10-0-136-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-64.ec2.internal' and this object" podUID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:21.292616 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:09:21.292578 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" is forbidden: User \"system:node:ip-10-0-136-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-64.ec2.internal' and this object" podUID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:21.293496 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.293454 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" podStartSLOduration=1.390411434 podStartE2EDuration="5.293438499s" totalImagesPullingTime="3.903027065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:21.290444828 +0000 UTC m=+462.717270922" watchObservedRunningTime="2026-07-21 17:09:21.293438499 +0000 UTC m=+462.720264592" Jul 21 17:09:21.507630 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.507604 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:21.509925 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:09:21.509898 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" is forbidden: User \"system:node:ip-10-0-136-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-64.ec2.internal' and this object" podUID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:21.617979 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.617936 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj786\" (UniqueName: \"kubernetes.io/projected/54f05a9f-0a6c-4385-af96-a8c1b86087c7-kube-api-access-nj786\") pod \"54f05a9f-0a6c-4385-af96-a8c1b86087c7\" (UID: \"54f05a9f-0a6c-4385-af96-a8c1b86087c7\") " Jul 21 17:09:21.618173 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.618039 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f05a9f-0a6c-4385-af96-a8c1b86087c7-extensions-socket-volume\") pod \"54f05a9f-0a6c-4385-af96-a8c1b86087c7\" (UID: \"54f05a9f-0a6c-4385-af96-a8c1b86087c7\") " Jul 21 17:09:21.618341 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.618314 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54f05a9f-0a6c-4385-af96-a8c1b86087c7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "54f05a9f-0a6c-4385-af96-a8c1b86087c7" (UID: "54f05a9f-0a6c-4385-af96-a8c1b86087c7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:09:21.620368 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.620327 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f05a9f-0a6c-4385-af96-a8c1b86087c7-kube-api-access-nj786" (OuterVolumeSpecName: "kube-api-access-nj786") pod "54f05a9f-0a6c-4385-af96-a8c1b86087c7" (UID: "54f05a9f-0a6c-4385-af96-a8c1b86087c7"). InnerVolumeSpecName "kube-api-access-nj786". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:09:21.719048 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.719005 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj786\" (UniqueName: \"kubernetes.io/projected/54f05a9f-0a6c-4385-af96-a8c1b86087c7-kube-api-access-nj786\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:09:21.719048 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:21.719042 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f05a9f-0a6c-4385-af96-a8c1b86087c7-extensions-socket-volume\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:09:22.273337 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:22.273301 2562 generic.go:356] "Generic (PLEG): container finished" podID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" containerID="85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66" exitCode=2 Jul 21 17:09:22.273824 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:22.273350 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:22.273824 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:22.273405 2562 scope.go:117] "RemoveContainer" containerID="85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66" Jul 21 17:09:22.276001 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:09:22.275971 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" is forbidden: User \"system:node:ip-10-0-136-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-64.ec2.internal' and this object" podUID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:22.282972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:22.282954 2562 scope.go:117] "RemoveContainer" containerID="85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66" Jul 21 17:09:22.283262 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:09:22.283242 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66\": container with ID starting with 85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66 not found: ID does not exist" containerID="85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66" Jul 21 17:09:22.283310 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:22.283275 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66"} err="failed to get container status \"85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66\": rpc error: code = NotFound desc = could not find container \"85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66\": container with ID starting with 85a4e21a05d447156da9aec457e1caad89ed62f4afb10432b701df0331fb3a66 not found: ID does not exist" Jul 21 17:09:22.283640 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:09:22.283621 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xmwn9\" is forbidden: User \"system:node:ip-10-0-136-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-64.ec2.internal' and this object" podUID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xmwn9" Jul 21 17:09:23.114803 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:23.114760 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" path="/var/lib/kubelet/pods/54f05a9f-0a6c-4385-af96-a8c1b86087c7/volumes" Jul 21 17:09:32.275850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:32.275814 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:44.679666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:44.679630 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g"] Jul 21 17:09:44.680136 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:44.679840 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" podUID="3082e860-5ce5-4b98-b68f-ed5499645fb1" containerName="manager" containerID="cri-o://314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6" gracePeriod=10 Jul 21 17:09:44.939467 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:44.939398 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:45.016733 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.016692 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3082e860-5ce5-4b98-b68f-ed5499645fb1-extensions-socket-volume\") pod \"3082e860-5ce5-4b98-b68f-ed5499645fb1\" (UID: \"3082e860-5ce5-4b98-b68f-ed5499645fb1\") " Jul 21 17:09:45.016935 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.016778 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2b5f\" (UniqueName: \"kubernetes.io/projected/3082e860-5ce5-4b98-b68f-ed5499645fb1-kube-api-access-l2b5f\") pod \"3082e860-5ce5-4b98-b68f-ed5499645fb1\" (UID: \"3082e860-5ce5-4b98-b68f-ed5499645fb1\") " Jul 21 17:09:45.017125 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.017095 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3082e860-5ce5-4b98-b68f-ed5499645fb1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3082e860-5ce5-4b98-b68f-ed5499645fb1" (UID: "3082e860-5ce5-4b98-b68f-ed5499645fb1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:09:45.019032 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.019000 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3082e860-5ce5-4b98-b68f-ed5499645fb1-kube-api-access-l2b5f" (OuterVolumeSpecName: "kube-api-access-l2b5f") pod "3082e860-5ce5-4b98-b68f-ed5499645fb1" (UID: "3082e860-5ce5-4b98-b68f-ed5499645fb1"). InnerVolumeSpecName "kube-api-access-l2b5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:09:45.117806 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.117769 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3082e860-5ce5-4b98-b68f-ed5499645fb1-extensions-socket-volume\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:09:45.117806 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.117804 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2b5f\" (UniqueName: \"kubernetes.io/projected/3082e860-5ce5-4b98-b68f-ed5499645fb1-kube-api-access-l2b5f\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:09:45.382916 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.382882 2562 generic.go:356] "Generic (PLEG): container finished" podID="3082e860-5ce5-4b98-b68f-ed5499645fb1" containerID="314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6" exitCode=0 Jul 21 17:09:45.383092 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.382931 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" Jul 21 17:09:45.383092 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.382970 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" event={"ID":"3082e860-5ce5-4b98-b68f-ed5499645fb1","Type":"ContainerDied","Data":"314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6"} Jul 21 17:09:45.383092 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.383026 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g" event={"ID":"3082e860-5ce5-4b98-b68f-ed5499645fb1","Type":"ContainerDied","Data":"9b29b7ea006432e5af8964db18508774b19bcdf7e3089d9cdb158cc4342f447d"} Jul 21 17:09:45.383092 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.383050 2562 scope.go:117] "RemoveContainer" containerID="314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6" Jul 21 17:09:45.391858 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.391837 2562 scope.go:117] "RemoveContainer" containerID="314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6" Jul 21 17:09:45.392146 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:09:45.392125 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6\": container with ID starting with 314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6 not found: ID does not exist" containerID="314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6" Jul 21 17:09:45.392197 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.392155 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6"} err="failed to get container status \"314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6\": rpc error: code = NotFound desc = could not find container \"314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6\": container with ID starting with 314e7026fe095dced7b102edb490dd439ef69f76093b8c98050ce91c3c817de6 not found: ID does not exist" Jul 21 17:09:45.407929 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.407896 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g"] Jul 21 17:09:45.418268 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:45.418238 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-m9z7g"] Jul 21 17:09:47.114473 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:47.114438 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3082e860-5ce5-4b98-b68f-ed5499645fb1" path="/var/lib/kubelet/pods/3082e860-5ce5-4b98-b68f-ed5499645fb1/volumes" Jul 21 17:09:48.724401 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.724363 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb"] Jul 21 17:09:48.724893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.724863 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" containerName="manager" Jul 21 17:09:48.724893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.724878 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" containerName="manager" Jul 21 17:09:48.725009 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.724915 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3082e860-5ce5-4b98-b68f-ed5499645fb1" containerName="manager" Jul 21 17:09:48.725009 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.724924 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3082e860-5ce5-4b98-b68f-ed5499645fb1" containerName="manager" Jul 21 17:09:48.725109 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.725016 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3082e860-5ce5-4b98-b68f-ed5499645fb1" containerName="manager" Jul 21 17:09:48.725109 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.725030 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="54f05a9f-0a6c-4385-af96-a8c1b86087c7" containerName="manager" Jul 21 17:09:48.729655 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.729631 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.732165 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.732141 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6l5dk\"" Jul 21 17:09:48.741477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.741447 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb"] Jul 21 17:09:48.852105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.852060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.852105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.852101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nn6r\" (UniqueName: \"kubernetes.io/projected/5731c75f-2ccd-41a4-8827-05a6e91f3354-kube-api-access-4nn6r\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.852382 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.852127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.852382 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.852150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.852382 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.852168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5731c75f-2ccd-41a4-8827-05a6e91f3354-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.852382 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.852248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.852382 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.852280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.852382 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.852307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.852382 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.852345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.953779 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.953733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5731c75f-2ccd-41a4-8827-05a6e91f3354-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.953988 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.953833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.953988 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.953872 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.953988 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.953930 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.954140 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.953988 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.954140 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.954052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.954140 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.954077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nn6r\" (UniqueName: \"kubernetes.io/projected/5731c75f-2ccd-41a4-8827-05a6e91f3354-kube-api-access-4nn6r\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.954140 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.954114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.954333 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.954146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.954439 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.954419 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.954560 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.954538 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5731c75f-2ccd-41a4-8827-05a6e91f3354-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.954674 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.954653 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.954733 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.954699 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.954786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.954742 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.957147 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.957121 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.957260 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.957187 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.964620 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.964506 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nn6r\" (UniqueName: \"kubernetes.io/projected/5731c75f-2ccd-41a4-8827-05a6e91f3354-kube-api-access-4nn6r\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:48.964773 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:48.964696 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5731c75f-2ccd-41a4-8827-05a6e91f3354-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-klnfb\" (UID: \"5731c75f-2ccd-41a4-8827-05a6e91f3354\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:49.041932 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:49.041880 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:49.196958 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:49.196875 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb"] Jul 21 17:09:49.199393 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:09:49.199355 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5731c75f_2ccd_41a4_8827_05a6e91f3354.slice/crio-6ee629bbec3875e48dbbda499c64b72222449bc5c0a7c2baafd2a4d2a321c013 WatchSource:0}: Error finding container 6ee629bbec3875e48dbbda499c64b72222449bc5c0a7c2baafd2a4d2a321c013: Status 404 returned error can't find the container with id 6ee629bbec3875e48dbbda499c64b72222449bc5c0a7c2baafd2a4d2a321c013 Jul 21 17:09:49.201470 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:49.201431 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:09:49.201624 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:49.201550 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:09:49.201624 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:49.201592 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:09:49.405286 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:49.405189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" event={"ID":"5731c75f-2ccd-41a4-8827-05a6e91f3354","Type":"ContainerStarted","Data":"fa11b07b3bc9bdbb65578d062c3922867411cae826068d7346ef474ba597e7e2"} Jul 21 17:09:49.405286 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:49.405249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" event={"ID":"5731c75f-2ccd-41a4-8827-05a6e91f3354","Type":"ContainerStarted","Data":"6ee629bbec3875e48dbbda499c64b72222449bc5c0a7c2baafd2a4d2a321c013"} Jul 21 17:09:49.430935 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:49.430879 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" podStartSLOduration=1.4308615900000001 podStartE2EDuration="1.43086159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:49.429402007 +0000 UTC m=+490.856228099" watchObservedRunningTime="2026-07-21 17:09:49.43086159 +0000 UTC m=+490.857687682" Jul 21 17:09:50.042929 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:50.042899 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:50.048401 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:50.048371 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:50.410154 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:50.410063 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:09:50.411118 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:09:50.411098 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:10:04.367745 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.367705 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9cz66"] Jul 21 17:10:04.370881 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.370861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:04.373492 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.373471 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 21 17:10:04.373611 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.373473 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kmzmg\"" Jul 21 17:10:04.379709 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.379682 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9cz66"] Jul 21 17:10:04.464080 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.464046 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9cz66"] Jul 21 17:10:04.490015 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.489984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ebea344-ffec-4383-8ee6-6ce19c3e2374-config-file\") pod \"limitador-limitador-64c94fd64f-9cz66\" (UID: \"4ebea344-ffec-4383-8ee6-6ce19c3e2374\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:04.490180 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.490027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nckcs\" (UniqueName: \"kubernetes.io/projected/4ebea344-ffec-4383-8ee6-6ce19c3e2374-kube-api-access-nckcs\") pod \"limitador-limitador-64c94fd64f-9cz66\" (UID: \"4ebea344-ffec-4383-8ee6-6ce19c3e2374\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:04.591346 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.591310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ebea344-ffec-4383-8ee6-6ce19c3e2374-config-file\") pod \"limitador-limitador-64c94fd64f-9cz66\" (UID: \"4ebea344-ffec-4383-8ee6-6ce19c3e2374\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:04.591577 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.591359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nckcs\" (UniqueName: \"kubernetes.io/projected/4ebea344-ffec-4383-8ee6-6ce19c3e2374-kube-api-access-nckcs\") pod \"limitador-limitador-64c94fd64f-9cz66\" (UID: \"4ebea344-ffec-4383-8ee6-6ce19c3e2374\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:04.592039 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.592011 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ebea344-ffec-4383-8ee6-6ce19c3e2374-config-file\") pod \"limitador-limitador-64c94fd64f-9cz66\" (UID: \"4ebea344-ffec-4383-8ee6-6ce19c3e2374\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:04.602580 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.602542 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nckcs\" (UniqueName: \"kubernetes.io/projected/4ebea344-ffec-4383-8ee6-6ce19c3e2374-kube-api-access-nckcs\") pod \"limitador-limitador-64c94fd64f-9cz66\" (UID: \"4ebea344-ffec-4383-8ee6-6ce19c3e2374\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:04.683826 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.683726 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:04.840389 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:04.840362 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9cz66"] Jul 21 17:10:04.842437 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:10:04.842407 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebea344_ffec_4383_8ee6_6ce19c3e2374.slice/crio-cbdc3fbb670468ba1fcdd68bcb382ba0ac82f5e706e258c7e472cf1159fe78bb WatchSource:0}: Error finding container cbdc3fbb670468ba1fcdd68bcb382ba0ac82f5e706e258c7e472cf1159fe78bb: Status 404 returned error can't find the container with id cbdc3fbb670468ba1fcdd68bcb382ba0ac82f5e706e258c7e472cf1159fe78bb Jul 21 17:10:05.484736 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:05.484702 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" event={"ID":"4ebea344-ffec-4383-8ee6-6ce19c3e2374","Type":"ContainerStarted","Data":"cbdc3fbb670468ba1fcdd68bcb382ba0ac82f5e706e258c7e472cf1159fe78bb"} Jul 21 17:10:08.503104 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:08.503059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" event={"ID":"4ebea344-ffec-4383-8ee6-6ce19c3e2374","Type":"ContainerStarted","Data":"672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac"} Jul 21 17:10:08.503508 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:08.503152 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:08.527771 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:08.527719 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" podStartSLOduration=1.6719743729999998 podStartE2EDuration="4.527703929s" totalImagesPullingTime="2.855729556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:10:08.526039841 +0000 UTC m=+509.952865934" watchObservedRunningTime="2026-07-21 17:10:08.527703929 +0000 UTC m=+509.954530055" Jul 21 17:10:19.509969 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:19.509942 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:21.452432 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:21.452393 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9cz66"] Jul 21 17:10:21.452872 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:21.452619 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" podUID="4ebea344-ffec-4383-8ee6-6ce19c3e2374" containerName="limitador" containerID="cri-o://672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac" gracePeriod=30 Jul 21 17:10:22.011466 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.011394 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:22.049481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.049449 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ebea344-ffec-4383-8ee6-6ce19c3e2374-config-file\") pod \"4ebea344-ffec-4383-8ee6-6ce19c3e2374\" (UID: \"4ebea344-ffec-4383-8ee6-6ce19c3e2374\") " Jul 21 17:10:22.049675 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.049586 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nckcs\" (UniqueName: \"kubernetes.io/projected/4ebea344-ffec-4383-8ee6-6ce19c3e2374-kube-api-access-nckcs\") pod \"4ebea344-ffec-4383-8ee6-6ce19c3e2374\" (UID: \"4ebea344-ffec-4383-8ee6-6ce19c3e2374\") " Jul 21 17:10:22.049864 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.049839 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ebea344-ffec-4383-8ee6-6ce19c3e2374-config-file" (OuterVolumeSpecName: "config-file") pod "4ebea344-ffec-4383-8ee6-6ce19c3e2374" (UID: "4ebea344-ffec-4383-8ee6-6ce19c3e2374"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:10:22.051797 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.051769 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ebea344-ffec-4383-8ee6-6ce19c3e2374-kube-api-access-nckcs" (OuterVolumeSpecName: "kube-api-access-nckcs") pod "4ebea344-ffec-4383-8ee6-6ce19c3e2374" (UID: "4ebea344-ffec-4383-8ee6-6ce19c3e2374"). InnerVolumeSpecName "kube-api-access-nckcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:10:22.150964 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.150923 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nckcs\" (UniqueName: \"kubernetes.io/projected/4ebea344-ffec-4383-8ee6-6ce19c3e2374-kube-api-access-nckcs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:10:22.150964 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.150956 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4ebea344-ffec-4383-8ee6-6ce19c3e2374-config-file\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:10:22.568757 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.568717 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ebea344-ffec-4383-8ee6-6ce19c3e2374" containerID="672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac" exitCode=0 Jul 21 17:10:22.569246 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.568766 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" Jul 21 17:10:22.569246 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.568771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" event={"ID":"4ebea344-ffec-4383-8ee6-6ce19c3e2374","Type":"ContainerDied","Data":"672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac"} Jul 21 17:10:22.569246 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.568831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9cz66" event={"ID":"4ebea344-ffec-4383-8ee6-6ce19c3e2374","Type":"ContainerDied","Data":"cbdc3fbb670468ba1fcdd68bcb382ba0ac82f5e706e258c7e472cf1159fe78bb"} Jul 21 17:10:22.569246 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.568860 2562 scope.go:117] "RemoveContainer" containerID="672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac" Jul 21 17:10:22.578504 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.578483 2562 scope.go:117] "RemoveContainer" containerID="672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac" Jul 21 17:10:22.578806 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:10:22.578788 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac\": container with ID starting with 672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac not found: ID does not exist" containerID="672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac" Jul 21 17:10:22.578881 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.578816 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac"} err="failed to get container status \"672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac\": rpc error: code = NotFound desc = could not find container \"672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac\": container with ID starting with 672efef6d58e83b82387c4d981e037754c5ca57d5a073d9b8950cca5debfd8ac not found: ID does not exist" Jul 21 17:10:22.592318 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.592275 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9cz66"] Jul 21 17:10:22.597408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:22.597384 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9cz66"] Jul 21 17:10:23.114585 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:23.114550 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ebea344-ffec-4383-8ee6-6ce19c3e2374" path="/var/lib/kubelet/pods/4ebea344-ffec-4383-8ee6-6ce19c3e2374/volumes" Jul 21 17:10:27.502048 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.502013 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5"] Jul 21 17:10:27.502427 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.502390 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ebea344-ffec-4383-8ee6-6ce19c3e2374" containerName="limitador" Jul 21 17:10:27.502427 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.502409 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ebea344-ffec-4383-8ee6-6ce19c3e2374" containerName="limitador" Jul 21 17:10:27.502547 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.502534 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ebea344-ffec-4383-8ee6-6ce19c3e2374" containerName="limitador" Jul 21 17:10:27.506860 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.506838 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" Jul 21 17:10:27.509650 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.509618 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 21 17:10:27.509650 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.509648 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 17:10:27.509835 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.509681 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 21 17:10:27.510893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.510877 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rq7gf\"" Jul 21 17:10:27.515282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.515259 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5"] Jul 21 17:10:27.598189 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.598157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64jxf\" (UniqueName: \"kubernetes.io/projected/8ba09a88-a40f-43fa-aaab-549dca89f710-kube-api-access-64jxf\") pod \"postgres-69fb4594cf-9mcx5\" (UID: \"8ba09a88-a40f-43fa-aaab-549dca89f710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" Jul 21 17:10:27.598395 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.598206 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8ba09a88-a40f-43fa-aaab-549dca89f710-data\") pod \"postgres-69fb4594cf-9mcx5\" (UID: \"8ba09a88-a40f-43fa-aaab-549dca89f710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" Jul 21 17:10:27.699198 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.699139 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64jxf\" (UniqueName: \"kubernetes.io/projected/8ba09a88-a40f-43fa-aaab-549dca89f710-kube-api-access-64jxf\") pod \"postgres-69fb4594cf-9mcx5\" (UID: \"8ba09a88-a40f-43fa-aaab-549dca89f710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" Jul 21 17:10:27.699198 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.699205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8ba09a88-a40f-43fa-aaab-549dca89f710-data\") pod \"postgres-69fb4594cf-9mcx5\" (UID: \"8ba09a88-a40f-43fa-aaab-549dca89f710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" Jul 21 17:10:27.699650 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.699630 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8ba09a88-a40f-43fa-aaab-549dca89f710-data\") pod \"postgres-69fb4594cf-9mcx5\" (UID: \"8ba09a88-a40f-43fa-aaab-549dca89f710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" Jul 21 17:10:27.710421 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.710399 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64jxf\" (UniqueName: \"kubernetes.io/projected/8ba09a88-a40f-43fa-aaab-549dca89f710-kube-api-access-64jxf\") pod \"postgres-69fb4594cf-9mcx5\" (UID: \"8ba09a88-a40f-43fa-aaab-549dca89f710\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" Jul 21 17:10:27.819318 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.819281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" Jul 21 17:10:27.966444 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:27.966379 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5"] Jul 21 17:10:27.970283 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:10:27.970246 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba09a88_a40f_43fa_aaab_549dca89f710.slice/crio-fabcda0b63e7e669f0f390ced55a67501bcfc9abb808bfb8bdd3d8d39ac470ec WatchSource:0}: Error finding container fabcda0b63e7e669f0f390ced55a67501bcfc9abb808bfb8bdd3d8d39ac470ec: Status 404 returned error can't find the container with id fabcda0b63e7e669f0f390ced55a67501bcfc9abb808bfb8bdd3d8d39ac470ec Jul 21 17:10:28.606787 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:28.606754 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" event={"ID":"8ba09a88-a40f-43fa-aaab-549dca89f710","Type":"ContainerStarted","Data":"fabcda0b63e7e669f0f390ced55a67501bcfc9abb808bfb8bdd3d8d39ac470ec"} Jul 21 17:10:33.638913 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:33.638871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" event={"ID":"8ba09a88-a40f-43fa-aaab-549dca89f710","Type":"ContainerStarted","Data":"658fc9b4b11e83bf0aa3a5e7ebb18444b6ee801254fcd3622e94fb7e1e388395"} Jul 21 17:10:33.639323 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:33.639004 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" Jul 21 17:10:33.660288 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:33.660238 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" podStartSLOduration=1.7882642720000002 podStartE2EDuration="6.660223002s" totalImagesPullingTime="4.87195873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:10:33.658505593 +0000 UTC m=+535.085331692" watchObservedRunningTime="2026-07-21 17:10:33.660223002 +0000 UTC m=+535.087049095" Jul 21 17:10:39.674861 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:39.674832 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9mcx5" Jul 21 17:10:46.724491 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.724453 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68d5cf45d-7v27q"] Jul 21 17:10:46.731713 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.731692 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:10:46.735047 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.735025 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rk7d7\"" Jul 21 17:10:46.736138 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.736118 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 21 17:10:46.741938 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.741909 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d5cf45d-7v27q"] Jul 21 17:10:46.745971 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.745947 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 21 17:10:46.881957 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.881911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f102ad9f-9024-426a-b36a-052d330a422b-webhook-cert\") pod \"maas-controller-68d5cf45d-7v27q\" (UID: \"f102ad9f-9024-426a-b36a-052d330a422b\") " pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:10:46.882124 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.881978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx4ds\" (UniqueName: \"kubernetes.io/projected/f102ad9f-9024-426a-b36a-052d330a422b-kube-api-access-wx4ds\") pod \"maas-controller-68d5cf45d-7v27q\" (UID: \"f102ad9f-9024-426a-b36a-052d330a422b\") " pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:10:46.983412 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.983323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f102ad9f-9024-426a-b36a-052d330a422b-webhook-cert\") pod \"maas-controller-68d5cf45d-7v27q\" (UID: \"f102ad9f-9024-426a-b36a-052d330a422b\") " pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:10:46.983412 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.983387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx4ds\" (UniqueName: \"kubernetes.io/projected/f102ad9f-9024-426a-b36a-052d330a422b-kube-api-access-wx4ds\") pod \"maas-controller-68d5cf45d-7v27q\" (UID: \"f102ad9f-9024-426a-b36a-052d330a422b\") " pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:10:46.986002 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.985972 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f102ad9f-9024-426a-b36a-052d330a422b-webhook-cert\") pod \"maas-controller-68d5cf45d-7v27q\" (UID: \"f102ad9f-9024-426a-b36a-052d330a422b\") " pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:10:46.994491 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:46.994467 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx4ds\" (UniqueName: \"kubernetes.io/projected/f102ad9f-9024-426a-b36a-052d330a422b-kube-api-access-wx4ds\") pod \"maas-controller-68d5cf45d-7v27q\" (UID: \"f102ad9f-9024-426a-b36a-052d330a422b\") " pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:10:47.043129 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:47.043077 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:10:47.193037 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:47.193008 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d5cf45d-7v27q"] Jul 21 17:10:47.195621 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:10:47.195586 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf102ad9f_9024_426a_b36a_052d330a422b.slice/crio-4427be3fdea48323f55b456a63fd43b25eaca6888d44901bf15793cb9bfc072f WatchSource:0}: Error finding container 4427be3fdea48323f55b456a63fd43b25eaca6888d44901bf15793cb9bfc072f: Status 404 returned error can't find the container with id 4427be3fdea48323f55b456a63fd43b25eaca6888d44901bf15793cb9bfc072f Jul 21 17:10:47.709187 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:47.709145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d5cf45d-7v27q" event={"ID":"f102ad9f-9024-426a-b36a-052d330a422b","Type":"ContainerStarted","Data":"4427be3fdea48323f55b456a63fd43b25eaca6888d44901bf15793cb9bfc072f"} Jul 21 17:10:49.722629 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:49.722499 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d5cf45d-7v27q" event={"ID":"f102ad9f-9024-426a-b36a-052d330a422b","Type":"ContainerStarted","Data":"b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478"} Jul 21 17:10:49.722989 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:49.722657 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:10:49.748246 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:10:49.748180 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68d5cf45d-7v27q" podStartSLOduration=1.52709998 podStartE2EDuration="3.748158758s" totalImagesPullingTime="2.221058778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:10:49.746434549 +0000 UTC m=+551.173260643" watchObservedRunningTime="2026-07-21 17:10:49.748158758 +0000 UTC m=+551.174984854" Jul 21 17:11:00.729694 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:00.729654 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:11:21.415399 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.415361 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5d974694cd-2l295"] Jul 21 17:11:21.439277 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.439237 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d974694cd-2l295"] Jul 21 17:11:21.439438 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.439337 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:21.442118 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.442093 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 21 17:11:21.442857 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.442838 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tph4c\"" Jul 21 17:11:21.506143 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.506107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88js\" (UniqueName: \"kubernetes.io/projected/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-kube-api-access-d88js\") pod \"maas-api-5d974694cd-2l295\" (UID: \"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee\") " pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:21.506328 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.506167 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-maas-api-tls\") pod \"maas-api-5d974694cd-2l295\" (UID: \"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee\") " pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:21.506328 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.506261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-openshift-service-ca\") pod \"maas-api-5d974694cd-2l295\" (UID: \"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee\") " pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:21.607429 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.607393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d88js\" (UniqueName: \"kubernetes.io/projected/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-kube-api-access-d88js\") pod \"maas-api-5d974694cd-2l295\" (UID: \"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee\") " pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:21.607621 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.607453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-maas-api-tls\") pod \"maas-api-5d974694cd-2l295\" (UID: \"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee\") " pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:21.607621 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.607494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-openshift-service-ca\") pod \"maas-api-5d974694cd-2l295\" (UID: \"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee\") " pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:21.607693 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:11:21.607640 2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 21 17:11:21.607726 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:11:21.607720 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-maas-api-tls podName:7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee nodeName:}" failed. No retries permitted until 2026-07-21 17:11:22.10770073 +0000 UTC m=+583.534526820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-maas-api-tls") pod "maas-api-5d974694cd-2l295" (UID: "7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee") : secret "maas-api-serving-cert" not found Jul 21 17:11:21.608194 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.608176 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-openshift-service-ca\") pod \"maas-api-5d974694cd-2l295\" (UID: \"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee\") " pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:21.617081 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:21.617058 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88js\" (UniqueName: \"kubernetes.io/projected/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-kube-api-access-d88js\") pod \"maas-api-5d974694cd-2l295\" (UID: \"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee\") " pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:22.092372 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.092330 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-v4dsr"] Jul 21 17:11:22.098748 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.098720 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" Jul 21 17:11:22.101355 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.101335 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 21 17:11:22.110411 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.110383 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-v4dsr"] Jul 21 17:11:22.111730 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.111702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-maas-api-tls\") pod \"maas-api-5d974694cd-2l295\" (UID: \"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee\") " pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:22.114968 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.114942 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee-maas-api-tls\") pod \"maas-api-5d974694cd-2l295\" (UID: \"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee\") " pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:22.212618 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.212575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b8cac7-d482-40aa-bbf2-a34e4bf184eb-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-v4dsr\" (UID: \"d3b8cac7-d482-40aa-bbf2-a34e4bf184eb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" Jul 21 17:11:22.212836 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.212699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvc4h\" (UniqueName: \"kubernetes.io/projected/d3b8cac7-d482-40aa-bbf2-a34e4bf184eb-kube-api-access-dvc4h\") pod \"payload-pre-processing-7677b774bb-v4dsr\" (UID: \"d3b8cac7-d482-40aa-bbf2-a34e4bf184eb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" Jul 21 17:11:22.313764 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.313727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvc4h\" (UniqueName: \"kubernetes.io/projected/d3b8cac7-d482-40aa-bbf2-a34e4bf184eb-kube-api-access-dvc4h\") pod \"payload-pre-processing-7677b774bb-v4dsr\" (UID: \"d3b8cac7-d482-40aa-bbf2-a34e4bf184eb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" Jul 21 17:11:22.313958 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.313792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b8cac7-d482-40aa-bbf2-a34e4bf184eb-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-v4dsr\" (UID: \"d3b8cac7-d482-40aa-bbf2-a34e4bf184eb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" Jul 21 17:11:22.314472 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.314451 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b8cac7-d482-40aa-bbf2-a34e4bf184eb-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-v4dsr\" (UID: \"d3b8cac7-d482-40aa-bbf2-a34e4bf184eb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" Jul 21 17:11:22.326610 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.326579 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvc4h\" (UniqueName: \"kubernetes.io/projected/d3b8cac7-d482-40aa-bbf2-a34e4bf184eb-kube-api-access-dvc4h\") pod \"payload-pre-processing-7677b774bb-v4dsr\" (UID: \"d3b8cac7-d482-40aa-bbf2-a34e4bf184eb\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" Jul 21 17:11:22.351468 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.351388 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:22.411032 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.410999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" Jul 21 17:11:22.509469 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.509352 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d974694cd-2l295"] Jul 21 17:11:22.511467 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:11:22.511422 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7742a32e_b49c_4ed2_89bc_4c6cb1f6a5ee.slice/crio-47b9983ea509f312d1dcb680b244ec0a627bbf8fbfac1b2ac7771ec67de99936 WatchSource:0}: Error finding container 47b9983ea509f312d1dcb680b244ec0a627bbf8fbfac1b2ac7771ec67de99936: Status 404 returned error can't find the container with id 47b9983ea509f312d1dcb680b244ec0a627bbf8fbfac1b2ac7771ec67de99936 Jul 21 17:11:22.570359 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.570333 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-v4dsr"] Jul 21 17:11:22.572795 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:11:22.572755 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b8cac7_d482_40aa_bbf2_a34e4bf184eb.slice/crio-ae2db3dc25b6399401abf132e534deb1a02411f3b7ae01333b1515c061477a65 WatchSource:0}: Error finding container ae2db3dc25b6399401abf132e534deb1a02411f3b7ae01333b1515c061477a65: Status 404 returned error can't find the container with id ae2db3dc25b6399401abf132e534deb1a02411f3b7ae01333b1515c061477a65 Jul 21 17:11:22.880058 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.880020 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" event={"ID":"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee","Type":"ContainerStarted","Data":"47b9983ea509f312d1dcb680b244ec0a627bbf8fbfac1b2ac7771ec67de99936"} Jul 21 17:11:22.881295 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:22.881264 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" event={"ID":"d3b8cac7-d482-40aa-bbf2-a34e4bf184eb","Type":"ContainerStarted","Data":"ae2db3dc25b6399401abf132e534deb1a02411f3b7ae01333b1515c061477a65"} Jul 21 17:11:26.907414 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:26.907311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" event={"ID":"7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee","Type":"ContainerStarted","Data":"c05a94a429d1d7b7af7b0a06adbcf7f91a7f6d8ed96a8da6a4136b0fbf44053d"} Jul 21 17:11:26.907825 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:26.907564 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:26.909135 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:26.909101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" event={"ID":"d3b8cac7-d482-40aa-bbf2-a34e4bf184eb","Type":"ContainerStarted","Data":"ef7e2ec5ae84e7f2f5e5aa199a8a3cec973771029e4b8f3b9a86f334b5f0ebcc"} Jul 21 17:11:26.909259 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:26.909204 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" Jul 21 17:11:26.927377 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:26.927320 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" podStartSLOduration=2.239306859 podStartE2EDuration="5.927304737s" totalImagesPullingTime="3.687997878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:11:26.926978829 +0000 UTC m=+588.353804923" watchObservedRunningTime="2026-07-21 17:11:26.927304737 +0000 UTC m=+588.354130829" Jul 21 17:11:26.945256 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:26.945187 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" podStartSLOduration=1.318746293 podStartE2EDuration="4.945163935s" totalImagesPullingTime="3.626417642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:11:26.94362447 +0000 UTC m=+588.370450565" watchObservedRunningTime="2026-07-21 17:11:26.945163935 +0000 UTC m=+588.371990029" Jul 21 17:11:30.931536 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:30.931485 2562 generic.go:356] "Generic (PLEG): container finished" podID="5731c75f-2ccd-41a4-8827-05a6e91f3354" containerID="fa11b07b3bc9bdbb65578d062c3922867411cae826068d7346ef474ba597e7e2" exitCode=0 Jul 21 17:11:30.931939 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:30.931560 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" event={"ID":"5731c75f-2ccd-41a4-8827-05a6e91f3354","Type":"ContainerDied","Data":"fa11b07b3bc9bdbb65578d062c3922867411cae826068d7346ef474ba597e7e2"} Jul 21 17:11:30.931939 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:30.931929 2562 scope.go:117] "RemoveContainer" containerID="fa11b07b3bc9bdbb65578d062c3922867411cae826068d7346ef474ba597e7e2" Jul 21 17:11:30.932953 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:30.932920 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:11:30.933023 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:30.933000 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:11:30.933064 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:30.933039 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:11:31.938228 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:31.938189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" event={"ID":"5731c75f-2ccd-41a4-8827-05a6e91f3354","Type":"ContainerStarted","Data":"a4da35687c7f0ecc29e986721e34d3cc9a5938ffa25ed35acd73496f6eef6b8a"} Jul 21 17:11:32.042417 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:32.042379 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:11:32.043409 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:32.043382 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-klnfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 21 17:11:32.043554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:32.043435 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" podUID="5731c75f-2ccd-41a4-8827-05a6e91f3354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 21 17:11:32.921471 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:32.921438 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5d974694cd-2l295" Jul 21 17:11:33.042264 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:33.042225 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-klnfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 21 17:11:33.042658 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:33.042290 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" podUID="5731c75f-2ccd-41a4-8827-05a6e91f3354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 21 17:11:34.042695 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:34.042662 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-klnfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 21 17:11:34.043121 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:34.042717 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" podUID="5731c75f-2ccd-41a4-8827-05a6e91f3354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 21 17:11:35.042407 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:35.042371 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-klnfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 21 17:11:35.042595 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:35.042462 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" podUID="5731c75f-2ccd-41a4-8827-05a6e91f3354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 21 17:11:35.411010 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:35.410919 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:11:36.047000 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:36.046970 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:11:36.048251 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:36.048226 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-klnfb" Jul 21 17:11:37.917933 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:37.917903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-v4dsr" Jul 21 17:11:39.034984 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:39.034958 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:11:39.042105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:39.042073 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:11:50.642175 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.642133 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv"] Jul 21 17:11:50.646055 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.646029 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.648801 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.648774 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 21 17:11:50.649980 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.649947 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-k6wdl\"" Jul 21 17:11:50.650106 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.650003 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 21 17:11:50.650106 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.650017 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 21 17:11:50.658341 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.658309 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv"] Jul 21 17:11:50.706702 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.706668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.706702 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.706703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.706897 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.706733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfvqk\" (UniqueName: \"kubernetes.io/projected/bfa35b30-ab25-4d9f-9798-050e99644dd6-kube-api-access-lfvqk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.706897 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.706773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa35b30-ab25-4d9f-9798-050e99644dd6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.706897 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.706810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.706897 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.706833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.807653 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.807612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.807832 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.807691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.807832 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.807717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.807832 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.807756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfvqk\" (UniqueName: \"kubernetes.io/projected/bfa35b30-ab25-4d9f-9798-050e99644dd6-kube-api-access-lfvqk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.807977 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.807898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa35b30-ab25-4d9f-9798-050e99644dd6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.808033 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.808003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.808086 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.808072 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.808183 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.808157 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.808344 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.808322 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.810151 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.810126 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfa35b30-ab25-4d9f-9798-050e99644dd6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.810719 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.810703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa35b30-ab25-4d9f-9798-050e99644dd6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.817274 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.817253 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfvqk\" (UniqueName: \"kubernetes.io/projected/bfa35b30-ab25-4d9f-9798-050e99644dd6-kube-api-access-lfvqk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv\" (UID: \"bfa35b30-ab25-4d9f-9798-050e99644dd6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:50.961118 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:50.961023 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:11:51.112975 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:11:51.112946 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa35b30_ab25_4d9f_9798_050e99644dd6.slice/crio-528f6698bd2a5ee4c52c8326b97f970e9e9c11705eb05f3572aa55b15a371519 WatchSource:0}: Error finding container 528f6698bd2a5ee4c52c8326b97f970e9e9c11705eb05f3572aa55b15a371519: Status 404 returned error can't find the container with id 528f6698bd2a5ee4c52c8326b97f970e9e9c11705eb05f3572aa55b15a371519 Jul 21 17:11:51.114898 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:51.114876 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv"] Jul 21 17:11:52.040585 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:52.040545 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" event={"ID":"bfa35b30-ab25-4d9f-9798-050e99644dd6","Type":"ContainerStarted","Data":"528f6698bd2a5ee4c52c8326b97f970e9e9c11705eb05f3572aa55b15a371519"} Jul 21 17:11:53.046987 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:53.046941 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" event={"ID":"bfa35b30-ab25-4d9f-9798-050e99644dd6","Type":"ContainerStarted","Data":"465903c71b01d93205ef465b381f39aa006c09a09130965270f61712a94c16e6"} Jul 21 17:11:53.069556 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:11:53.069471 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" podStartSLOduration=1.958888312 podStartE2EDuration="3.06945267s" totalImagesPullingTime="1.110564358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:11:53.068249786 +0000 UTC m=+614.495075881" watchObservedRunningTime="2026-07-21 17:11:53.06945267 +0000 UTC m=+614.496278762" Jul 21 17:12:00.961581 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:00.961458 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:12:00.961933 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:00.961602 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:12:00.974348 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:00.974316 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:12:01.097192 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:01.097161 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv" Jul 21 17:12:04.728944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.728902 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk"] Jul 21 17:12:04.732592 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.732566 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.735433 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.735408 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 21 17:12:04.744109 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.744080 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk"] Jul 21 17:12:04.834288 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.834250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3258f759-baa1-434d-a3bf-cb62a07cd5d8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.834288 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.834305 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94fqt\" (UniqueName: \"kubernetes.io/projected/3258f759-baa1-434d-a3bf-cb62a07cd5d8-kube-api-access-94fqt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.834507 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.834339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.834507 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.834390 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.834507 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.834428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.834507 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.834454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.935544 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.935477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.935709 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.935555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.935709 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.935576 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.935709 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.935641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3258f759-baa1-434d-a3bf-cb62a07cd5d8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.935709 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.935677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94fqt\" (UniqueName: \"kubernetes.io/projected/3258f759-baa1-434d-a3bf-cb62a07cd5d8-kube-api-access-94fqt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.935905 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.935728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.935960 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.935935 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.936012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.935997 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.936072 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.936055 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.938212 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.938177 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3258f759-baa1-434d-a3bf-cb62a07cd5d8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.938336 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.938319 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3258f759-baa1-434d-a3bf-cb62a07cd5d8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:04.945481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:04.945452 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94fqt\" (UniqueName: \"kubernetes.io/projected/3258f759-baa1-434d-a3bf-cb62a07cd5d8-kube-api-access-94fqt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ng2pk\" (UID: \"3258f759-baa1-434d-a3bf-cb62a07cd5d8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:05.043745 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:05.043709 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:05.198765 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:05.198736 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk"] Jul 21 17:12:05.201874 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:12:05.201847 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3258f759_baa1_434d_a3bf_cb62a07cd5d8.slice/crio-4a8d1b7dc5e81078c86a0becffafd70933d4cecd6bf52d1f3ff3754df44ef7a4 WatchSource:0}: Error finding container 4a8d1b7dc5e81078c86a0becffafd70933d4cecd6bf52d1f3ff3754df44ef7a4: Status 404 returned error can't find the container with id 4a8d1b7dc5e81078c86a0becffafd70933d4cecd6bf52d1f3ff3754df44ef7a4 Jul 21 17:12:05.203612 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:05.203589 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 17:12:06.114834 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:06.114797 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" event={"ID":"3258f759-baa1-434d-a3bf-cb62a07cd5d8","Type":"ContainerStarted","Data":"2d754e5227ff7134fc069bd3b6ea836bb5a51863d9efe38a27f82521b41affd8"} Jul 21 17:12:06.115330 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:06.114874 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" event={"ID":"3258f759-baa1-434d-a3bf-cb62a07cd5d8","Type":"ContainerStarted","Data":"4a8d1b7dc5e81078c86a0becffafd70933d4cecd6bf52d1f3ff3754df44ef7a4"} Jul 21 17:12:06.136534 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:06.136472 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" podStartSLOduration=1.955822765 podStartE2EDuration="2.13645344s" totalImagesPullingTime="180.630675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:12:06.134840143 +0000 UTC m=+627.561666237" watchObservedRunningTime="2026-07-21 17:12:06.13645344 +0000 UTC m=+627.563279593" Jul 21 17:12:15.044698 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:15.044659 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:15.045200 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:15.044738 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:15.057408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:15.057379 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:12:15.170456 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:12:15.170417 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ng2pk" Jul 21 17:14:34.725885 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:34.725846 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68d5cf45d-7v27q"] Jul 21 17:14:34.726402 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:34.726065 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-68d5cf45d-7v27q" podUID="f102ad9f-9024-426a-b36a-052d330a422b" containerName="manager" containerID="cri-o://b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478" gracePeriod=30 Jul 21 17:14:34.980827 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:34.980764 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:14:35.095769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.095729 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f102ad9f-9024-426a-b36a-052d330a422b-webhook-cert\") pod \"f102ad9f-9024-426a-b36a-052d330a422b\" (UID: \"f102ad9f-9024-426a-b36a-052d330a422b\") " Jul 21 17:14:35.095769 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.095772 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx4ds\" (UniqueName: \"kubernetes.io/projected/f102ad9f-9024-426a-b36a-052d330a422b-kube-api-access-wx4ds\") pod \"f102ad9f-9024-426a-b36a-052d330a422b\" (UID: \"f102ad9f-9024-426a-b36a-052d330a422b\") " Jul 21 17:14:35.098237 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.098207 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f102ad9f-9024-426a-b36a-052d330a422b-kube-api-access-wx4ds" (OuterVolumeSpecName: "kube-api-access-wx4ds") pod "f102ad9f-9024-426a-b36a-052d330a422b" (UID: "f102ad9f-9024-426a-b36a-052d330a422b"). InnerVolumeSpecName "kube-api-access-wx4ds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:14:35.098237 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.098222 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f102ad9f-9024-426a-b36a-052d330a422b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f102ad9f-9024-426a-b36a-052d330a422b" (UID: "f102ad9f-9024-426a-b36a-052d330a422b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:14:35.196938 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.196896 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f102ad9f-9024-426a-b36a-052d330a422b-webhook-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:14:35.196938 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.196932 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx4ds\" (UniqueName: \"kubernetes.io/projected/f102ad9f-9024-426a-b36a-052d330a422b-kube-api-access-wx4ds\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:14:35.845946 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.845915 2562 generic.go:356] "Generic (PLEG): container finished" podID="f102ad9f-9024-426a-b36a-052d330a422b" containerID="b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478" exitCode=0 Jul 21 17:14:35.846438 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.845963 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d5cf45d-7v27q" Jul 21 17:14:35.846438 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.845999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d5cf45d-7v27q" event={"ID":"f102ad9f-9024-426a-b36a-052d330a422b","Type":"ContainerDied","Data":"b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478"} Jul 21 17:14:35.846438 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.846062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d5cf45d-7v27q" event={"ID":"f102ad9f-9024-426a-b36a-052d330a422b","Type":"ContainerDied","Data":"4427be3fdea48323f55b456a63fd43b25eaca6888d44901bf15793cb9bfc072f"} Jul 21 17:14:35.846438 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.846092 2562 scope.go:117] "RemoveContainer" containerID="b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478" Jul 21 17:14:35.855408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.855389 2562 scope.go:117] "RemoveContainer" containerID="b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478" Jul 21 17:14:35.855770 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:14:35.855749 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478\": container with ID starting with b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478 not found: ID does not exist" containerID="b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478" Jul 21 17:14:35.855846 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.855780 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478"} err="failed to get container status \"b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478\": rpc error: code = NotFound desc = could not find container \"b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478\": container with ID starting with b0ac3d84b0b00e5b9acfda4796dd121e4c2f95a2fe863218b1e1c193c0c32478 not found: ID does not exist" Jul 21 17:14:35.866102 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.866064 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68d5cf45d-7v27q"] Jul 21 17:14:35.871189 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:35.871160 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68d5cf45d-7v27q"] Jul 21 17:14:37.122066 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:14:37.122034 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f102ad9f-9024-426a-b36a-052d330a422b" path="/var/lib/kubelet/pods/f102ad9f-9024-426a-b36a-052d330a422b/volumes" Jul 21 17:15:00.175327 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:00.175288 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744235-l5tlh"] Jul 21 17:15:00.175830 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:00.175679 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f102ad9f-9024-426a-b36a-052d330a422b" containerName="manager" Jul 21 17:15:00.175830 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:00.175691 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f102ad9f-9024-426a-b36a-052d330a422b" containerName="manager" Jul 21 17:15:00.175830 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:00.175764 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f102ad9f-9024-426a-b36a-052d330a422b" containerName="manager" Jul 21 17:15:00.180337 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:00.180310 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-l5tlh" Jul 21 17:15:00.183505 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:00.183479 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dl9wf\"" Jul 21 17:15:00.190510 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:00.190480 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744235-l5tlh"] Jul 21 17:15:00.193319 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:00.193295 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-l5tlh" Jul 21 17:15:00.358333 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:00.358302 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744235-l5tlh"] Jul 21 17:15:00.360809 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:15:00.360782 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec657d4_58ff_4a54_85ab_e232c61b2c45.slice/crio-f2835c108788523024392f208d877ea289bd1ff03c0dfaed4da1e8ed3fa6f227 WatchSource:0}: Error finding container f2835c108788523024392f208d877ea289bd1ff03c0dfaed4da1e8ed3fa6f227: Status 404 returned error can't find the container with id f2835c108788523024392f208d877ea289bd1ff03c0dfaed4da1e8ed3fa6f227 Jul 21 17:15:00.966894 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:00.966854 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-l5tlh" event={"ID":"3ec657d4-58ff-4a54-85ab-e232c61b2c45","Type":"ContainerStarted","Data":"f2835c108788523024392f208d877ea289bd1ff03c0dfaed4da1e8ed3fa6f227"} Jul 21 17:15:10.016737 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:10.016700 2562 generic.go:356] "Generic (PLEG): container finished" podID="3ec657d4-58ff-4a54-85ab-e232c61b2c45" containerID="ff37614b795a86f0a8af8c51c601269c21c4fe099a49e3008e22725415b288fc" exitCode=0 Jul 21 17:15:10.017171 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:10.016791 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-l5tlh" event={"ID":"3ec657d4-58ff-4a54-85ab-e232c61b2c45","Type":"ContainerDied","Data":"ff37614b795a86f0a8af8c51c601269c21c4fe099a49e3008e22725415b288fc"} Jul 21 17:15:11.163054 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:11.163028 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-l5tlh" Jul 21 17:15:12.028543 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:12.028502 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-l5tlh" Jul 21 17:15:12.028543 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:12.028538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744235-l5tlh" event={"ID":"3ec657d4-58ff-4a54-85ab-e232c61b2c45","Type":"ContainerDied","Data":"f2835c108788523024392f208d877ea289bd1ff03c0dfaed4da1e8ed3fa6f227"} Jul 21 17:15:12.028755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:12.028584 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2835c108788523024392f208d877ea289bd1ff03c0dfaed4da1e8ed3fa6f227" Jul 21 17:15:55.408443 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.408407 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68d5cf45d-fm98t"] Jul 21 17:15:55.408945 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.408796 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ec657d4-58ff-4a54-85ab-e232c61b2c45" containerName="cleanup" Jul 21 17:15:55.408945 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.408807 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec657d4-58ff-4a54-85ab-e232c61b2c45" containerName="cleanup" Jul 21 17:15:55.408945 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.408883 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ec657d4-58ff-4a54-85ab-e232c61b2c45" containerName="cleanup" Jul 21 17:15:55.410694 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.410676 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d5cf45d-fm98t" Jul 21 17:15:55.413361 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.413322 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 21 17:15:55.414579 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.414557 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rk7d7\"" Jul 21 17:15:55.414702 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.414618 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 21 17:15:55.421430 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.421356 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d5cf45d-fm98t"] Jul 21 17:15:55.538788 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.538745 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb42d\" (UniqueName: \"kubernetes.io/projected/28eefc4a-657b-449a-8f5c-2f93dbd9c26c-kube-api-access-fb42d\") pod \"maas-controller-68d5cf45d-fm98t\" (UID: \"28eefc4a-657b-449a-8f5c-2f93dbd9c26c\") " pod="opendatahub/maas-controller-68d5cf45d-fm98t" Jul 21 17:15:55.538983 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.538843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28eefc4a-657b-449a-8f5c-2f93dbd9c26c-webhook-cert\") pod \"maas-controller-68d5cf45d-fm98t\" (UID: \"28eefc4a-657b-449a-8f5c-2f93dbd9c26c\") " pod="opendatahub/maas-controller-68d5cf45d-fm98t" Jul 21 17:15:55.639815 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.639757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb42d\" (UniqueName: \"kubernetes.io/projected/28eefc4a-657b-449a-8f5c-2f93dbd9c26c-kube-api-access-fb42d\") pod \"maas-controller-68d5cf45d-fm98t\" (UID: \"28eefc4a-657b-449a-8f5c-2f93dbd9c26c\") " pod="opendatahub/maas-controller-68d5cf45d-fm98t" Jul 21 17:15:55.640032 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.639851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28eefc4a-657b-449a-8f5c-2f93dbd9c26c-webhook-cert\") pod \"maas-controller-68d5cf45d-fm98t\" (UID: \"28eefc4a-657b-449a-8f5c-2f93dbd9c26c\") " pod="opendatahub/maas-controller-68d5cf45d-fm98t" Jul 21 17:15:55.642422 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.642398 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28eefc4a-657b-449a-8f5c-2f93dbd9c26c-webhook-cert\") pod \"maas-controller-68d5cf45d-fm98t\" (UID: \"28eefc4a-657b-449a-8f5c-2f93dbd9c26c\") " pod="opendatahub/maas-controller-68d5cf45d-fm98t" Jul 21 17:15:55.650775 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.650741 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb42d\" (UniqueName: \"kubernetes.io/projected/28eefc4a-657b-449a-8f5c-2f93dbd9c26c-kube-api-access-fb42d\") pod \"maas-controller-68d5cf45d-fm98t\" (UID: \"28eefc4a-657b-449a-8f5c-2f93dbd9c26c\") " pod="opendatahub/maas-controller-68d5cf45d-fm98t" Jul 21 17:15:55.722070 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.721965 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d5cf45d-fm98t" Jul 21 17:15:55.866510 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:55.866485 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d5cf45d-fm98t"] Jul 21 17:15:55.869322 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:15:55.869295 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28eefc4a_657b_449a_8f5c_2f93dbd9c26c.slice/crio-7244548ad9180c7973150da7e78847abb9f4ad648c3d62dda3c7a16143a74bc7 WatchSource:0}: Error finding container 7244548ad9180c7973150da7e78847abb9f4ad648c3d62dda3c7a16143a74bc7: Status 404 returned error can't find the container with id 7244548ad9180c7973150da7e78847abb9f4ad648c3d62dda3c7a16143a74bc7 Jul 21 17:15:56.247834 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:56.247802 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d5cf45d-fm98t" event={"ID":"28eefc4a-657b-449a-8f5c-2f93dbd9c26c","Type":"ContainerStarted","Data":"7244548ad9180c7973150da7e78847abb9f4ad648c3d62dda3c7a16143a74bc7"} Jul 21 17:15:57.253917 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:57.253882 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d5cf45d-fm98t" event={"ID":"28eefc4a-657b-449a-8f5c-2f93dbd9c26c","Type":"ContainerStarted","Data":"0b86c971c7b500f82c1b4e0fda810b42cf258585a56dca1be099534699c12042"} Jul 21 17:15:57.254333 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:57.254025 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68d5cf45d-fm98t" Jul 21 17:15:57.274901 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:15:57.274844 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68d5cf45d-fm98t" podStartSLOduration=1.8769215 podStartE2EDuration="2.27482702s" totalImagesPullingTime="397.90552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:15:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:15:57.273323841 +0000 UTC m=+858.700149932" watchObservedRunningTime="2026-07-21 17:15:57.27482702 +0000 UTC m=+858.701653112" Jul 21 17:16:08.261555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:16:08.261500 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68d5cf45d-fm98t" Jul 21 17:16:39.066022 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:16:39.065937 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:16:39.070963 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:16:39.070936 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:21:39.098689 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:21:39.098570 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:21:39.102786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:21:39.100494 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:26:39.134805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:26:39.134700 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:26:39.141091 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:26:39.141067 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:28:45.370241 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.370162 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww"] Jul 21 17:28:45.373712 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.373690 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.380193 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.380164 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d476230f-openshift-default-dockercfg-pzhh5\"" Jul 21 17:28:45.424370 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.424309 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww"] Jul 21 17:28:45.479691 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.479649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-istio-token\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.479868 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.479715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-certs\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.479868 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.479754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-data\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.479868 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.479771 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803662fa-0a7c-4568-84fb-58e34534cd44-istio-podinfo\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.479868 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.479799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-credential-socket\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.479868 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.479821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldjr7\" (UniqueName: \"kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-kube-api-access-ldjr7\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.479868 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.479851 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-envoy\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.480059 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.479879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-socket\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.480059 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.479897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803662fa-0a7c-4568-84fb-58e34534cd44-istiod-ca-cert\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.580736 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.580696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-istio-token\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.580937 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.580768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-certs\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.580937 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.580789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-data\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.580937 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.580806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803662fa-0a7c-4568-84fb-58e34534cd44-istio-podinfo\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.580937 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.580855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-credential-socket\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.580937 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.580890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldjr7\" (UniqueName: \"kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-kube-api-access-ldjr7\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.580937 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.580921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-envoy\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.581264 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.580964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-socket\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.581264 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.580989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803662fa-0a7c-4568-84fb-58e34534cd44-istiod-ca-cert\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.581264 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.581221 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-certs\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.581405 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.581287 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-data\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.581405 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.581333 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-credential-socket\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.581548 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.581497 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-socket\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.581927 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.581905 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803662fa-0a7c-4568-84fb-58e34534cd44-istiod-ca-cert\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.583432 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.583406 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-envoy\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.583668 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.583650 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803662fa-0a7c-4568-84fb-58e34534cd44-istio-podinfo\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.598736 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.598706 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-istio-token\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.599869 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.599849 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldjr7\" (UniqueName: \"kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-kube-api-access-ldjr7\") pod \"e2e-ait-d476230f-openshift-default-6649694c5-8hbww\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.683992 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.683900 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:45.852041 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.852016 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww"] Jul 21 17:28:45.853218 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:28:45.853190 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803662fa_0a7c_4568_84fb_58e34534cd44.slice/crio-ba4ee5c0670a1a59c3d2ff78add83a631f2bb1243e6c237641c886d35f6940b9 WatchSource:0}: Error finding container ba4ee5c0670a1a59c3d2ff78add83a631f2bb1243e6c237641c886d35f6940b9: Status 404 returned error can't find the container with id ba4ee5c0670a1a59c3d2ff78add83a631f2bb1243e6c237641c886d35f6940b9 Jul 21 17:28:45.855227 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.855193 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:28:45.855317 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.855276 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:28:45.855378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:45.855320 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:28:46.029101 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:46.029003 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" event={"ID":"803662fa-0a7c-4568-84fb-58e34534cd44","Type":"ContainerStarted","Data":"033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d"} Jul 21 17:28:46.029101 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:46.029072 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" event={"ID":"803662fa-0a7c-4568-84fb-58e34534cd44","Type":"ContainerStarted","Data":"ba4ee5c0670a1a59c3d2ff78add83a631f2bb1243e6c237641c886d35f6940b9"} Jul 21 17:28:46.060125 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:46.060068 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" podStartSLOduration=1.060050808 podStartE2EDuration="1.060050808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:28:46.059783141 +0000 UTC m=+1627.486609238" watchObservedRunningTime="2026-07-21 17:28:46.060050808 +0000 UTC m=+1627.486876901" Jul 21 17:28:46.684822 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:46.684783 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:46.689837 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:46.689810 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:47.034004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.033921 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:47.035058 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.035038 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:28:47.608817 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.608769 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr"] Jul 21 17:28:47.612404 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.612384 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:47.615960 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.615930 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d476230f-serving-cert\"" Jul 21 17:28:47.633008 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.632975 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr"] Jul 21 17:28:47.700754 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.700721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-maas-api-tls\") pod \"maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:47.701122 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.700785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq58x\" (UniqueName: \"kubernetes.io/projected/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-kube-api-access-wq58x\") pod \"maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:47.701122 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.700899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-openshift-service-ca\") pod \"maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:47.801645 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.801599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-openshift-service-ca\") pod \"maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:47.801854 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.801694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-maas-api-tls\") pod \"maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:47.801854 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.801741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq58x\" (UniqueName: \"kubernetes.io/projected/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-kube-api-access-wq58x\") pod \"maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:47.801938 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:28:47.801851 2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-serving-cert: secret "maas-api-e2e-ait-d476230f-serving-cert" not found Jul 21 17:28:47.801971 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:28:47.801938 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-maas-api-tls podName:6c1ef3a5-4fe4-4401-8c80-81b82c80cef8 nodeName:}" failed. No retries permitted until 2026-07-21 17:28:48.301919094 +0000 UTC m=+1629.728745166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-maas-api-tls") pod "maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" (UID: "6c1ef3a5-4fe4-4401-8c80-81b82c80cef8") : secret "maas-api-e2e-ait-d476230f-serving-cert" not found Jul 21 17:28:47.802340 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.802321 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-openshift-service-ca\") pod \"maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:47.811321 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:47.811290 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq58x\" (UniqueName: \"kubernetes.io/projected/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-kube-api-access-wq58x\") pod \"maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:48.306979 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:48.306939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-maas-api-tls\") pod \"maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:48.309618 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:48.309594 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-maas-api-tls\") pod \"maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:48.524964 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:48.524928 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:48.682697 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:48.682668 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr"] Jul 21 17:28:48.685342 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:28:48.685312 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1ef3a5_4fe4_4401_8c80_81b82c80cef8.slice/crio-80f0589f0dbabc39e29ff52d6abef2db838d8e7bf994cdfe31af7fc375ef2a26 WatchSource:0}: Error finding container 80f0589f0dbabc39e29ff52d6abef2db838d8e7bf994cdfe31af7fc375ef2a26: Status 404 returned error can't find the container with id 80f0589f0dbabc39e29ff52d6abef2db838d8e7bf994cdfe31af7fc375ef2a26 Jul 21 17:28:48.686818 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:48.686798 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 17:28:49.044790 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:49.044753 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" event={"ID":"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8","Type":"ContainerStarted","Data":"80f0589f0dbabc39e29ff52d6abef2db838d8e7bf994cdfe31af7fc375ef2a26"} Jul 21 17:28:50.051286 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:50.051249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" event={"ID":"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8","Type":"ContainerStarted","Data":"c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99"} Jul 21 17:28:50.051702 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:50.051311 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:28:50.075611 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:50.075552 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" podStartSLOduration=2.326873321 podStartE2EDuration="3.075503392s" totalImagesPullingTime="748.630071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:28:50.072626635 +0000 UTC m=+1631.499452728" watchObservedRunningTime="2026-07-21 17:28:50.075503392 +0000 UTC m=+1631.502329529" Jul 21 17:28:56.068855 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:28:56.068806 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:29:01.109015 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:01.108977 2562 generic.go:356] "Generic (PLEG): container finished" podID="803662fa-0a7c-4568-84fb-58e34534cd44" containerID="033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d" exitCode=0 Jul 21 17:29:01.114466 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:01.114434 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" event={"ID":"803662fa-0a7c-4568-84fb-58e34534cd44","Type":"ContainerDied","Data":"033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d"} Jul 21 17:29:01.114871 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:01.114855 2562 scope.go:117] "RemoveContainer" containerID="033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d" Jul 21 17:29:01.115968 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:01.115939 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:29:01.116039 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:01.116022 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:29:01.116086 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:01.116070 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:29:02.034010 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:02.033974 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:29:02.116211 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:02.116169 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" event={"ID":"803662fa-0a7c-4568-84fb-58e34534cd44","Type":"ContainerStarted","Data":"da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc"} Jul 21 17:29:02.684984 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:02.684940 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:29:02.686099 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:02.686076 2562 patch_prober.go:28] interesting pod/e2e-ait-d476230f-openshift-default-6649694c5-8hbww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 21 17:29:02.686230 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:02.686136 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 21 17:29:03.685320 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:03.685283 2562 patch_prober.go:28] interesting pod/e2e-ait-d476230f-openshift-default-6649694c5-8hbww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 21 17:29:03.685755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:03.685339 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 21 17:29:04.684630 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:04.684596 2562 patch_prober.go:28] interesting pod/e2e-ait-d476230f-openshift-default-6649694c5-8hbww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 21 17:29:04.684820 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:04.684677 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 21 17:29:05.684862 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:05.684822 2562 patch_prober.go:28] interesting pod/e2e-ait-d476230f-openshift-default-6649694c5-8hbww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 21 17:29:05.685289 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:05.684897 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 21 17:29:06.688941 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:06.688907 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:29:06.689392 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:06.689156 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:29:06.690054 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:06.690033 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:29:23.635219 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:23.635185 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr"] Jul 21 17:29:23.635836 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:23.635470 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" podUID="6c1ef3a5-4fe4-4401-8c80-81b82c80cef8" containerName="maas-api" containerID="cri-o://c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99" gracePeriod=30 Jul 21 17:29:23.896564 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:23.896484 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:29:23.950693 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:23.950660 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-maas-api-tls\") pod \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " Jul 21 17:29:23.950876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:23.950768 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq58x\" (UniqueName: \"kubernetes.io/projected/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-kube-api-access-wq58x\") pod \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " Jul 21 17:29:23.950876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:23.950795 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-openshift-service-ca\") pod \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\" (UID: \"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8\") " Jul 21 17:29:23.951207 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:23.951169 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6c1ef3a5-4fe4-4401-8c80-81b82c80cef8" (UID: "6c1ef3a5-4fe4-4401-8c80-81b82c80cef8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:29:23.953133 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:23.953106 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-kube-api-access-wq58x" (OuterVolumeSpecName: "kube-api-access-wq58x") pod "6c1ef3a5-4fe4-4401-8c80-81b82c80cef8" (UID: "6c1ef3a5-4fe4-4401-8c80-81b82c80cef8"). InnerVolumeSpecName "kube-api-access-wq58x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:29:23.953228 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:23.953143 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6c1ef3a5-4fe4-4401-8c80-81b82c80cef8" (UID: "6c1ef3a5-4fe4-4401-8c80-81b82c80cef8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:29:24.051904 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.051868 2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-maas-api-tls\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:24.051904 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.051901 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq58x\" (UniqueName: \"kubernetes.io/projected/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-kube-api-access-wq58x\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:24.051904 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.051911 2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8-openshift-service-ca\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:24.225902 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.225817 2562 generic.go:356] "Generic (PLEG): container finished" podID="6c1ef3a5-4fe4-4401-8c80-81b82c80cef8" containerID="c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99" exitCode=0 Jul 21 17:29:24.225902 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.225862 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" Jul 21 17:29:24.226085 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.225907 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" event={"ID":"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8","Type":"ContainerDied","Data":"c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99"} Jul 21 17:29:24.226085 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.225969 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr" event={"ID":"6c1ef3a5-4fe4-4401-8c80-81b82c80cef8","Type":"ContainerDied","Data":"80f0589f0dbabc39e29ff52d6abef2db838d8e7bf994cdfe31af7fc375ef2a26"} Jul 21 17:29:24.226085 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.225993 2562 scope.go:117] "RemoveContainer" containerID="c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99" Jul 21 17:29:24.237864 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.237841 2562 scope.go:117] "RemoveContainer" containerID="c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99" Jul 21 17:29:24.238176 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:29:24.238155 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99\": container with ID starting with c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99 not found: ID does not exist" containerID="c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99" Jul 21 17:29:24.238269 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.238190 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99"} err="failed to get container status \"c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99\": rpc error: code = NotFound desc = could not find container \"c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99\": container with ID starting with c63730355b89306d86e6093949dd1e93cbaf59979ded6e1ed77398ea06301e99 not found: ID does not exist" Jul 21 17:29:24.252714 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.252687 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr"] Jul 21 17:29:24.258694 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:24.258669 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d476230f-75c44f6fd9-ngpcr"] Jul 21 17:29:25.114376 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:25.114343 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c1ef3a5-4fe4-4401-8c80-81b82c80cef8" path="/var/lib/kubelet/pods/6c1ef3a5-4fe4-4401-8c80-81b82c80cef8/volumes" Jul 21 17:29:28.269912 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:28.269880 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww"] Jul 21 17:29:28.270344 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:28.270181 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" containerID="cri-o://da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc" gracePeriod=30 Jul 21 17:29:29.289194 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.289157 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l"] Jul 21 17:29:29.289586 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.289554 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1ef3a5-4fe4-4401-8c80-81b82c80cef8" containerName="maas-api" Jul 21 17:29:29.289586 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.289568 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1ef3a5-4fe4-4401-8c80-81b82c80cef8" containerName="maas-api" Jul 21 17:29:29.289678 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.289664 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1ef3a5-4fe4-4401-8c80-81b82c80cef8" containerName="maas-api" Jul 21 17:29:29.294183 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.294159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.296911 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.296889 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-6ac89a3f-gw-openshift-default-dockercfg-47rmt\"" Jul 21 17:29:29.314027 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.313995 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l"] Jul 21 17:29:29.401273 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.401224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-socket\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.401477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.401396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-credential-socket\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.401662 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.401430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-token\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.401754 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.401695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-certs\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.401754 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.401722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-envoy\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.401754 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.401751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-data\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.401929 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.401866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-podinfo\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.401988 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.401939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8txd\" (UniqueName: \"kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-kube-api-access-x8txd\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.401988 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.401982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istiod-ca-cert\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.502929 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.502888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-socket\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.502952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-credential-socket\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.502981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-token\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-certs\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-envoy\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-data\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-podinfo\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503134 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8txd\" (UniqueName: \"kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-kube-api-access-x8txd\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503484 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istiod-ca-cert\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503484 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503437 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-certs\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503484 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503442 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-data\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503484 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503474 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-credential-socket\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503740 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503688 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-socket\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.503978 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.503959 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istiod-ca-cert\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.505692 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.505663 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-envoy\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.505917 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.505900 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-podinfo\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.515346 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.515321 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-token\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.516092 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.516071 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8txd\" (UniqueName: \"kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-kube-api-access-x8txd\") pod \"e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.604761 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.604713 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:29.762697 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.762672 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l"] Jul 21 17:29:29.764777 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:29:29.764755 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3662f4_0e5f_434a_b6d9_deeb45ed034f.slice/crio-377d5944c3d31a9c5784fee296952bfc815ba5f9ecdb1c8647fee68739476323 WatchSource:0}: Error finding container 377d5944c3d31a9c5784fee296952bfc815ba5f9ecdb1c8647fee68739476323: Status 404 returned error can't find the container with id 377d5944c3d31a9c5784fee296952bfc815ba5f9ecdb1c8647fee68739476323 Jul 21 17:29:29.766880 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.766845 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:29:29.766982 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.766909 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:29:29.766982 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:29.766940 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:29:30.257499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:30.257459 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" event={"ID":"cb3662f4-0e5f-434a-b6d9-deeb45ed034f","Type":"ContainerStarted","Data":"5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54"} Jul 21 17:29:30.257701 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:30.257555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" event={"ID":"cb3662f4-0e5f-434a-b6d9-deeb45ed034f","Type":"ContainerStarted","Data":"377d5944c3d31a9c5784fee296952bfc815ba5f9ecdb1c8647fee68739476323"} Jul 21 17:29:30.285684 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:30.285631 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" podStartSLOduration=1.2856112020000001 podStartE2EDuration="1.285611202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:29:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:29:30.284345723 +0000 UTC m=+1671.711171828" watchObservedRunningTime="2026-07-21 17:29:30.285611202 +0000 UTC m=+1671.712437365" Jul 21 17:29:30.605871 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:30.605828 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:30.607564 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:30.607532 2562 patch_prober.go:28] interesting pod/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 17:29:30.607703 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:30.607601 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 17:29:31.610006 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:31.609975 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:32.267764 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:32.267733 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:32.268871 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:32.268846 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:33.534164 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.534088 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:29:33.642285 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642246 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-istio-token\") pod \"803662fa-0a7c-4568-84fb-58e34534cd44\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " Jul 21 17:29:33.642474 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642314 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-data\") pod \"803662fa-0a7c-4568-84fb-58e34534cd44\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " Jul 21 17:29:33.642474 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642336 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-certs\") pod \"803662fa-0a7c-4568-84fb-58e34534cd44\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " Jul 21 17:29:33.642474 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642357 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-credential-socket\") pod \"803662fa-0a7c-4568-84fb-58e34534cd44\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " Jul 21 17:29:33.642474 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642375 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803662fa-0a7c-4568-84fb-58e34534cd44-istiod-ca-cert\") pod \"803662fa-0a7c-4568-84fb-58e34534cd44\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " Jul 21 17:29:33.642474 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642412 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-socket\") pod \"803662fa-0a7c-4568-84fb-58e34534cd44\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " Jul 21 17:29:33.642474 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642455 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-envoy\") pod \"803662fa-0a7c-4568-84fb-58e34534cd44\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " Jul 21 17:29:33.642835 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642569 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldjr7\" (UniqueName: \"kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-kube-api-access-ldjr7\") pod \"803662fa-0a7c-4568-84fb-58e34534cd44\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " Jul 21 17:29:33.642835 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642626 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803662fa-0a7c-4568-84fb-58e34534cd44-istio-podinfo\") pod \"803662fa-0a7c-4568-84fb-58e34534cd44\" (UID: \"803662fa-0a7c-4568-84fb-58e34534cd44\") " Jul 21 17:29:33.642835 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642776 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "803662fa-0a7c-4568-84fb-58e34534cd44" (UID: "803662fa-0a7c-4568-84fb-58e34534cd44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:29:33.642835 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642793 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "803662fa-0a7c-4568-84fb-58e34534cd44" (UID: "803662fa-0a7c-4568-84fb-58e34534cd44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:29:33.643041 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.642949 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "803662fa-0a7c-4568-84fb-58e34534cd44" (UID: "803662fa-0a7c-4568-84fb-58e34534cd44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:29:33.643096 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.643045 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:33.643096 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.643067 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:33.643096 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.643082 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:33.643273 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.643248 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803662fa-0a7c-4568-84fb-58e34534cd44-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "803662fa-0a7c-4568-84fb-58e34534cd44" (UID: "803662fa-0a7c-4568-84fb-58e34534cd44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:29:33.644147 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.644124 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-data" (OuterVolumeSpecName: "istio-data") pod "803662fa-0a7c-4568-84fb-58e34534cd44" (UID: "803662fa-0a7c-4568-84fb-58e34534cd44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:29:33.644989 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.644966 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "803662fa-0a7c-4568-84fb-58e34534cd44" (UID: "803662fa-0a7c-4568-84fb-58e34534cd44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:29:33.645129 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.645112 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-istio-token" (OuterVolumeSpecName: "istio-token") pod "803662fa-0a7c-4568-84fb-58e34534cd44" (UID: "803662fa-0a7c-4568-84fb-58e34534cd44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:29:33.645413 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.645393 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/803662fa-0a7c-4568-84fb-58e34534cd44-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "803662fa-0a7c-4568-84fb-58e34534cd44" (UID: "803662fa-0a7c-4568-84fb-58e34534cd44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:29:33.645906 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.645885 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-kube-api-access-ldjr7" (OuterVolumeSpecName: "kube-api-access-ldjr7") pod "803662fa-0a7c-4568-84fb-58e34534cd44" (UID: "803662fa-0a7c-4568-84fb-58e34534cd44"). InnerVolumeSpecName "kube-api-access-ldjr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:29:33.743560 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.743504 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:33.743560 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.743557 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldjr7\" (UniqueName: \"kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-kube-api-access-ldjr7\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:33.743560 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.743567 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803662fa-0a7c-4568-84fb-58e34534cd44-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:33.743803 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.743577 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803662fa-0a7c-4568-84fb-58e34534cd44-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:33.743803 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.743585 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803662fa-0a7c-4568-84fb-58e34534cd44-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:33.743803 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:33.743592 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803662fa-0a7c-4568-84fb-58e34534cd44-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:29:34.280568 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.280535 2562 generic.go:356] "Generic (PLEG): container finished" podID="803662fa-0a7c-4568-84fb-58e34534cd44" containerID="da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc" exitCode=0 Jul 21 17:29:34.280726 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.280587 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" Jul 21 17:29:34.280726 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.280634 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" event={"ID":"803662fa-0a7c-4568-84fb-58e34534cd44","Type":"ContainerDied","Data":"da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc"} Jul 21 17:29:34.280726 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.280687 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww" event={"ID":"803662fa-0a7c-4568-84fb-58e34534cd44","Type":"ContainerDied","Data":"ba4ee5c0670a1a59c3d2ff78add83a631f2bb1243e6c237641c886d35f6940b9"} Jul 21 17:29:34.280726 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.280710 2562 scope.go:117] "RemoveContainer" containerID="da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc" Jul 21 17:29:34.290469 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.290446 2562 scope.go:117] "RemoveContainer" containerID="033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d" Jul 21 17:29:34.301062 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.301041 2562 scope.go:117] "RemoveContainer" containerID="da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc" Jul 21 17:29:34.301341 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:29:34.301322 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc\": container with ID starting with da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc not found: ID does not exist" containerID="da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc" Jul 21 17:29:34.301389 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.301352 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc"} err="failed to get container status \"da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc\": rpc error: code = NotFound desc = could not find container \"da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc\": container with ID starting with da91f0a77e4063ac502478dc699504d23c53c58f2c200db4cedb552f3d3f49dc not found: ID does not exist" Jul 21 17:29:34.301389 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.301378 2562 scope.go:117] "RemoveContainer" containerID="033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d" Jul 21 17:29:34.301664 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:29:34.301645 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d\": container with ID starting with 033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d not found: ID does not exist" containerID="033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d" Jul 21 17:29:34.301715 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.301671 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d"} err="failed to get container status \"033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d\": rpc error: code = NotFound desc = could not find container \"033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d\": container with ID starting with 033beafb95a96b5345c120123bc72436c2f1a41c6b786b8619bc8c8389392e9d not found: ID does not exist" Jul 21 17:29:34.307185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.307160 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww"] Jul 21 17:29:34.314622 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:34.314597 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d476230f-openshift-default-6649694c5-8hbww"] Jul 21 17:29:35.115712 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:35.115677 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" path="/var/lib/kubelet/pods/803662fa-0a7c-4568-84fb-58e34534cd44/volumes" Jul 21 17:29:46.343949 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:46.343914 2562 generic.go:356] "Generic (PLEG): container finished" podID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerID="5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54" exitCode=0 Jul 21 17:29:46.344366 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:46.343990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" event={"ID":"cb3662f4-0e5f-434a-b6d9-deeb45ed034f","Type":"ContainerDied","Data":"5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54"} Jul 21 17:29:46.344424 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:46.344372 2562 scope.go:117] "RemoveContainer" containerID="5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54" Jul 21 17:29:46.345417 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:46.345387 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:29:46.345487 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:46.345464 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:29:46.345564 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:46.345507 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:29:47.267786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:47.267746 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:47.354800 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:47.354756 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" event={"ID":"cb3662f4-0e5f-434a-b6d9-deeb45ed034f","Type":"ContainerStarted","Data":"6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1"} Jul 21 17:29:47.605752 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:47.605707 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:47.606972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:47.606946 2562 patch_prober.go:28] interesting pod/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 17:29:47.607089 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:47.607001 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 17:29:48.605368 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:48.605326 2562 patch_prober.go:28] interesting pod/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 17:29:48.605797 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:48.605390 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 17:29:49.605701 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:49.605663 2562 patch_prober.go:28] interesting pod/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 17:29:49.606094 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:49.605730 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 17:29:50.605989 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:50.605947 2562 patch_prober.go:28] interesting pod/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 17:29:50.606396 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:50.606019 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 17:29:51.616969 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:51.616932 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:51.617437 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:51.617234 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:29:51.618021 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:29:51.618002 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:30:11.983246 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:11.983161 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l"] Jul 21 17:30:11.983732 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:11.983418 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" containerID="cri-o://6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1" gracePeriod=30 Jul 21 17:30:12.786987 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.786953 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw"] Jul 21 17:30:12.787341 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.787329 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" Jul 21 17:30:12.787386 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.787342 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" Jul 21 17:30:12.787460 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.787439 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" Jul 21 17:30:12.790499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.790477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.793775 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.793753 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4db918c7-openshift-default-dockercfg-fms6t\"" Jul 21 17:30:12.810364 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.810334 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw"] Jul 21 17:30:12.811994 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.811963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-data\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.812117 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.812027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-certs\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.812117 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.812104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-credential-socket\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.812210 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.812154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-token\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.812210 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.812199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-podinfo\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.812298 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.812217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-envoy\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.812298 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.812234 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgc6f\" (UniqueName: \"kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-kube-api-access-dgc6f\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.812298 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.812256 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-socket\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.812428 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.812302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b7ae16-26db-457b-b3a2-9b66f419240c-istiod-ca-cert\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.913563 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.913494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-certs\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.913711 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.913598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-credential-socket\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.913711 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.913640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-token\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.913711 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.913702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-podinfo\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.913906 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.913734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-envoy\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.913906 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.913759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgc6f\" (UniqueName: \"kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-kube-api-access-dgc6f\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.913906 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.913793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-socket\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.913906 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.913823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b7ae16-26db-457b-b3a2-9b66f419240c-istiod-ca-cert\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.913906 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.913855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-data\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.914154 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.913937 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-certs\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.914154 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.914017 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-credential-socket\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.914270 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.914187 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-socket\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.914319 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.914277 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-data\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.914680 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.914635 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b7ae16-26db-457b-b3a2-9b66f419240c-istiod-ca-cert\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.916242 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.916220 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-envoy\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.916476 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.916458 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-podinfo\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.924229 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.924195 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-token\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:12.924324 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:12.924246 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgc6f\" (UniqueName: \"kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-kube-api-access-dgc6f\") pod \"e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:13.101797 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:13.101731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:13.254655 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:13.254628 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw"] Jul 21 17:30:13.256172 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:30:13.256149 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b7ae16_26db_457b_b3a2_9b66f419240c.slice/crio-2e6b231c3841ce4ab06352c504de6720338322e9c8d22df132fdf4b5bf8afdf5 WatchSource:0}: Error finding container 2e6b231c3841ce4ab06352c504de6720338322e9c8d22df132fdf4b5bf8afdf5: Status 404 returned error can't find the container with id 2e6b231c3841ce4ab06352c504de6720338322e9c8d22df132fdf4b5bf8afdf5 Jul 21 17:30:13.258679 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:13.258634 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:30:13.258750 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:13.258730 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:30:13.258785 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:13.258771 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:30:13.494046 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:13.493953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" event={"ID":"b6b7ae16-26db-457b-b3a2-9b66f419240c","Type":"ContainerStarted","Data":"97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a"} Jul 21 17:30:13.494046 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:13.494019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" event={"ID":"b6b7ae16-26db-457b-b3a2-9b66f419240c","Type":"ContainerStarted","Data":"2e6b231c3841ce4ab06352c504de6720338322e9c8d22df132fdf4b5bf8afdf5"} Jul 21 17:30:13.528428 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:13.528372 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" podStartSLOduration=1.5283543819999998 podStartE2EDuration="1.528354382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:30:13.526624753 +0000 UTC m=+1714.953450847" watchObservedRunningTime="2026-07-21 17:30:13.528354382 +0000 UTC m=+1714.955180475" Jul 21 17:30:14.101952 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:14.101916 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:14.107026 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:14.107000 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:14.501023 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:14.500937 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:14.501986 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:14.501962 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:17.238663 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.238634 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:30:17.357154 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357121 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8txd\" (UniqueName: \"kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-kube-api-access-x8txd\") pod \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " Jul 21 17:30:17.357354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357167 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-certs\") pod \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " Jul 21 17:30:17.357354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357217 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istiod-ca-cert\") pod \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " Jul 21 17:30:17.357354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357241 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-credential-socket\") pod \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " Jul 21 17:30:17.357354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357275 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-socket\") pod \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " Jul 21 17:30:17.357354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357291 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-podinfo\") pod \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " Jul 21 17:30:17.357354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357317 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-data\") pod \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " Jul 21 17:30:17.357354 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357343 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-envoy\") pod \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " Jul 21 17:30:17.357729 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357429 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-token\") pod \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\" (UID: \"cb3662f4-0e5f-434a-b6d9-deeb45ed034f\") " Jul 21 17:30:17.357729 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357630 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb3662f4-0e5f-434a-b6d9-deeb45ed034f" (UID: "cb3662f4-0e5f-434a-b6d9-deeb45ed034f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:30:17.357840 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.357762 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb3662f4-0e5f-434a-b6d9-deeb45ed034f" (UID: "cb3662f4-0e5f-434a-b6d9-deeb45ed034f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:30:17.358062 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.358035 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb3662f4-0e5f-434a-b6d9-deeb45ed034f" (UID: "cb3662f4-0e5f-434a-b6d9-deeb45ed034f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:30:17.358163 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.358150 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb3662f4-0e5f-434a-b6d9-deeb45ed034f" (UID: "cb3662f4-0e5f-434a-b6d9-deeb45ed034f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:30:17.359138 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.359102 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb3662f4-0e5f-434a-b6d9-deeb45ed034f" (UID: "cb3662f4-0e5f-434a-b6d9-deeb45ed034f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:30:17.359860 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.359825 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-kube-api-access-x8txd" (OuterVolumeSpecName: "kube-api-access-x8txd") pod "cb3662f4-0e5f-434a-b6d9-deeb45ed034f" (UID: "cb3662f4-0e5f-434a-b6d9-deeb45ed034f"). InnerVolumeSpecName "kube-api-access-x8txd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:30:17.359986 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.359965 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb3662f4-0e5f-434a-b6d9-deeb45ed034f" (UID: "cb3662f4-0e5f-434a-b6d9-deeb45ed034f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:30:17.360835 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.360329 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb3662f4-0e5f-434a-b6d9-deeb45ed034f" (UID: "cb3662f4-0e5f-434a-b6d9-deeb45ed034f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:30:17.360927 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.360867 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb3662f4-0e5f-434a-b6d9-deeb45ed034f" (UID: "cb3662f4-0e5f-434a-b6d9-deeb45ed034f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:30:17.458499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.458463 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:30:17.458499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.458490 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8txd\" (UniqueName: \"kubernetes.io/projected/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-kube-api-access-x8txd\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:30:17.458499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.458500 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:30:17.458499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.458509 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:30:17.458796 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.458537 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:30:17.458796 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.458548 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:30:17.458796 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.458557 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:30:17.458796 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.458564 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:30:17.458796 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.458572 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb3662f4-0e5f-434a-b6d9-deeb45ed034f-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:30:17.517411 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.517374 2562 generic.go:356] "Generic (PLEG): container finished" podID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerID="6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1" exitCode=0 Jul 21 17:30:17.517626 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.517436 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" Jul 21 17:30:17.517626 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.517451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" event={"ID":"cb3662f4-0e5f-434a-b6d9-deeb45ed034f","Type":"ContainerDied","Data":"6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1"} Jul 21 17:30:17.517626 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.517560 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l" event={"ID":"cb3662f4-0e5f-434a-b6d9-deeb45ed034f","Type":"ContainerDied","Data":"377d5944c3d31a9c5784fee296952bfc815ba5f9ecdb1c8647fee68739476323"} Jul 21 17:30:17.517626 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.517589 2562 scope.go:117] "RemoveContainer" containerID="6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1" Jul 21 17:30:17.527971 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.527901 2562 scope.go:117] "RemoveContainer" containerID="5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54" Jul 21 17:30:17.538863 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.538844 2562 scope.go:117] "RemoveContainer" containerID="6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1" Jul 21 17:30:17.539178 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:30:17.539156 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1\": container with ID starting with 6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1 not found: ID does not exist" containerID="6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1" Jul 21 17:30:17.539239 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.539188 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1"} err="failed to get container status \"6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1\": rpc error: code = NotFound desc = could not find container \"6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1\": container with ID starting with 6940c258268d5dcd91310b3e3bb11d20d75d4c38154da4b6fdb248c03d43c2a1 not found: ID does not exist" Jul 21 17:30:17.539239 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.539207 2562 scope.go:117] "RemoveContainer" containerID="5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54" Jul 21 17:30:17.539498 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:30:17.539475 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54\": container with ID starting with 5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54 not found: ID does not exist" containerID="5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54" Jul 21 17:30:17.539579 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.539508 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54"} err="failed to get container status \"5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54\": rpc error: code = NotFound desc = could not find container \"5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54\": container with ID starting with 5575b81163abf27db7aa1db3c6f3577aaac643e2efab20034b170f38a79e8a54 not found: ID does not exist" Jul 21 17:30:17.543200 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.543172 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l"] Jul 21 17:30:17.546870 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:17.546845 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-6ac89a3f-gw-openshift-default-756f89879f-7896l"] Jul 21 17:30:19.114735 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:19.114702 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" path="/var/lib/kubelet/pods/cb3662f4-0e5f-434a-b6d9-deeb45ed034f/volumes" Jul 21 17:30:29.549757 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:29.548540 2562 patch_prober.go:28] interesting pod/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:35848->10.132.0.48:15021: read: connection reset by peer" start-of-body= Jul 21 17:30:29.549757 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:29.548650 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:35848->10.132.0.48:15021: read: connection reset by peer" Jul 21 17:30:29.605019 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:29.604987 2562 generic.go:356] "Generic (PLEG): container finished" podID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerID="97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a" exitCode=0 Jul 21 17:30:29.605019 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:29.605031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" event={"ID":"b6b7ae16-26db-457b-b3a2-9b66f419240c","Type":"ContainerDied","Data":"97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a"} Jul 21 17:30:29.605442 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:29.605429 2562 scope.go:117] "RemoveContainer" containerID="97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a" Jul 21 17:30:29.606571 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:29.606531 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:30:29.606699 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:29.606624 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:30:29.606699 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:29.606673 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:30:30.611947 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:30.611914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" event={"ID":"b6b7ae16-26db-457b-b3a2-9b66f419240c","Type":"ContainerStarted","Data":"8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0"} Jul 21 17:30:31.102709 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:31.102674 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:31.102906 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:31.102886 2562 patch_prober.go:28] interesting pod/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 21 17:30:31.102952 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:31.102932 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 21 17:30:32.102477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:32.102438 2562 patch_prober.go:28] interesting pod/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 21 17:30:32.102885 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:32.102499 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 21 17:30:33.102364 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:33.102330 2562 patch_prober.go:28] interesting pod/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 21 17:30:33.102580 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:33.102388 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 21 17:30:34.102879 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:34.102836 2562 patch_prober.go:28] interesting pod/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 21 17:30:34.103270 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:34.102914 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 21 17:30:35.105920 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:35.105888 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:35.106388 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:35.106160 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:35.106880 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:35.106862 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:30:57.049300 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.049264 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw"] Jul 21 17:30:57.049886 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.049548 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" containerID="cri-o://8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0" gracePeriod=30 Jul 21 17:30:57.862715 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.862676 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb"] Jul 21 17:30:57.863108 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.863092 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" Jul 21 17:30:57.863156 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.863111 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" Jul 21 17:30:57.863156 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.863123 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" Jul 21 17:30:57.863156 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.863128 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" Jul 21 17:30:57.863156 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.863139 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" Jul 21 17:30:57.863156 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.863144 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" Jul 21 17:30:57.863306 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.863207 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" Jul 21 17:30:57.863306 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.863219 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="803662fa-0a7c-4568-84fb-58e34534cd44" containerName="istio-proxy" Jul 21 17:30:57.867390 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.867371 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:57.874005 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.873982 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2ca71765-openshift-default-dockercfg-pr5cm\"" Jul 21 17:30:57.899013 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.898977 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb"] Jul 21 17:30:57.944552 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.944484 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-certs\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:57.944760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.944559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-envoy\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:57.944760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.944631 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-data\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:57.944760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.944711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/500bacc3-3e26-44e3-abfe-956d0e57387a-istiod-ca-cert\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:57.944760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.944749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-podinfo\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:57.944992 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.944793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-credential-socket\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:57.944992 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.944858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-socket\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:57.944992 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.944892 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-token\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:57.944992 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:57.944973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s286w\" (UniqueName: \"kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-kube-api-access-s286w\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046028 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.045991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-data\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046235 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/500bacc3-3e26-44e3-abfe-956d0e57387a-istiod-ca-cert\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046235 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-podinfo\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046235 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-credential-socket\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046235 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-socket\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046235 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046135 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-token\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046235 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s286w\" (UniqueName: \"kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-kube-api-access-s286w\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046235 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-certs\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046695 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-envoy\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046695 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046454 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-data\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046695 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046602 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-socket\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046695 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046674 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-certs\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046980 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046814 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-credential-socket\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.046980 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.046918 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/500bacc3-3e26-44e3-abfe-956d0e57387a-istiod-ca-cert\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.049201 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.049179 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-envoy\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.049556 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.049536 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-podinfo\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.057571 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.057542 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s286w\" (UniqueName: \"kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-kube-api-access-s286w\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.058411 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.058387 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-token\") pod \"e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.180044 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.179947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:58.336941 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.336913 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb"] Jul 21 17:30:58.339686 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:30:58.339658 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500bacc3_3e26_44e3_abfe_956d0e57387a.slice/crio-e7cb292f7089371533d59b487b268b02de866949bdd25a26890cb9917a71c451 WatchSource:0}: Error finding container e7cb292f7089371533d59b487b268b02de866949bdd25a26890cb9917a71c451: Status 404 returned error can't find the container with id e7cb292f7089371533d59b487b268b02de866949bdd25a26890cb9917a71c451 Jul 21 17:30:58.342634 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.342601 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:30:58.342709 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.342674 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:30:58.342747 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.342710 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:30:58.757646 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.757609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" event={"ID":"500bacc3-3e26-44e3-abfe-956d0e57387a","Type":"ContainerStarted","Data":"e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be"} Jul 21 17:30:58.757865 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.757670 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" event={"ID":"500bacc3-3e26-44e3-abfe-956d0e57387a","Type":"ContainerStarted","Data":"e7cb292f7089371533d59b487b268b02de866949bdd25a26890cb9917a71c451"} Jul 21 17:30:58.786304 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:58.786245 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" podStartSLOduration=1.7862285230000001 podStartE2EDuration="1.786228523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:30:58.78410197 +0000 UTC m=+1760.210928057" watchObservedRunningTime="2026-07-21 17:30:58.786228523 +0000 UTC m=+1760.213054616" Jul 21 17:30:59.180641 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:59.180591 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:59.185936 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:59.185910 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:59.762908 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:59.762872 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:30:59.763964 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:30:59.763943 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:31:02.306185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.306158 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:31:02.388239 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388144 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgc6f\" (UniqueName: \"kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-kube-api-access-dgc6f\") pod \"b6b7ae16-26db-457b-b3a2-9b66f419240c\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " Jul 21 17:31:02.388239 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388183 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-token\") pod \"b6b7ae16-26db-457b-b3a2-9b66f419240c\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " Jul 21 17:31:02.388239 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388208 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-podinfo\") pod \"b6b7ae16-26db-457b-b3a2-9b66f419240c\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " Jul 21 17:31:02.388239 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388237 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-credential-socket\") pod \"b6b7ae16-26db-457b-b3a2-9b66f419240c\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " Jul 21 17:31:02.388858 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388313 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-certs\") pod \"b6b7ae16-26db-457b-b3a2-9b66f419240c\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " Jul 21 17:31:02.388858 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388349 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b7ae16-26db-457b-b3a2-9b66f419240c-istiod-ca-cert\") pod \"b6b7ae16-26db-457b-b3a2-9b66f419240c\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " Jul 21 17:31:02.388858 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388401 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-socket\") pod \"b6b7ae16-26db-457b-b3a2-9b66f419240c\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " Jul 21 17:31:02.388858 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388457 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-data\") pod \"b6b7ae16-26db-457b-b3a2-9b66f419240c\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " Jul 21 17:31:02.388858 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388698 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6b7ae16-26db-457b-b3a2-9b66f419240c" (UID: "b6b7ae16-26db-457b-b3a2-9b66f419240c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:31:02.388858 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388722 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6b7ae16-26db-457b-b3a2-9b66f419240c" (UID: "b6b7ae16-26db-457b-b3a2-9b66f419240c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:31:02.388858 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388756 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6b7ae16-26db-457b-b3a2-9b66f419240c" (UID: "b6b7ae16-26db-457b-b3a2-9b66f419240c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:31:02.388858 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388770 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6b7ae16-26db-457b-b3a2-9b66f419240c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6b7ae16-26db-457b-b3a2-9b66f419240c" (UID: "b6b7ae16-26db-457b-b3a2-9b66f419240c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:31:02.388858 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.388822 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-envoy\") pod \"b6b7ae16-26db-457b-b3a2-9b66f419240c\" (UID: \"b6b7ae16-26db-457b-b3a2-9b66f419240c\") " Jul 21 17:31:02.389494 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.389412 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:02.389494 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.389432 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:02.389494 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.389447 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b7ae16-26db-457b-b3a2-9b66f419240c-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:02.389494 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.389460 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:02.389793 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.389768 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6b7ae16-26db-457b-b3a2-9b66f419240c" (UID: "b6b7ae16-26db-457b-b3a2-9b66f419240c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:31:02.390909 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.390886 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-kube-api-access-dgc6f" (OuterVolumeSpecName: "kube-api-access-dgc6f") pod "b6b7ae16-26db-457b-b3a2-9b66f419240c" (UID: "b6b7ae16-26db-457b-b3a2-9b66f419240c"). InnerVolumeSpecName "kube-api-access-dgc6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:31:02.391028 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.391001 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6b7ae16-26db-457b-b3a2-9b66f419240c" (UID: "b6b7ae16-26db-457b-b3a2-9b66f419240c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:31:02.391091 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.391019 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6b7ae16-26db-457b-b3a2-9b66f419240c" (UID: "b6b7ae16-26db-457b-b3a2-9b66f419240c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:31:02.391215 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.391201 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6b7ae16-26db-457b-b3a2-9b66f419240c" (UID: "b6b7ae16-26db-457b-b3a2-9b66f419240c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:31:02.489975 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.489943 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:02.489975 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.489970 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:02.489975 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.489981 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgc6f\" (UniqueName: \"kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-kube-api-access-dgc6f\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:02.490208 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.489990 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:02.490208 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.489998 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b7ae16-26db-457b-b3a2-9b66f419240c-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:02.782620 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.782492 2562 generic.go:356] "Generic (PLEG): container finished" podID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerID="8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0" exitCode=0 Jul 21 17:31:02.782620 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.782558 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" event={"ID":"b6b7ae16-26db-457b-b3a2-9b66f419240c","Type":"ContainerDied","Data":"8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0"} Jul 21 17:31:02.782620 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.782602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" event={"ID":"b6b7ae16-26db-457b-b3a2-9b66f419240c","Type":"ContainerDied","Data":"2e6b231c3841ce4ab06352c504de6720338322e9c8d22df132fdf4b5bf8afdf5"} Jul 21 17:31:02.782891 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.782624 2562 scope.go:117] "RemoveContainer" containerID="8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0" Jul 21 17:31:02.782891 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.782563 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw" Jul 21 17:31:02.793450 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.793426 2562 scope.go:117] "RemoveContainer" containerID="97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a" Jul 21 17:31:02.802215 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.802192 2562 scope.go:117] "RemoveContainer" containerID="8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0" Jul 21 17:31:02.802538 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:31:02.802497 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0\": container with ID starting with 8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0 not found: ID does not exist" containerID="8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0" Jul 21 17:31:02.802614 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.802554 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0"} err="failed to get container status \"8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0\": rpc error: code = NotFound desc = could not find container \"8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0\": container with ID starting with 8186c4ad387ddc4e1e182fc115fd140d2c82c0aff334c4c43b7eeca80bbc43b0 not found: ID does not exist" Jul 21 17:31:02.802614 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.802574 2562 scope.go:117] "RemoveContainer" containerID="97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a" Jul 21 17:31:02.802845 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:31:02.802826 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a\": container with ID starting with 97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a not found: ID does not exist" containerID="97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a" Jul 21 17:31:02.802884 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.802852 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a"} err="failed to get container status \"97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a\": rpc error: code = NotFound desc = could not find container \"97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a\": container with ID starting with 97bc6357f10d1f8c0dcd818e955bdd1bdda12fa2862395be73c5089a1483c54a not found: ID does not exist" Jul 21 17:31:02.807713 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.807684 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw"] Jul 21 17:31:02.813777 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:02.813745 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4db918c7-openshift-default-678cf7bcbc-ms6mw"] Jul 21 17:31:03.114847 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:03.114812 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" path="/var/lib/kubelet/pods/b6b7ae16-26db-457b-b3a2-9b66f419240c/volumes" Jul 21 17:31:14.683247 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:31:14.683210 2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@4-22440-0.service\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500bacc3_3e26_44e3_abfe_956d0e57387a.slice/crio-e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be.scope\": RecentStats: unable to find data in memory cache]" Jul 21 17:31:14.764628 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:14.764586 2562 patch_prober.go:28] interesting pod/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 21 17:31:14.764805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:14.764652 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 21 17:31:14.848940 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:14.848850 2562 generic.go:356] "Generic (PLEG): container finished" podID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerID="e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be" exitCode=0 Jul 21 17:31:14.848940 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:14.848915 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" event={"ID":"500bacc3-3e26-44e3-abfe-956d0e57387a","Type":"ContainerDied","Data":"e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be"} Jul 21 17:31:14.849289 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:14.849275 2562 scope.go:117] "RemoveContainer" containerID="e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be" Jul 21 17:31:14.850300 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:14.850269 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:31:14.850396 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:14.850338 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:31:14.850396 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:14.850371 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:31:15.856283 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:15.856248 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" event={"ID":"500bacc3-3e26-44e3-abfe-956d0e57387a","Type":"ContainerStarted","Data":"1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151"} Jul 21 17:31:16.180668 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:16.180573 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:31:16.180830 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:16.180770 2562 patch_prober.go:28] interesting pod/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 21 17:31:16.180830 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:16.180821 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 21 17:31:17.180846 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:17.180811 2562 patch_prober.go:28] interesting pod/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 21 17:31:17.181242 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:17.180870 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 21 17:31:18.181010 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:18.180972 2562 patch_prober.go:28] interesting pod/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 21 17:31:18.181398 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:18.181037 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 21 17:31:19.180619 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:19.180579 2562 patch_prober.go:28] interesting pod/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 21 17:31:19.180818 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:19.180654 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 21 17:31:20.180941 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:20.180897 2562 patch_prober.go:28] interesting pod/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 21 17:31:20.181330 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:20.180958 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 21 17:31:21.185386 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:21.185353 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:31:21.185846 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:21.185722 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:31:21.186486 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:21.186469 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:31:39.167248 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:39.167206 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:31:39.171201 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:39.171180 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:31:40.282286 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:40.282241 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb"] Jul 21 17:31:40.282821 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:40.282542 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" containerID="cri-o://1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151" gracePeriod=30 Jul 21 17:31:45.537599 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.537567 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:31:45.618850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.618751 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s286w\" (UniqueName: \"kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-kube-api-access-s286w\") pod \"500bacc3-3e26-44e3-abfe-956d0e57387a\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " Jul 21 17:31:45.618850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.618809 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-token\") pod \"500bacc3-3e26-44e3-abfe-956d0e57387a\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " Jul 21 17:31:45.618850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.618842 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-envoy\") pod \"500bacc3-3e26-44e3-abfe-956d0e57387a\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " Jul 21 17:31:45.619145 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.618933 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-credential-socket\") pod \"500bacc3-3e26-44e3-abfe-956d0e57387a\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " Jul 21 17:31:45.619145 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.618991 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-podinfo\") pod \"500bacc3-3e26-44e3-abfe-956d0e57387a\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " Jul 21 17:31:45.619145 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.619039 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-certs\") pod \"500bacc3-3e26-44e3-abfe-956d0e57387a\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " Jul 21 17:31:45.619145 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.619066 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-socket\") pod \"500bacc3-3e26-44e3-abfe-956d0e57387a\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " Jul 21 17:31:45.619145 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.619100 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/500bacc3-3e26-44e3-abfe-956d0e57387a-istiod-ca-cert\") pod \"500bacc3-3e26-44e3-abfe-956d0e57387a\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " Jul 21 17:31:45.619420 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.619155 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-data\") pod \"500bacc3-3e26-44e3-abfe-956d0e57387a\" (UID: \"500bacc3-3e26-44e3-abfe-956d0e57387a\") " Jul 21 17:31:45.619420 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.619210 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "500bacc3-3e26-44e3-abfe-956d0e57387a" (UID: "500bacc3-3e26-44e3-abfe-956d0e57387a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:31:45.619554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.619455 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "500bacc3-3e26-44e3-abfe-956d0e57387a" (UID: "500bacc3-3e26-44e3-abfe-956d0e57387a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:31:45.619554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.619471 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:45.620230 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.619752 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "500bacc3-3e26-44e3-abfe-956d0e57387a" (UID: "500bacc3-3e26-44e3-abfe-956d0e57387a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:31:45.620230 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.619825 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/500bacc3-3e26-44e3-abfe-956d0e57387a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "500bacc3-3e26-44e3-abfe-956d0e57387a" (UID: "500bacc3-3e26-44e3-abfe-956d0e57387a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:31:45.620740 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.620710 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-data" (OuterVolumeSpecName: "istio-data") pod "500bacc3-3e26-44e3-abfe-956d0e57387a" (UID: "500bacc3-3e26-44e3-abfe-956d0e57387a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:31:45.621422 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.621395 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "500bacc3-3e26-44e3-abfe-956d0e57387a" (UID: "500bacc3-3e26-44e3-abfe-956d0e57387a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:31:45.621422 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.621407 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-token" (OuterVolumeSpecName: "istio-token") pod "500bacc3-3e26-44e3-abfe-956d0e57387a" (UID: "500bacc3-3e26-44e3-abfe-956d0e57387a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:31:45.621422 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.621406 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-kube-api-access-s286w" (OuterVolumeSpecName: "kube-api-access-s286w") pod "500bacc3-3e26-44e3-abfe-956d0e57387a" (UID: "500bacc3-3e26-44e3-abfe-956d0e57387a"). InnerVolumeSpecName "kube-api-access-s286w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:31:45.621605 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.621457 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "500bacc3-3e26-44e3-abfe-956d0e57387a" (UID: "500bacc3-3e26-44e3-abfe-956d0e57387a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:31:45.720585 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.720547 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:45.720585 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.720579 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:45.720585 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.720587 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:45.720585 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.720596 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/500bacc3-3e26-44e3-abfe-956d0e57387a-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:45.720878 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.720606 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:45.720878 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.720614 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s286w\" (UniqueName: \"kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-kube-api-access-s286w\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:45.720878 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.720625 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:45.720878 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:45.720633 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/500bacc3-3e26-44e3-abfe-956d0e57387a-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:31:46.013121 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.013036 2562 generic.go:356] "Generic (PLEG): container finished" podID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerID="1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151" exitCode=0 Jul 21 17:31:46.013121 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.013092 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" Jul 21 17:31:46.013296 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.013139 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" event={"ID":"500bacc3-3e26-44e3-abfe-956d0e57387a","Type":"ContainerDied","Data":"1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151"} Jul 21 17:31:46.013296 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.013200 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb" event={"ID":"500bacc3-3e26-44e3-abfe-956d0e57387a","Type":"ContainerDied","Data":"e7cb292f7089371533d59b487b268b02de866949bdd25a26890cb9917a71c451"} Jul 21 17:31:46.013296 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.013234 2562 scope.go:117] "RemoveContainer" containerID="1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151" Jul 21 17:31:46.023481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.023461 2562 scope.go:117] "RemoveContainer" containerID="e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be" Jul 21 17:31:46.032302 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.032280 2562 scope.go:117] "RemoveContainer" containerID="1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151" Jul 21 17:31:46.033099 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:31:46.033074 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151\": container with ID starting with 1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151 not found: ID does not exist" containerID="1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151" Jul 21 17:31:46.033167 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.033109 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151"} err="failed to get container status \"1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151\": rpc error: code = NotFound desc = could not find container \"1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151\": container with ID starting with 1702f05d8ae959b1671399c40ed00aed502d3f62947c0f0c4df936eccfba3151 not found: ID does not exist" Jul 21 17:31:46.033167 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.033130 2562 scope.go:117] "RemoveContainer" containerID="e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be" Jul 21 17:31:46.033413 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:31:46.033395 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be\": container with ID starting with e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be not found: ID does not exist" containerID="e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be" Jul 21 17:31:46.033468 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.033416 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be"} err="failed to get container status \"e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be\": rpc error: code = NotFound desc = could not find container \"e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be\": container with ID starting with e05845fc7b3238c10268490559730168107b7b79cb1780e0d88e731aede250be not found: ID does not exist" Jul 21 17:31:46.038069 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.038038 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb"] Jul 21 17:31:46.046415 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:46.046382 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2ca71765-openshift-default-686895d48c-vt6vb"] Jul 21 17:31:47.115199 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:31:47.115165 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" path="/var/lib/kubelet/pods/500bacc3-3e26-44e3-abfe-956d0e57387a/volumes" Jul 21 17:33:26.168596 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.168496 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw"] Jul 21 17:33:26.169070 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.169058 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" Jul 21 17:33:26.169120 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.169073 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" Jul 21 17:33:26.169120 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.169089 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" Jul 21 17:33:26.169120 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.169100 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" Jul 21 17:33:26.169120 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.169110 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" Jul 21 17:33:26.169120 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.169118 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" Jul 21 17:33:26.169270 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.169229 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" Jul 21 17:33:26.169270 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.169240 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" Jul 21 17:33:26.169270 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.169249 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" Jul 21 17:33:26.169270 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.169264 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb3662f4-0e5f-434a-b6d9-deeb45ed034f" containerName="istio-proxy" Jul 21 17:33:26.172681 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.172662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.177798 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.177775 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d01307af-openshift-default-dockercfg-22zwq\"" Jul 21 17:33:26.209118 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.209012 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw"] Jul 21 17:33:26.257451 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.257411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-envoy\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.257682 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.257468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istiod-ca-cert\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.257682 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.257571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-data\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.257682 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.257602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-socket\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.257682 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.257636 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h9fn\" (UniqueName: \"kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-kube-api-access-6h9fn\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.257855 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.257760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-certs\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.257855 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.257822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-credential-socket\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.257954 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.257860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-podinfo\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.258010 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.257987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-token\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.358431 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.358393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-certs\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.358431 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.358434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-credential-socket\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.358755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.358456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-podinfo\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.358755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.358484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-token\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.358755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.358504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-envoy\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.358755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.358607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istiod-ca-cert\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.358755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.358662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-data\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.358755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.358695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-socket\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.358755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.358730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h9fn\" (UniqueName: \"kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-kube-api-access-6h9fn\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.359166 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.358968 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-certs\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.359166 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.359012 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-credential-socket\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.359166 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.359127 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-data\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.359282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.359272 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-socket\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.359382 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.359357 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istiod-ca-cert\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.360999 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.360974 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-envoy\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.361793 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.361773 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-podinfo\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.368882 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.368856 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h9fn\" (UniqueName: \"kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-kube-api-access-6h9fn\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.369006 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.368985 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-token\") pod \"e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.494786 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.494693 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:26.651023 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.650996 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw"] Jul 21 17:33:26.652944 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:33:26.652916 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc17f9345_7c36_4565_80eb_9c9c8a5eb239.slice/crio-dfc235d87267198f6b82dbd761d2ae5cc64d432dadcc4346d4bbf74c90ab3e3c WatchSource:0}: Error finding container dfc235d87267198f6b82dbd761d2ae5cc64d432dadcc4346d4bbf74c90ab3e3c: Status 404 returned error can't find the container with id dfc235d87267198f6b82dbd761d2ae5cc64d432dadcc4346d4bbf74c90ab3e3c Jul 21 17:33:26.655063 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.655029 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:33:26.655129 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.655096 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:33:26.655129 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:26.655125 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:33:27.510999 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:27.510961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" event={"ID":"c17f9345-7c36-4565-80eb-9c9c8a5eb239","Type":"ContainerStarted","Data":"65bb2d7305a23c085fc655e708378dcc3366f031f130748d6207dc38d6371711"} Jul 21 17:33:27.511481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:27.511019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" event={"ID":"c17f9345-7c36-4565-80eb-9c9c8a5eb239","Type":"ContainerStarted","Data":"dfc235d87267198f6b82dbd761d2ae5cc64d432dadcc4346d4bbf74c90ab3e3c"} Jul 21 17:33:27.537408 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:27.537352 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" podStartSLOduration=1.537336524 podStartE2EDuration="1.537336524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:33:27.535445403 +0000 UTC m=+1908.962271495" watchObservedRunningTime="2026-07-21 17:33:27.537336524 +0000 UTC m=+1908.964162618" Jul 21 17:33:28.495052 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:28.495010 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:28.500360 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:28.500333 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:28.516551 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:28.516505 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:28.517396 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:28.517379 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:41.594969 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:41.594935 2562 generic.go:356] "Generic (PLEG): container finished" podID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerID="65bb2d7305a23c085fc655e708378dcc3366f031f130748d6207dc38d6371711" exitCode=0 Jul 21 17:33:41.595397 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:41.594995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" event={"ID":"c17f9345-7c36-4565-80eb-9c9c8a5eb239","Type":"ContainerDied","Data":"65bb2d7305a23c085fc655e708378dcc3366f031f130748d6207dc38d6371711"} Jul 21 17:33:41.595397 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:41.595359 2562 scope.go:117] "RemoveContainer" containerID="65bb2d7305a23c085fc655e708378dcc3366f031f130748d6207dc38d6371711" Jul 21 17:33:41.596390 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:41.596360 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:33:41.596440 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:41.596431 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:33:41.596475 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:41.596465 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:33:42.602303 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:42.602264 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" event={"ID":"c17f9345-7c36-4565-80eb-9c9c8a5eb239","Type":"ContainerStarted","Data":"7cec047ea7a6e07e3f3d477cae220e12f7029958ef11234dba2a63082740bea1"} Jul 21 17:33:43.495193 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:43.495155 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:43.496332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:43.496305 2562 patch_prober.go:28] interesting pod/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 21 17:33:43.496469 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:43.496364 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 21 17:33:43.517219 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:43.517185 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:44.495088 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:44.495049 2562 patch_prober.go:28] interesting pod/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 21 17:33:44.495483 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:44.495122 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 21 17:33:45.495256 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:45.495216 2562 patch_prober.go:28] interesting pod/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 21 17:33:45.495678 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:45.495296 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 21 17:33:46.495902 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:46.495862 2562 patch_prober.go:28] interesting pod/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 21 17:33:46.496292 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:46.495930 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 21 17:33:47.500118 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:47.500081 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:33:47.501154 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:33:47.501135 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:34:04.497069 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:04.497034 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw"] Jul 21 17:34:04.497502 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:04.497236 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" containerID="cri-o://7cec047ea7a6e07e3f3d477cae220e12f7029958ef11234dba2a63082740bea1" gracePeriod=30 Jul 21 17:34:09.740034 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.739999 2562 generic.go:356] "Generic (PLEG): container finished" podID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerID="7cec047ea7a6e07e3f3d477cae220e12f7029958ef11234dba2a63082740bea1" exitCode=0 Jul 21 17:34:09.740480 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.740078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" event={"ID":"c17f9345-7c36-4565-80eb-9c9c8a5eb239","Type":"ContainerDied","Data":"7cec047ea7a6e07e3f3d477cae220e12f7029958ef11234dba2a63082740bea1"} Jul 21 17:34:09.740480 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.740141 2562 scope.go:117] "RemoveContainer" containerID="65bb2d7305a23c085fc655e708378dcc3366f031f130748d6207dc38d6371711" Jul 21 17:34:09.769015 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.768993 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:34:09.891936 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.891905 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istiod-ca-cert\") pod \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " Jul 21 17:34:09.892127 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.891944 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h9fn\" (UniqueName: \"kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-kube-api-access-6h9fn\") pod \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " Jul 21 17:34:09.892127 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.891963 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-token\") pod \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " Jul 21 17:34:09.892127 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892014 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-credential-socket\") pod \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " Jul 21 17:34:09.892127 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892031 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-podinfo\") pod \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " Jul 21 17:34:09.892127 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892054 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-data\") pod \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " Jul 21 17:34:09.892127 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892072 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-certs\") pod \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " Jul 21 17:34:09.892127 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892121 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-socket\") pod \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " Jul 21 17:34:09.892423 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892210 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-envoy\") pod \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\" (UID: \"c17f9345-7c36-4565-80eb-9c9c8a5eb239\") " Jul 21 17:34:09.892423 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892396 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c17f9345-7c36-4565-80eb-9c9c8a5eb239" (UID: "c17f9345-7c36-4565-80eb-9c9c8a5eb239"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:34:09.892565 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892412 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c17f9345-7c36-4565-80eb-9c9c8a5eb239" (UID: "c17f9345-7c36-4565-80eb-9c9c8a5eb239"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:34:09.892565 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892540 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c17f9345-7c36-4565-80eb-9c9c8a5eb239" (UID: "c17f9345-7c36-4565-80eb-9c9c8a5eb239"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:34:09.892674 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892599 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c17f9345-7c36-4565-80eb-9c9c8a5eb239" (UID: "c17f9345-7c36-4565-80eb-9c9c8a5eb239"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:34:09.892674 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892627 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:34:09.892674 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.892647 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:34:09.893477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.893447 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-data" (OuterVolumeSpecName: "istio-data") pod "c17f9345-7c36-4565-80eb-9c9c8a5eb239" (UID: "c17f9345-7c36-4565-80eb-9c9c8a5eb239"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:34:09.894540 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.894498 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-kube-api-access-6h9fn" (OuterVolumeSpecName: "kube-api-access-6h9fn") pod "c17f9345-7c36-4565-80eb-9c9c8a5eb239" (UID: "c17f9345-7c36-4565-80eb-9c9c8a5eb239"). InnerVolumeSpecName "kube-api-access-6h9fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:34:09.894662 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.894541 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-token" (OuterVolumeSpecName: "istio-token") pod "c17f9345-7c36-4565-80eb-9c9c8a5eb239" (UID: "c17f9345-7c36-4565-80eb-9c9c8a5eb239"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:34:09.894738 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.894718 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c17f9345-7c36-4565-80eb-9c9c8a5eb239" (UID: "c17f9345-7c36-4565-80eb-9c9c8a5eb239"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:34:09.894782 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.894739 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c17f9345-7c36-4565-80eb-9c9c8a5eb239" (UID: "c17f9345-7c36-4565-80eb-9c9c8a5eb239"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:34:09.993413 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.993380 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:34:09.993413 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.993410 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h9fn\" (UniqueName: \"kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-kube-api-access-6h9fn\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:34:09.993413 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.993421 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:34:09.993413 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.993430 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:34:09.993719 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.993437 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:34:09.993719 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.993445 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:34:09.993719 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:09.993452 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c17f9345-7c36-4565-80eb-9c9c8a5eb239-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:34:10.746831 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:10.746800 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" Jul 21 17:34:10.747323 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:10.746795 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw" event={"ID":"c17f9345-7c36-4565-80eb-9c9c8a5eb239","Type":"ContainerDied","Data":"dfc235d87267198f6b82dbd761d2ae5cc64d432dadcc4346d4bbf74c90ab3e3c"} Jul 21 17:34:10.747323 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:10.746963 2562 scope.go:117] "RemoveContainer" containerID="7cec047ea7a6e07e3f3d477cae220e12f7029958ef11234dba2a63082740bea1" Jul 21 17:34:10.794110 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:10.794077 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw"] Jul 21 17:34:10.801259 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:10.801232 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d01307af-openshift-default-77bf8d9b75-zdnsw"] Jul 21 17:34:11.117237 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:11.117207 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" path="/var/lib/kubelet/pods/c17f9345-7c36-4565-80eb-9c9c8a5eb239/volumes" Jul 21 17:34:26.286206 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.286160 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf"] Jul 21 17:34:26.286784 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.286765 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" Jul 21 17:34:26.286874 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.286788 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" Jul 21 17:34:26.286874 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.286808 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" Jul 21 17:34:26.286874 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.286817 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b7ae16-26db-457b-b3a2-9b66f419240c" containerName="istio-proxy" Jul 21 17:34:26.286874 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.286834 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" Jul 21 17:34:26.286874 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.286843 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" Jul 21 17:34:26.287110 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.286934 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" Jul 21 17:34:26.287110 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.286948 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c17f9345-7c36-4565-80eb-9c9c8a5eb239" containerName="istio-proxy" Jul 21 17:34:26.287110 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.286960 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="500bacc3-3e26-44e3-abfe-956d0e57387a" containerName="istio-proxy" Jul 21 17:34:26.291542 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.291492 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.295259 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.295236 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-28b3afa2-openshift-default-dockercfg-s8hhn\"" Jul 21 17:34:26.306713 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.306688 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf"] Jul 21 17:34:26.330377 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.330339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-token\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.330586 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.330389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-data\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.330586 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.330419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmjnk\" (UniqueName: \"kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-kube-api-access-cmjnk\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.330586 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.330448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c84583-b784-41fe-ad63-44f2b59bd16c-istiod-ca-cert\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.330586 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.330477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-podinfo\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.330586 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.330559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-certs\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.330792 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.330592 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-envoy\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.330792 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.330634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-credential-socket\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.330792 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.330742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-socket\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431207 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-data\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431406 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjnk\" (UniqueName: \"kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-kube-api-access-cmjnk\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431406 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c84583-b784-41fe-ad63-44f2b59bd16c-istiod-ca-cert\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431558 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-podinfo\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431558 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-certs\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431558 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-envoy\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431736 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-credential-socket\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431736 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-socket\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431736 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431696 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-data\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431895 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-token\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.431895 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.431815 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-certs\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.432137 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.432112 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c84583-b784-41fe-ad63-44f2b59bd16c-istiod-ca-cert\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.432248 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.432142 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-socket\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.432313 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.432289 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-credential-socket\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.434136 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.434115 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-podinfo\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.434303 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.434286 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-envoy\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.441405 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.441380 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-token\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.441860 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.441839 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmjnk\" (UniqueName: \"kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-kube-api-access-cmjnk\") pod \"e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.605254 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.605213 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:26.760017 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.759990 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf"] Jul 21 17:34:26.762761 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:34:26.762722 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c84583_b784_41fe_ad63_44f2b59bd16c.slice/crio-9681fe3043cb0098e3764dda4b54f3e154fee1d42a074a3abb31ffa2005d3602 WatchSource:0}: Error finding container 9681fe3043cb0098e3764dda4b54f3e154fee1d42a074a3abb31ffa2005d3602: Status 404 returned error can't find the container with id 9681fe3043cb0098e3764dda4b54f3e154fee1d42a074a3abb31ffa2005d3602 Jul 21 17:34:26.765065 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.765029 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:34:26.765150 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.765101 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:34:26.765150 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.765130 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:34:26.826723 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:26.826693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" event={"ID":"c6c84583-b784-41fe-ad63-44f2b59bd16c","Type":"ContainerStarted","Data":"9681fe3043cb0098e3764dda4b54f3e154fee1d42a074a3abb31ffa2005d3602"} Jul 21 17:34:27.833623 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:27.833586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" event={"ID":"c6c84583-b784-41fe-ad63-44f2b59bd16c","Type":"ContainerStarted","Data":"9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234"} Jul 21 17:34:27.859292 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:27.859239 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" podStartSLOduration=1.859221746 podStartE2EDuration="1.859221746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:34:27.856804947 +0000 UTC m=+1969.283631027" watchObservedRunningTime="2026-07-21 17:34:27.859221746 +0000 UTC m=+1969.286047832" Jul 21 17:34:28.606305 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:28.606268 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:28.611264 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:28.611238 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:28.839394 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:28.839361 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:28.840427 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:28.840406 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:44.581790 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:44.580585 2562 patch_prober.go:28] interesting pod/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:41528->10.132.0.51:15021: read: connection reset by peer" start-of-body= Jul 21 17:34:44.581790 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:44.580647 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:41528->10.132.0.51:15021: read: connection reset by peer" Jul 21 17:34:44.925945 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:44.925838 2562 generic.go:356] "Generic (PLEG): container finished" podID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerID="9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234" exitCode=0 Jul 21 17:34:44.925945 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:44.925898 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" event={"ID":"c6c84583-b784-41fe-ad63-44f2b59bd16c","Type":"ContainerDied","Data":"9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234"} Jul 21 17:34:44.926297 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:44.926280 2562 scope.go:117] "RemoveContainer" containerID="9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234" Jul 21 17:34:44.927237 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:44.927204 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:34:44.927310 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:44.927279 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:34:44.927365 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:44.927310 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:34:45.932224 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:45.932193 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" event={"ID":"c6c84583-b784-41fe-ad63-44f2b59bd16c","Type":"ContainerStarted","Data":"c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b"} Jul 21 17:34:46.605681 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:46.605644 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:46.605924 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:46.605898 2562 patch_prober.go:28] interesting pod/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 21 17:34:46.605974 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:46.605951 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 21 17:34:47.605887 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:47.605850 2562 patch_prober.go:28] interesting pod/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 21 17:34:47.606278 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:47.605913 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 21 17:34:48.606669 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:48.606629 2562 patch_prober.go:28] interesting pod/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 21 17:34:48.607090 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:48.606691 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 21 17:34:49.606475 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:49.606430 2562 patch_prober.go:28] interesting pod/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 21 17:34:49.606696 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:49.606494 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 21 17:34:50.610083 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:50.610047 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:50.610539 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:50.610453 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:34:50.611119 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:34:50.611101 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:36:39.200841 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:39.200809 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:36:39.202189 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:39.202164 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:36:41.935680 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:41.935643 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf"] Jul 21 17:36:41.936082 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:41.935909 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" containerID="cri-o://c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b" gracePeriod=30 Jul 21 17:36:47.209558 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.209449 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:36:47.254645 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.254500 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-podinfo\") pod \"c6c84583-b784-41fe-ad63-44f2b59bd16c\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " Jul 21 17:36:47.254645 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.254581 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-certs\") pod \"c6c84583-b784-41fe-ad63-44f2b59bd16c\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " Jul 21 17:36:47.254876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.254657 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-token\") pod \"c6c84583-b784-41fe-ad63-44f2b59bd16c\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " Jul 21 17:36:47.254876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.254682 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-envoy\") pod \"c6c84583-b784-41fe-ad63-44f2b59bd16c\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " Jul 21 17:36:47.254876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.254711 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c84583-b784-41fe-ad63-44f2b59bd16c-istiod-ca-cert\") pod \"c6c84583-b784-41fe-ad63-44f2b59bd16c\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " Jul 21 17:36:47.254876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.254738 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-socket\") pod \"c6c84583-b784-41fe-ad63-44f2b59bd16c\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " Jul 21 17:36:47.254876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.254766 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-credential-socket\") pod \"c6c84583-b784-41fe-ad63-44f2b59bd16c\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " Jul 21 17:36:47.254876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.254830 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-data\") pod \"c6c84583-b784-41fe-ad63-44f2b59bd16c\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " Jul 21 17:36:47.255177 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.254914 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmjnk\" (UniqueName: \"kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-kube-api-access-cmjnk\") pod \"c6c84583-b784-41fe-ad63-44f2b59bd16c\" (UID: \"c6c84583-b784-41fe-ad63-44f2b59bd16c\") " Jul 21 17:36:47.255901 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.255707 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c6c84583-b784-41fe-ad63-44f2b59bd16c" (UID: "c6c84583-b784-41fe-ad63-44f2b59bd16c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:36:47.256283 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.256062 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c6c84583-b784-41fe-ad63-44f2b59bd16c" (UID: "c6c84583-b784-41fe-ad63-44f2b59bd16c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:36:47.256283 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.256245 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6c84583-b784-41fe-ad63-44f2b59bd16c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c6c84583-b784-41fe-ad63-44f2b59bd16c" (UID: "c6c84583-b784-41fe-ad63-44f2b59bd16c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:36:47.257266 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.256953 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c6c84583-b784-41fe-ad63-44f2b59bd16c" (UID: "c6c84583-b784-41fe-ad63-44f2b59bd16c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:36:47.257266 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.256976 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c6c84583-b784-41fe-ad63-44f2b59bd16c" (UID: "c6c84583-b784-41fe-ad63-44f2b59bd16c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:36:47.258123 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.258028 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c6c84583-b784-41fe-ad63-44f2b59bd16c" (UID: "c6c84583-b784-41fe-ad63-44f2b59bd16c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:36:47.258123 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.258096 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c6c84583-b784-41fe-ad63-44f2b59bd16c" (UID: "c6c84583-b784-41fe-ad63-44f2b59bd16c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:36:47.258290 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.258172 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-kube-api-access-cmjnk" (OuterVolumeSpecName: "kube-api-access-cmjnk") pod "c6c84583-b784-41fe-ad63-44f2b59bd16c" (UID: "c6c84583-b784-41fe-ad63-44f2b59bd16c"). InnerVolumeSpecName "kube-api-access-cmjnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:36:47.259582 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.259552 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6c84583-b784-41fe-ad63-44f2b59bd16c" (UID: "c6c84583-b784-41fe-ad63-44f2b59bd16c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:36:47.356390 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.356341 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:36:47.356390 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.356379 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:36:47.356390 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.356393 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmjnk\" (UniqueName: \"kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-kube-api-access-cmjnk\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:36:47.356706 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.356405 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:36:47.356706 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.356417 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:36:47.356706 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.356427 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:36:47.356706 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.356437 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:36:47.356706 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.356450 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c84583-b784-41fe-ad63-44f2b59bd16c-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:36:47.356706 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.356462 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c84583-b784-41fe-ad63-44f2b59bd16c-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:36:47.551669 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.551634 2562 generic.go:356] "Generic (PLEG): container finished" podID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerID="c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b" exitCode=0 Jul 21 17:36:47.551869 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.551687 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" Jul 21 17:36:47.551869 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.551704 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" event={"ID":"c6c84583-b784-41fe-ad63-44f2b59bd16c","Type":"ContainerDied","Data":"c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b"} Jul 21 17:36:47.551869 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.551748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf" event={"ID":"c6c84583-b784-41fe-ad63-44f2b59bd16c","Type":"ContainerDied","Data":"9681fe3043cb0098e3764dda4b54f3e154fee1d42a074a3abb31ffa2005d3602"} Jul 21 17:36:47.551869 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.551770 2562 scope.go:117] "RemoveContainer" containerID="c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b" Jul 21 17:36:47.565422 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.565397 2562 scope.go:117] "RemoveContainer" containerID="9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234" Jul 21 17:36:47.574543 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.574498 2562 scope.go:117] "RemoveContainer" containerID="c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b" Jul 21 17:36:47.574866 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:36:47.574844 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b\": container with ID starting with c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b not found: ID does not exist" containerID="c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b" Jul 21 17:36:47.574920 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.574877 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b"} err="failed to get container status \"c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b\": rpc error: code = NotFound desc = could not find container \"c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b\": container with ID starting with c8bee00981e8cd9bdc0ad6796e11979a7ecaf189f0cd4d5f1a91e44dcd98289b not found: ID does not exist" Jul 21 17:36:47.574920 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.574895 2562 scope.go:117] "RemoveContainer" containerID="9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234" Jul 21 17:36:47.575162 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:36:47.575142 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234\": container with ID starting with 9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234 not found: ID does not exist" containerID="9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234" Jul 21 17:36:47.575212 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.575169 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234"} err="failed to get container status \"9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234\": rpc error: code = NotFound desc = could not find container \"9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234\": container with ID starting with 9d9192fa4edf5323312c9205fbf44c3f467fc2a727599f1c6e91cb9501f19234 not found: ID does not exist" Jul 21 17:36:47.579115 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.579084 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf"] Jul 21 17:36:47.589693 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:47.589660 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-28b3afa2-openshift-default-5bd6496f4c-tchlf"] Jul 21 17:36:49.114675 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:36:49.114637 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" path="/var/lib/kubelet/pods/c6c84583-b784-41fe-ad63-44f2b59bd16c/volumes" Jul 21 17:37:42.982591 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:42.982556 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd"] Jul 21 17:37:42.983000 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:42.982936 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" Jul 21 17:37:42.983000 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:42.982949 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" Jul 21 17:37:42.983000 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:42.982966 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" Jul 21 17:37:42.983000 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:42.982971 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" Jul 21 17:37:42.983140 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:42.983032 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" Jul 21 17:37:42.983140 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:42.983043 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6c84583-b784-41fe-ad63-44f2b59bd16c" containerName="istio-proxy" Jul 21 17:37:42.986051 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:42.986035 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:42.992817 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:42.992777 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2d0798-openshift-default-dockercfg-cmfsq\"" Jul 21 17:37:43.016303 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.016274 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd"] Jul 21 17:37:43.072454 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.072412 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-data\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.072664 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.072573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-socket\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.072664 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.072612 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istiod-ca-cert\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.072787 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.072694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-envoy\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.072863 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.072773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-credential-socket\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.072863 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.072825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-podinfo\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.072974 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.072867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmxt9\" (UniqueName: \"kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-kube-api-access-fmxt9\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.072974 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.072906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-certs\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.072974 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.072931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-token\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174005 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.173967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-envoy\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-credential-socket\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-podinfo\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmxt9\" (UniqueName: \"kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-kube-api-access-fmxt9\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-certs\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-token\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174463 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-data\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174463 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-socket\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174463 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istiod-ca-cert\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174463 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174444 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-credential-socket\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174743 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174558 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-certs\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.174931 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174841 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-data\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.175028 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.174999 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istiod-ca-cert\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.175094 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.175069 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-socket\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.176834 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.176770 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-envoy\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.176943 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.176838 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-podinfo\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.186242 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.186214 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-token\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.186396 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.186379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmxt9\" (UniqueName: \"kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-kube-api-access-fmxt9\") pod \"e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.297324 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.297290 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:43.455440 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.455370 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd"] Jul 21 17:37:43.457823 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:37:43.457800 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76bb904e_61ca_4c95_aa51_3ba8ea0bf58f.slice/crio-00ef072e2b31fcd8959986ec061acc52897413bd41bbe04c86233ae666bbdb27 WatchSource:0}: Error finding container 00ef072e2b31fcd8959986ec061acc52897413bd41bbe04c86233ae666bbdb27: Status 404 returned error can't find the container with id 00ef072e2b31fcd8959986ec061acc52897413bd41bbe04c86233ae666bbdb27 Jul 21 17:37:43.460016 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.459973 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:37:43.460100 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.460056 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:37:43.460100 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.460087 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:37:43.828196 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.828160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" event={"ID":"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f","Type":"ContainerStarted","Data":"13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9"} Jul 21 17:37:43.828407 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.828219 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" event={"ID":"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f","Type":"ContainerStarted","Data":"00ef072e2b31fcd8959986ec061acc52897413bd41bbe04c86233ae666bbdb27"} Jul 21 17:37:43.855332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:43.855273 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" podStartSLOduration=1.855256875 podStartE2EDuration="1.855256875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:37:43.853479578 +0000 UTC m=+2165.280305672" watchObservedRunningTime="2026-07-21 17:37:43.855256875 +0000 UTC m=+2165.282082968" Jul 21 17:37:44.298270 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:44.298233 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:44.303425 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:44.303402 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:44.833590 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:44.833557 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:44.834570 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:44.834552 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:37:50.956689 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:50.956655 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v"] Jul 21 17:37:50.960606 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:50.960586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:50.964269 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:50.964248 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-892f8e-openshift-default-dockercfg-s8hmj\"" Jul 21 17:37:50.982594 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:50.982567 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v"] Jul 21 17:37:51.052197 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.052163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-socket\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.052411 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.052223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-certs\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.052411 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.052275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-envoy\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.052411 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.052299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-data\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.052411 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.052324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-token\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.052665 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.052451 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-podinfo\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.052665 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.052503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnw4b\" (UniqueName: \"kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-kube-api-access-qnw4b\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.052665 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.052585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istiod-ca-cert\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.052831 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.052703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-credential-socket\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154248 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-socket\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154452 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-certs\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154452 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-envoy\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154452 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-data\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154452 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-token\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154452 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-podinfo\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154452 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnw4b\" (UniqueName: \"kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-kube-api-access-qnw4b\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154779 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istiod-ca-cert\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154779 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-credential-socket\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154779 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154657 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-socket\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154779 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154749 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-data\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154961 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154903 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-credential-socket\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.154961 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.154949 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-certs\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.155304 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.155279 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istiod-ca-cert\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.156916 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.156894 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-envoy\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.157220 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.157202 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-podinfo\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.172618 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.172582 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-token\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.173403 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.173374 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnw4b\" (UniqueName: \"kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-kube-api-access-qnw4b\") pod \"e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.271582 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.271459 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:51.448270 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:37:51.448242 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a17d9bd_93d6_4b27_928e_6c646c3f7d3c.slice/crio-331171bf895ee2d0aa7b566f35c6ef79afe15aa0ec9d02aee01bac4f499c1f38 WatchSource:0}: Error finding container 331171bf895ee2d0aa7b566f35c6ef79afe15aa0ec9d02aee01bac4f499c1f38: Status 404 returned error can't find the container with id 331171bf895ee2d0aa7b566f35c6ef79afe15aa0ec9d02aee01bac4f499c1f38 Jul 21 17:37:51.450550 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.450489 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:37:51.450658 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.450641 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:37:51.450700 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.450678 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:37:51.454094 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.454071 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v"] Jul 21 17:37:51.869391 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.869347 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" event={"ID":"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c","Type":"ContainerStarted","Data":"ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493"} Jul 21 17:37:51.869598 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.869415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" event={"ID":"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c","Type":"ContainerStarted","Data":"331171bf895ee2d0aa7b566f35c6ef79afe15aa0ec9d02aee01bac4f499c1f38"} Jul 21 17:37:51.898687 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:51.898632 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" podStartSLOduration=1.898614203 podStartE2EDuration="1.898614203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:37:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:37:51.896597209 +0000 UTC m=+2173.323423301" watchObservedRunningTime="2026-07-21 17:37:51.898614203 +0000 UTC m=+2173.325440296" Jul 21 17:37:52.272303 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:52.272211 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:52.277610 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:52.277584 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:52.874843 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:52.874807 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:37:52.875712 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:37:52.875687 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:38:00.282908 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:00.282055 2562 patch_prober.go:28] interesting pod/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:36680->10.132.0.52:15021: read: connection reset by peer" start-of-body= Jul 21 17:38:00.282908 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:00.282128 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:36680->10.132.0.52:15021: read: connection reset by peer" Jul 21 17:38:00.921795 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:00.921763 2562 generic.go:356] "Generic (PLEG): container finished" podID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerID="13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9" exitCode=0 Jul 21 17:38:00.921982 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:00.921841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" event={"ID":"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f","Type":"ContainerDied","Data":"13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9"} Jul 21 17:38:00.922320 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:00.922305 2562 scope.go:117] "RemoveContainer" containerID="13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9" Jul 21 17:38:00.923352 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:00.923323 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:38:00.923405 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:00.923393 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:38:00.923440 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:00.923425 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:38:01.936290 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:01.936251 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" event={"ID":"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f","Type":"ContainerStarted","Data":"0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf"} Jul 21 17:38:02.297918 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:02.297878 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:38:02.298285 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:02.298257 2562 patch_prober.go:28] interesting pod/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 21 17:38:02.298390 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:02.298322 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 21 17:38:03.298542 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:03.298491 2562 patch_prober.go:28] interesting pod/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 21 17:38:03.299024 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:03.298591 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 21 17:38:04.298370 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:04.298322 2562 patch_prober.go:28] interesting pod/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 21 17:38:04.298593 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:04.298406 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 21 17:38:05.297734 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:05.297692 2562 patch_prober.go:28] interesting pod/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 21 17:38:05.297954 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:05.297756 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 21 17:38:06.298336 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:06.298296 2562 patch_prober.go:28] interesting pod/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 21 17:38:06.298801 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:06.298358 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 21 17:38:06.969788 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:06.969754 2562 generic.go:356] "Generic (PLEG): container finished" podID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerID="ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493" exitCode=0 Jul 21 17:38:06.969989 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:06.969825 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" event={"ID":"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c","Type":"ContainerDied","Data":"ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493"} Jul 21 17:38:06.970253 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:06.970240 2562 scope.go:117] "RemoveContainer" containerID="ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493" Jul 21 17:38:06.971239 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:06.971209 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:38:06.971341 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:06.971293 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:38:06.971403 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:06.971339 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:38:07.302221 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:07.302191 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:38:07.302775 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:07.302549 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:38:07.303230 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:07.303215 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:38:07.874746 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:07.874709 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:38:07.977859 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:07.977812 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" event={"ID":"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c","Type":"ContainerStarted","Data":"8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f"} Jul 21 17:38:08.272699 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:08.272603 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:38:08.273384 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:08.273359 2562 patch_prober.go:28] interesting pod/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 21 17:38:08.273644 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:08.273608 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 21 17:38:09.272036 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:09.271997 2562 patch_prober.go:28] interesting pod/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 21 17:38:09.272696 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:09.272655 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 21 17:38:10.272049 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:10.272006 2562 patch_prober.go:28] interesting pod/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 21 17:38:10.272548 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:10.272091 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 21 17:38:11.272153 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:11.272113 2562 patch_prober.go:28] interesting pod/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 21 17:38:11.272579 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:11.272176 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 21 17:38:12.276009 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:12.275975 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:38:12.276437 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:12.276360 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:38:12.277278 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:38:12.277258 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:39:41.634377 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:41.634340 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd"] Jul 21 17:39:41.634857 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:41.634591 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" containerID="cri-o://0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf" gracePeriod=30 Jul 21 17:39:46.896332 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.896260 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:39:46.987704 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.987668 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmxt9\" (UniqueName: \"kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-kube-api-access-fmxt9\") pod \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " Jul 21 17:39:46.987891 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.987724 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istiod-ca-cert\") pod \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " Jul 21 17:39:46.987891 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.987752 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-envoy\") pod \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " Jul 21 17:39:46.987891 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.987776 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-socket\") pod \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " Jul 21 17:39:46.987891 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.987799 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-certs\") pod \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " Jul 21 17:39:46.987891 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.987825 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-token\") pod \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " Jul 21 17:39:46.987891 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.987875 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-data\") pod \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " Jul 21 17:39:46.988212 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.987936 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-credential-socket\") pod \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " Jul 21 17:39:46.988212 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.988008 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-podinfo\") pod \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\" (UID: \"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f\") " Jul 21 17:39:46.988212 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.988113 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" (UID: "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:39:46.988212 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.988125 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" (UID: "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:39:46.988212 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.988199 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" (UID: "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:39:46.988499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.988338 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" (UID: "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:39:46.988499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.988447 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:39:46.988499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.988466 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:39:46.988499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.988476 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:39:46.988499 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.988503 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:39:46.989253 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.989223 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-data" (OuterVolumeSpecName: "istio-data") pod "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" (UID: "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:39:46.990346 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.990322 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" (UID: "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:39:46.990440 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.990349 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-kube-api-access-fmxt9" (OuterVolumeSpecName: "kube-api-access-fmxt9") pod "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" (UID: "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f"). InnerVolumeSpecName "kube-api-access-fmxt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:39:46.990440 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.990373 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-token" (OuterVolumeSpecName: "istio-token") pod "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" (UID: "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:39:46.990574 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:46.990559 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" (UID: "76bb904e-61ca-4c95-aa51-3ba8ea0bf58f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:39:47.089173 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.089132 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:39:47.089173 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.089164 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:39:47.089173 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.089172 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:39:47.089173 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.089180 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:39:47.089454 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.089189 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmxt9\" (UniqueName: \"kubernetes.io/projected/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f-kube-api-access-fmxt9\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:39:47.470003 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.469971 2562 generic.go:356] "Generic (PLEG): container finished" podID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerID="0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf" exitCode=0 Jul 21 17:39:47.470176 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.470025 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" Jul 21 17:39:47.470176 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.470031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" event={"ID":"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f","Type":"ContainerDied","Data":"0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf"} Jul 21 17:39:47.470176 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.470075 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd" event={"ID":"76bb904e-61ca-4c95-aa51-3ba8ea0bf58f","Type":"ContainerDied","Data":"00ef072e2b31fcd8959986ec061acc52897413bd41bbe04c86233ae666bbdb27"} Jul 21 17:39:47.470176 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.470096 2562 scope.go:117] "RemoveContainer" containerID="0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf" Jul 21 17:39:47.482286 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.482265 2562 scope.go:117] "RemoveContainer" containerID="13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9" Jul 21 17:39:47.491321 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.491297 2562 scope.go:117] "RemoveContainer" containerID="0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf" Jul 21 17:39:47.491692 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:39:47.491671 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf\": container with ID starting with 0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf not found: ID does not exist" containerID="0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf" Jul 21 17:39:47.491760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.491701 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf"} err="failed to get container status \"0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf\": rpc error: code = NotFound desc = could not find container \"0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf\": container with ID starting with 0b55cd8b66ed097c83ce7236c117d0ef31d3f2f099cb0532ca9b88ff67b26baf not found: ID does not exist" Jul 21 17:39:47.491760 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.491720 2562 scope.go:117] "RemoveContainer" containerID="13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9" Jul 21 17:39:47.492029 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:39:47.491995 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9\": container with ID starting with 13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9 not found: ID does not exist" containerID="13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9" Jul 21 17:39:47.492141 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.492028 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9"} err="failed to get container status \"13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9\": rpc error: code = NotFound desc = could not find container \"13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9\": container with ID starting with 13349f94b2f82a01193c75e3e6ee67b66443f334f8bbe209f3c0ac52a23d4af9 not found: ID does not exist" Jul 21 17:39:47.494852 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.494827 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd"] Jul 21 17:39:47.507272 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:47.507244 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2d0798-openshift-default-98fbc7b9c-7twfd"] Jul 21 17:39:49.116104 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:39:49.116066 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" path="/var/lib/kubelet/pods/76bb904e-61ca-4c95-aa51-3ba8ea0bf58f/volumes" Jul 21 17:40:04.578688 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:04.578648 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v"] Jul 21 17:40:04.579189 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:04.578881 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" containerID="cri-o://8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f" gracePeriod=30 Jul 21 17:40:05.522668 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.522626 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj"] Jul 21 17:40:05.523228 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.523213 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" Jul 21 17:40:05.523288 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.523232 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" Jul 21 17:40:05.523288 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.523250 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" Jul 21 17:40:05.523288 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.523259 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" Jul 21 17:40:05.523378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.523362 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" Jul 21 17:40:05.523378 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.523374 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="76bb904e-61ca-4c95-aa51-3ba8ea0bf58f" containerName="istio-proxy" Jul 21 17:40:05.528089 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.528063 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.531314 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.531286 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-32299c-openshift-default-dockercfg-hmqz2\"" Jul 21 17:40:05.549642 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.549606 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj"] Jul 21 17:40:05.562218 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.562180 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-socket\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.562678 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.562645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-certs\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.562780 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.562742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-envoy\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.562853 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.562780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28214289-48db-42df-9ea8-cd7b2c49223c-istiod-ca-cert\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.562853 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.562821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mjpp\" (UniqueName: \"kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-kube-api-access-4mjpp\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.562976 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.562856 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-istio-token\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.562976 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.562908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28214289-48db-42df-9ea8-cd7b2c49223c-istio-podinfo\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.563087 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.562950 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-data\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.563087 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.563068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-credential-socket\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.663553 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.663500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-data\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.663563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-credential-socket\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.663616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-socket\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.663647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-certs\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.663707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-envoy\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.663733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28214289-48db-42df-9ea8-cd7b2c49223c-istiod-ca-cert\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.663757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mjpp\" (UniqueName: \"kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-kube-api-access-4mjpp\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.663786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-istio-token\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.663847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28214289-48db-42df-9ea8-cd7b2c49223c-istio-podinfo\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664404 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.664052 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-data\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664466 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.664399 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-certs\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664686 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.664640 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-socket\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.664686 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.664678 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28214289-48db-42df-9ea8-cd7b2c49223c-istiod-ca-cert\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.665175 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.665150 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-credential-socket\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.666725 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.666704 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-envoy\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.667026 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.667003 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28214289-48db-42df-9ea8-cd7b2c49223c-istio-podinfo\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.677743 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.677712 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mjpp\" (UniqueName: \"kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-kube-api-access-4mjpp\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.679501 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.679476 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-istio-token\") pod \"e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.839624 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.839594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:05.998841 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:05.998816 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj"] Jul 21 17:40:06.000793 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:40:06.000761 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28214289_48db_42df_9ea8_cd7b2c49223c.slice/crio-5b0518231480ad569fbefdb610aa1884124d33c657a9661dbcd9725aac8045be WatchSource:0}: Error finding container 5b0518231480ad569fbefdb610aa1884124d33c657a9661dbcd9725aac8045be: Status 404 returned error can't find the container with id 5b0518231480ad569fbefdb610aa1884124d33c657a9661dbcd9725aac8045be Jul 21 17:40:06.002907 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:06.002866 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:06.002993 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:06.002937 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:06.002993 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:06.002971 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:06.571820 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:06.571784 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" event={"ID":"28214289-48db-42df-9ea8-cd7b2c49223c","Type":"ContainerStarted","Data":"6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264"} Jul 21 17:40:06.572042 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:06.571839 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" event={"ID":"28214289-48db-42df-9ea8-cd7b2c49223c","Type":"ContainerStarted","Data":"5b0518231480ad569fbefdb610aa1884124d33c657a9661dbcd9725aac8045be"} Jul 21 17:40:06.599158 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:06.599102 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" podStartSLOduration=1.5990832849999999 podStartE2EDuration="1.599083285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:40:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:40:06.597280134 +0000 UTC m=+2308.024106228" watchObservedRunningTime="2026-07-21 17:40:06.599083285 +0000 UTC m=+2308.025909379" Jul 21 17:40:06.840327 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:06.840231 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:07.845319 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:07.845288 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:08.584493 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:08.584462 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:08.585733 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:08.585709 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:09.850664 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.850582 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:40:09.902865 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.902828 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-envoy\") pod \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " Jul 21 17:40:09.903060 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.902880 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-podinfo\") pod \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " Jul 21 17:40:09.903060 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.902927 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-certs\") pod \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " Jul 21 17:40:09.903060 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.902945 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-credential-socket\") pod \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " Jul 21 17:40:09.903060 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.903001 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-socket\") pod \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " Jul 21 17:40:09.903060 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.903038 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-token\") pod \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " Jul 21 17:40:09.903325 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.903079 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnw4b\" (UniqueName: \"kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-kube-api-access-qnw4b\") pod \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " Jul 21 17:40:09.903325 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.903124 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-data\") pod \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " Jul 21 17:40:09.903325 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.903146 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istiod-ca-cert\") pod \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\" (UID: \"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c\") " Jul 21 17:40:09.903325 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.903264 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" (UID: "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:40:09.903554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.903452 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:40:09.903554 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.903505 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" (UID: "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:40:09.903679 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.903602 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" (UID: "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:40:09.903679 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.903651 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" (UID: "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:40:09.904376 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.904347 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" (UID: "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:40:09.905666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.905636 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" (UID: "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:40:09.905666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.905652 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" (UID: "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:40:09.905811 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.905670 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" (UID: "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:40:09.905916 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:09.905901 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-kube-api-access-qnw4b" (OuterVolumeSpecName: "kube-api-access-qnw4b") pod "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" (UID: "5a17d9bd-93d6-4b27-928e-6c646c3f7d3c"). InnerVolumeSpecName "kube-api-access-qnw4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:40:10.004360 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.004317 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:40:10.004360 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.004350 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:40:10.004360 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.004359 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnw4b\" (UniqueName: \"kubernetes.io/projected/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-kube-api-access-qnw4b\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:40:10.004360 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.004369 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:40:10.004648 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.004377 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:40:10.004648 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.004385 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:40:10.004648 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.004392 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:40:10.004648 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.004400 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:40:10.596657 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.596619 2562 generic.go:356] "Generic (PLEG): container finished" podID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerID="8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f" exitCode=0 Jul 21 17:40:10.596874 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.596678 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" Jul 21 17:40:10.596874 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.596706 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" event={"ID":"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c","Type":"ContainerDied","Data":"8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f"} Jul 21 17:40:10.596874 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.596760 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v" event={"ID":"5a17d9bd-93d6-4b27-928e-6c646c3f7d3c","Type":"ContainerDied","Data":"331171bf895ee2d0aa7b566f35c6ef79afe15aa0ec9d02aee01bac4f499c1f38"} Jul 21 17:40:10.596874 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.596782 2562 scope.go:117] "RemoveContainer" containerID="8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f" Jul 21 17:40:10.606891 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.606874 2562 scope.go:117] "RemoveContainer" containerID="ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493" Jul 21 17:40:10.615466 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.615445 2562 scope.go:117] "RemoveContainer" containerID="8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f" Jul 21 17:40:10.615781 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:40:10.615759 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f\": container with ID starting with 8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f not found: ID does not exist" containerID="8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f" Jul 21 17:40:10.615914 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.615789 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f"} err="failed to get container status \"8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f\": rpc error: code = NotFound desc = could not find container \"8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f\": container with ID starting with 8fff93fbea473eea3a614fd64eff26e0b58c7ba84402fa114d3af0802e75c31f not found: ID does not exist" Jul 21 17:40:10.615914 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.615808 2562 scope.go:117] "RemoveContainer" containerID="ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493" Jul 21 17:40:10.616036 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:40:10.616020 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493\": container with ID starting with ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493 not found: ID does not exist" containerID="ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493" Jul 21 17:40:10.616086 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.616039 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493"} err="failed to get container status \"ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493\": rpc error: code = NotFound desc = could not find container \"ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493\": container with ID starting with ac66d92c49883004eb04d06502b6d43c65f890bc9d0497410a066009e9cd9493 not found: ID does not exist" Jul 21 17:40:10.644889 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.644855 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v"] Jul 21 17:40:10.663927 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:10.663899 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-892f8e-openshift-default-5bb87fd9bc-whn4v"] Jul 21 17:40:11.116624 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:11.116594 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" path="/var/lib/kubelet/pods/5a17d9bd-93d6-4b27-928e-6c646c3f7d3c/volumes" Jul 21 17:40:13.847274 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.847233 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4"] Jul 21 17:40:13.847896 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.847875 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" Jul 21 17:40:13.847937 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.847902 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" Jul 21 17:40:13.847972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.847936 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" Jul 21 17:40:13.847972 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.847947 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" Jul 21 17:40:13.848077 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.848064 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" Jul 21 17:40:13.848112 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.848086 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a17d9bd-93d6-4b27-928e-6c646c3f7d3c" containerName="istio-proxy" Jul 21 17:40:13.851365 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.851346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:13.854276 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.854252 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-17f82c-openshift-default-dockercfg-6jml4\"" Jul 21 17:40:13.866970 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.866943 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4"] Jul 21 17:40:13.939563 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.939500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-credential-socket\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:13.939563 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.939565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5pmf\" (UniqueName: \"kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-kube-api-access-j5pmf\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:13.939800 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.939591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-certs\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:13.939800 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.939627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/150e5f38-ee7d-491b-8530-139ad1e2f165-istiod-ca-cert\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:13.939800 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.939787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-podinfo\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:13.939951 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.939856 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-token\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:13.939951 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.939895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-data\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:13.939951 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.939924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-socket\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:13.940188 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:13.940163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-envoy\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.040761 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.040724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-credential-socket\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.040948 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.040770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5pmf\" (UniqueName: \"kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-kube-api-access-j5pmf\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.040948 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.040802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-certs\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.040948 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.040860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/150e5f38-ee7d-491b-8530-139ad1e2f165-istiod-ca-cert\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.040948 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.040900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-podinfo\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.040948 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.040942 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-token\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.041231 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.040973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-data\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.041231 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.041006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-socket\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.041231 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.041034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-envoy\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.041231 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.041202 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-credential-socket\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.041471 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.041259 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-certs\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.041471 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.041460 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-data\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.041603 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.041508 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-socket\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.041647 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.041625 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/150e5f38-ee7d-491b-8530-139ad1e2f165-istiod-ca-cert\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.043509 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.043487 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-envoy\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.043945 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.043925 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-podinfo\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.052840 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.052807 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-token\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.053197 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.053177 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5pmf\" (UniqueName: \"kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-kube-api-access-j5pmf\") pod \"e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.164840 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.164738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:14.324044 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.324014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4"] Jul 21 17:40:14.325856 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:40:14.325816 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150e5f38_ee7d_491b_8530_139ad1e2f165.slice/crio-f5afe3147ad29db291bc648cb79d8fb21629182c80b6661d72a027abcc4b3dfa WatchSource:0}: Error finding container f5afe3147ad29db291bc648cb79d8fb21629182c80b6661d72a027abcc4b3dfa: Status 404 returned error can't find the container with id f5afe3147ad29db291bc648cb79d8fb21629182c80b6661d72a027abcc4b3dfa Jul 21 17:40:14.327963 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.327932 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:14.328046 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.327994 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:14.328046 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.328023 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:14.629914 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.629878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" event={"ID":"150e5f38-ee7d-491b-8530-139ad1e2f165","Type":"ContainerStarted","Data":"c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a"} Jul 21 17:40:14.630094 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.629953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" event={"ID":"150e5f38-ee7d-491b-8530-139ad1e2f165","Type":"ContainerStarted","Data":"f5afe3147ad29db291bc648cb79d8fb21629182c80b6661d72a027abcc4b3dfa"} Jul 21 17:40:14.656755 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:14.656679 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" podStartSLOduration=1.656642234 podStartE2EDuration="1.656642234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:40:14.651733546 +0000 UTC m=+2316.078559641" watchObservedRunningTime="2026-07-21 17:40:14.656642234 +0000 UTC m=+2316.083468328" Jul 21 17:40:15.171233 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:15.171201 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:15.175780 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:15.175750 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:15.635602 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:15.635563 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:15.636562 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:15.636539 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:21.672108 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:21.672072 2562 generic.go:356] "Generic (PLEG): container finished" podID="28214289-48db-42df-9ea8-cd7b2c49223c" containerID="6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264" exitCode=0 Jul 21 17:40:21.672562 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:21.672127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" event={"ID":"28214289-48db-42df-9ea8-cd7b2c49223c","Type":"ContainerDied","Data":"6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264"} Jul 21 17:40:21.672562 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:21.672537 2562 scope.go:117] "RemoveContainer" containerID="6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264" Jul 21 17:40:21.673635 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:21.673602 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:21.673745 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:21.673696 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:21.673745 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:21.673733 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:22.679297 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:22.679263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" event={"ID":"28214289-48db-42df-9ea8-cd7b2c49223c","Type":"ContainerStarted","Data":"4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03"} Jul 21 17:40:22.839941 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:22.839898 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:22.841087 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:22.841061 2562 patch_prober.go:28] interesting pod/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 21 17:40:22.841212 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:22.841109 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 21 17:40:23.585422 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:23.585387 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:23.840422 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:23.840325 2562 patch_prober.go:28] interesting pod/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 21 17:40:23.840422 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:23.840387 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 21 17:40:24.840850 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:24.840801 2562 patch_prober.go:28] interesting pod/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 21 17:40:24.841330 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:24.840877 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 21 17:40:25.840778 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:25.840740 2562 patch_prober.go:28] interesting pod/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 21 17:40:25.841058 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:25.841030 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 21 17:40:26.844712 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:26.844671 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:26.848323 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:26.848290 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:40:31.678728 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:31.678630 2562 patch_prober.go:28] interesting pod/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 21 17:40:31.678728 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:31.678698 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 21 17:40:32.741261 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:32.741176 2562 generic.go:356] "Generic (PLEG): container finished" podID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerID="c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a" exitCode=0 Jul 21 17:40:32.741685 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:32.741253 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" event={"ID":"150e5f38-ee7d-491b-8530-139ad1e2f165","Type":"ContainerDied","Data":"c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a"} Jul 21 17:40:32.741729 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:32.741691 2562 scope.go:117] "RemoveContainer" containerID="c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a" Jul 21 17:40:32.742743 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:32.742713 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:32.742876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:32.742794 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:32.742876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:32.742844 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:40:33.751382 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:33.751339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" event={"ID":"150e5f38-ee7d-491b-8530-139ad1e2f165","Type":"ContainerStarted","Data":"52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e"} Jul 21 17:40:34.165584 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:34.165546 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:34.165888 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:34.165602 2562 patch_prober.go:28] interesting pod/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 17:40:34.166043 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:34.166018 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 17:40:35.165873 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:35.165830 2562 patch_prober.go:28] interesting pod/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 17:40:35.166355 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:35.165902 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 17:40:36.168805 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:36.168763 2562 patch_prober.go:28] interesting pod/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 17:40:36.169235 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:36.168849 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 17:40:37.165573 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:37.165507 2562 patch_prober.go:28] interesting pod/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 17:40:37.165905 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:37.165877 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 17:40:38.169202 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:38.169163 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:38.169610 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:38.169432 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:38.170236 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:38.170221 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:40:56.284564 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:56.284501 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj"] Jul 21 17:40:56.285073 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:56.284796 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" containerID="cri-o://4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03" gracePeriod=30 Jul 21 17:40:56.848256 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:56.848212 2562 patch_prober.go:28] interesting pod/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 21 17:40:56.848429 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:40:56.848286 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 17:41:01.548913 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.548840 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:41:01.642866 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.642833 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-data\") pod \"28214289-48db-42df-9ea8-cd7b2c49223c\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " Jul 21 17:41:01.643084 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.642881 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28214289-48db-42df-9ea8-cd7b2c49223c-istio-podinfo\") pod \"28214289-48db-42df-9ea8-cd7b2c49223c\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " Jul 21 17:41:01.643084 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.642905 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mjpp\" (UniqueName: \"kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-kube-api-access-4mjpp\") pod \"28214289-48db-42df-9ea8-cd7b2c49223c\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " Jul 21 17:41:01.643084 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.642930 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-envoy\") pod \"28214289-48db-42df-9ea8-cd7b2c49223c\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " Jul 21 17:41:01.643084 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.642950 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-certs\") pod \"28214289-48db-42df-9ea8-cd7b2c49223c\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " Jul 21 17:41:01.643084 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.642977 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-credential-socket\") pod \"28214289-48db-42df-9ea8-cd7b2c49223c\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " Jul 21 17:41:01.643084 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.643013 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-istio-token\") pod \"28214289-48db-42df-9ea8-cd7b2c49223c\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " Jul 21 17:41:01.643415 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.643101 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28214289-48db-42df-9ea8-cd7b2c49223c-istiod-ca-cert\") pod \"28214289-48db-42df-9ea8-cd7b2c49223c\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " Jul 21 17:41:01.643415 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.643128 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-socket\") pod \"28214289-48db-42df-9ea8-cd7b2c49223c\" (UID: \"28214289-48db-42df-9ea8-cd7b2c49223c\") " Jul 21 17:41:01.643415 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.643351 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28214289-48db-42df-9ea8-cd7b2c49223c" (UID: "28214289-48db-42df-9ea8-cd7b2c49223c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:01.643415 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.643365 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28214289-48db-42df-9ea8-cd7b2c49223c" (UID: "28214289-48db-42df-9ea8-cd7b2c49223c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:01.643666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.643483 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:01.643666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.643502 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:01.643666 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.643610 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28214289-48db-42df-9ea8-cd7b2c49223c" (UID: "28214289-48db-42df-9ea8-cd7b2c49223c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:01.643982 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.643827 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-data" (OuterVolumeSpecName: "istio-data") pod "28214289-48db-42df-9ea8-cd7b2c49223c" (UID: "28214289-48db-42df-9ea8-cd7b2c49223c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:01.644045 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.643997 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28214289-48db-42df-9ea8-cd7b2c49223c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28214289-48db-42df-9ea8-cd7b2c49223c" (UID: "28214289-48db-42df-9ea8-cd7b2c49223c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:41:01.645545 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.645498 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-kube-api-access-4mjpp" (OuterVolumeSpecName: "kube-api-access-4mjpp") pod "28214289-48db-42df-9ea8-cd7b2c49223c" (UID: "28214289-48db-42df-9ea8-cd7b2c49223c"). InnerVolumeSpecName "kube-api-access-4mjpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:41:01.645652 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.645558 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28214289-48db-42df-9ea8-cd7b2c49223c" (UID: "28214289-48db-42df-9ea8-cd7b2c49223c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:01.645652 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.645596 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28214289-48db-42df-9ea8-cd7b2c49223c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28214289-48db-42df-9ea8-cd7b2c49223c" (UID: "28214289-48db-42df-9ea8-cd7b2c49223c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:41:01.645763 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.645744 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-istio-token" (OuterVolumeSpecName: "istio-token") pod "28214289-48db-42df-9ea8-cd7b2c49223c" (UID: "28214289-48db-42df-9ea8-cd7b2c49223c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:41:01.744277 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.744234 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28214289-48db-42df-9ea8-cd7b2c49223c-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:01.744277 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.744271 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mjpp\" (UniqueName: \"kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-kube-api-access-4mjpp\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:01.744277 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.744282 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:01.744575 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.744291 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28214289-48db-42df-9ea8-cd7b2c49223c-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:01.744575 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.744299 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28214289-48db-42df-9ea8-cd7b2c49223c-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:01.744575 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.744306 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:01.744575 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.744314 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28214289-48db-42df-9ea8-cd7b2c49223c-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:01.901034 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.900939 2562 generic.go:356] "Generic (PLEG): container finished" podID="28214289-48db-42df-9ea8-cd7b2c49223c" containerID="4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03" exitCode=0 Jul 21 17:41:01.901034 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.901002 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" Jul 21 17:41:01.901266 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.901028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" event={"ID":"28214289-48db-42df-9ea8-cd7b2c49223c","Type":"ContainerDied","Data":"4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03"} Jul 21 17:41:01.901266 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.901084 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj" event={"ID":"28214289-48db-42df-9ea8-cd7b2c49223c","Type":"ContainerDied","Data":"5b0518231480ad569fbefdb610aa1884124d33c657a9661dbcd9725aac8045be"} Jul 21 17:41:01.901266 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.901106 2562 scope.go:117] "RemoveContainer" containerID="4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03" Jul 21 17:41:01.910985 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.910966 2562 scope.go:117] "RemoveContainer" containerID="6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264" Jul 21 17:41:01.919775 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.919750 2562 scope.go:117] "RemoveContainer" containerID="4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03" Jul 21 17:41:01.920083 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:41:01.920059 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03\": container with ID starting with 4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03 not found: ID does not exist" containerID="4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03" Jul 21 17:41:01.920164 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.920091 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03"} err="failed to get container status \"4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03\": rpc error: code = NotFound desc = could not find container \"4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03\": container with ID starting with 4096686aa0a9e1f178a054fbbaf3330b3fb98d94d786e57ba5f0f824391e5b03 not found: ID does not exist" Jul 21 17:41:01.920164 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.920109 2562 scope.go:117] "RemoveContainer" containerID="6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264" Jul 21 17:41:01.920384 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:41:01.920363 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264\": container with ID starting with 6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264 not found: ID does not exist" containerID="6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264" Jul 21 17:41:01.920423 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.920391 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264"} err="failed to get container status \"6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264\": rpc error: code = NotFound desc = could not find container \"6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264\": container with ID starting with 6ef1ba1e2c7363eeddb2cebe2d83cc878c9141579dac1c99eedc6894b2944264 not found: ID does not exist" Jul 21 17:41:01.927563 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.927531 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj"] Jul 21 17:41:01.932200 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:01.932171 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-32299c-openshift-default-d7d5f477f-pzbxj"] Jul 21 17:41:03.115282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:03.115247 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" path="/var/lib/kubelet/pods/28214289-48db-42df-9ea8-cd7b2c49223c/volumes" Jul 21 17:41:23.590879 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:23.590844 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4"] Jul 21 17:41:23.591412 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:23.591058 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" containerID="cri-o://52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e" gracePeriod=30 Jul 21 17:41:24.483303 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.483265 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc"] Jul 21 17:41:24.483725 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.483712 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" Jul 21 17:41:24.483783 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.483728 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" Jul 21 17:41:24.483783 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.483747 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" Jul 21 17:41:24.483783 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.483752 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" Jul 21 17:41:24.483882 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.483817 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" Jul 21 17:41:24.483882 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.483828 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="28214289-48db-42df-9ea8-cd7b2c49223c" containerName="istio-proxy" Jul 21 17:41:24.487063 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.487046 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.490270 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.490239 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-6fedc9-openshift-default-dockercfg-glmvl\"" Jul 21 17:41:24.511135 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.511098 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc"] Jul 21 17:41:24.564658 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.564618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e12d81-a357-4610-a5ca-1420c360e541-istio-podinfo\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.564876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.564721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-envoy\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.564876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.564756 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzlf7\" (UniqueName: \"kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-kube-api-access-jzlf7\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.564876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.564781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-socket\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.564876 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.564847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-istio-token\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.565165 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.564877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-credential-socket\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.565165 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.564925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-data\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.565165 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.564979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e12d81-a357-4610-a5ca-1420c360e541-istiod-ca-cert\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.565165 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.565010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-certs\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.665832 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.665793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzlf7\" (UniqueName: \"kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-kube-api-access-jzlf7\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.665840 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-socket\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.665893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-istio-token\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.665923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-credential-socket\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.665965 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-data\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.666010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e12d81-a357-4610-a5ca-1420c360e541-istiod-ca-cert\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.666041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-certs\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.666118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e12d81-a357-4610-a5ca-1420c360e541-istio-podinfo\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666282 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.666150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-envoy\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666758 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.666294 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-socket\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666758 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.666338 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-credential-socket\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666758 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.666554 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-certs\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666758 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.666608 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-data\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.666935 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.666793 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e12d81-a357-4610-a5ca-1420c360e541-istiod-ca-cert\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.668852 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.668812 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-envoy\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.669007 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.668990 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e12d81-a357-4610-a5ca-1420c360e541-istio-podinfo\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.675635 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.675609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-istio-token\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.675795 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.675768 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzlf7\" (UniqueName: \"kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-kube-api-access-jzlf7\") pod \"e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.797402 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.797364 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:24.948788 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.948755 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc"] Jul 21 17:41:24.950801 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:41:24.950774 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e12d81_a357_4610_a5ca_1420c360e541.slice/crio-88d68b079319b1e1f9467bec711c384186e8eed5b7c736c1c39ed2bcd9b21931 WatchSource:0}: Error finding container 88d68b079319b1e1f9467bec711c384186e8eed5b7c736c1c39ed2bcd9b21931: Status 404 returned error can't find the container with id 88d68b079319b1e1f9467bec711c384186e8eed5b7c736c1c39ed2bcd9b21931 Jul 21 17:41:24.953385 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.953353 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:24.953468 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.953420 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:24.953468 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:24.953447 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:25.018980 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:25.018943 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" event={"ID":"07e12d81-a357-4610-a5ca-1420c360e541","Type":"ContainerStarted","Data":"88d68b079319b1e1f9467bec711c384186e8eed5b7c736c1c39ed2bcd9b21931"} Jul 21 17:41:26.026020 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:26.025984 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" event={"ID":"07e12d81-a357-4610-a5ca-1420c360e541","Type":"ContainerStarted","Data":"de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f"} Jul 21 17:41:26.054076 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:26.054015 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" podStartSLOduration=2.054000416 podStartE2EDuration="2.054000416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:41:26.051286368 +0000 UTC m=+2387.478112461" watchObservedRunningTime="2026-07-21 17:41:26.054000416 +0000 UTC m=+2387.480826508" Jul 21 17:41:26.798185 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:26.798142 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:26.804197 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:26.804155 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:27.030855 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:27.030822 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:27.031854 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:27.031830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:28.850698 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.850665 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:41:28.911577 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.911494 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-data\") pod \"150e5f38-ee7d-491b-8530-139ad1e2f165\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " Jul 21 17:41:28.911577 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.911565 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-credential-socket\") pod \"150e5f38-ee7d-491b-8530-139ad1e2f165\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " Jul 21 17:41:28.911767 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.911603 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/150e5f38-ee7d-491b-8530-139ad1e2f165-istiod-ca-cert\") pod \"150e5f38-ee7d-491b-8530-139ad1e2f165\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " Jul 21 17:41:28.911767 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.911659 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5pmf\" (UniqueName: \"kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-kube-api-access-j5pmf\") pod \"150e5f38-ee7d-491b-8530-139ad1e2f165\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " Jul 21 17:41:28.911767 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.911678 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-podinfo\") pod \"150e5f38-ee7d-491b-8530-139ad1e2f165\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " Jul 21 17:41:28.911767 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.911718 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-certs\") pod \"150e5f38-ee7d-491b-8530-139ad1e2f165\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " Jul 21 17:41:28.911767 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.911738 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-socket\") pod \"150e5f38-ee7d-491b-8530-139ad1e2f165\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " Jul 21 17:41:28.911996 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.911829 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-token\") pod \"150e5f38-ee7d-491b-8530-139ad1e2f165\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " Jul 21 17:41:28.911996 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.911854 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-envoy\") pod \"150e5f38-ee7d-491b-8530-139ad1e2f165\" (UID: \"150e5f38-ee7d-491b-8530-139ad1e2f165\") " Jul 21 17:41:28.911996 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.911854 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "150e5f38-ee7d-491b-8530-139ad1e2f165" (UID: "150e5f38-ee7d-491b-8530-139ad1e2f165"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:28.912147 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.912051 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "150e5f38-ee7d-491b-8530-139ad1e2f165" (UID: "150e5f38-ee7d-491b-8530-139ad1e2f165"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:28.912147 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.912093 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/150e5f38-ee7d-491b-8530-139ad1e2f165-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "150e5f38-ee7d-491b-8530-139ad1e2f165" (UID: "150e5f38-ee7d-491b-8530-139ad1e2f165"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:41:28.912274 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.912249 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "150e5f38-ee7d-491b-8530-139ad1e2f165" (UID: "150e5f38-ee7d-491b-8530-139ad1e2f165"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:28.912383 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.912353 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:28.912383 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.912378 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:28.912542 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.912394 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/150e5f38-ee7d-491b-8530-139ad1e2f165-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:28.912542 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.912353 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-data" (OuterVolumeSpecName: "istio-data") pod "150e5f38-ee7d-491b-8530-139ad1e2f165" (UID: "150e5f38-ee7d-491b-8530-139ad1e2f165"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:28.914152 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.914119 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "150e5f38-ee7d-491b-8530-139ad1e2f165" (UID: "150e5f38-ee7d-491b-8530-139ad1e2f165"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:41:28.914152 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.914143 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "150e5f38-ee7d-491b-8530-139ad1e2f165" (UID: "150e5f38-ee7d-491b-8530-139ad1e2f165"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:28.914285 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.914195 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-kube-api-access-j5pmf" (OuterVolumeSpecName: "kube-api-access-j5pmf") pod "150e5f38-ee7d-491b-8530-139ad1e2f165" (UID: "150e5f38-ee7d-491b-8530-139ad1e2f165"). InnerVolumeSpecName "kube-api-access-j5pmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:41:28.914407 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:28.914393 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-token" (OuterVolumeSpecName: "istio-token") pod "150e5f38-ee7d-491b-8530-139ad1e2f165" (UID: "150e5f38-ee7d-491b-8530-139ad1e2f165"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:41:29.013714 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.013666 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5pmf\" (UniqueName: \"kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-kube-api-access-j5pmf\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:29.013714 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.013711 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:29.013714 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.013724 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:29.013960 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.013736 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:29.013960 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.013750 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:29.013960 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.013761 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/150e5f38-ee7d-491b-8530-139ad1e2f165-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:41:29.041739 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.041705 2562 generic.go:356] "Generic (PLEG): container finished" podID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerID="52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e" exitCode=0 Jul 21 17:41:29.041943 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.041762 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" Jul 21 17:41:29.041943 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.041802 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" event={"ID":"150e5f38-ee7d-491b-8530-139ad1e2f165","Type":"ContainerDied","Data":"52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e"} Jul 21 17:41:29.041943 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.041860 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4" event={"ID":"150e5f38-ee7d-491b-8530-139ad1e2f165","Type":"ContainerDied","Data":"f5afe3147ad29db291bc648cb79d8fb21629182c80b6661d72a027abcc4b3dfa"} Jul 21 17:41:29.041943 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.041884 2562 scope.go:117] "RemoveContainer" containerID="52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e" Jul 21 17:41:29.052009 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.051993 2562 scope.go:117] "RemoveContainer" containerID="c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a" Jul 21 17:41:29.060877 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.060856 2562 scope.go:117] "RemoveContainer" containerID="52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e" Jul 21 17:41:29.061148 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:41:29.061125 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e\": container with ID starting with 52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e not found: ID does not exist" containerID="52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e" Jul 21 17:41:29.061256 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.061158 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e"} err="failed to get container status \"52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e\": rpc error: code = NotFound desc = could not find container \"52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e\": container with ID starting with 52ce9abda1134fd276113682765959ffb72da0d9120f9bffda4316217bf8dd2e not found: ID does not exist" Jul 21 17:41:29.061256 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.061184 2562 scope.go:117] "RemoveContainer" containerID="c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a" Jul 21 17:41:29.061474 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:41:29.061457 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a\": container with ID starting with c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a not found: ID does not exist" containerID="c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a" Jul 21 17:41:29.061563 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.061480 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a"} err="failed to get container status \"c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a\": rpc error: code = NotFound desc = could not find container \"c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a\": container with ID starting with c5cfcd5dd42ee5c00e394c0eba514a329c3d97fff781c811beaa4c45d615403a not found: ID does not exist" Jul 21 17:41:29.067009 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.066986 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4"] Jul 21 17:41:29.076604 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.076578 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-17f82c-openshift-default-6dbd5cd987-bfch4"] Jul 21 17:41:29.115015 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:29.114978 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" path="/var/lib/kubelet/pods/150e5f38-ee7d-491b-8530-139ad1e2f165/volumes" Jul 21 17:41:33.078672 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.078634 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg"] Jul 21 17:41:33.079167 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.079150 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" Jul 21 17:41:33.079167 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.079165 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" Jul 21 17:41:33.079300 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.079273 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" Jul 21 17:41:33.083928 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.083906 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.086531 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.086501 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-5a36a6-openshift-default-dockercfg-x8pkc\"" Jul 21 17:41:33.095021 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.094996 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg"] Jul 21 17:41:33.151967 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.151919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-token\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.151967 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.151973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-data\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.152244 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.152050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb8w7\" (UniqueName: \"kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-kube-api-access-vb8w7\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.152244 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.152092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-envoy\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.152244 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.152115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59d64e8c-04b8-41e6-80ab-47ef99beda44-istiod-ca-cert\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.152244 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.152133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-podinfo\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.152244 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.152208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-socket\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.152244 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.152240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-credential-socket\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.152599 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.152262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-certs\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.252979 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.252940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-socket\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253214 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253020 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-credential-socket\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253214 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-certs\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253214 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-token\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253214 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-data\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253214 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb8w7\" (UniqueName: \"kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-kube-api-access-vb8w7\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-envoy\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59d64e8c-04b8-41e6-80ab-47ef99beda44-istiod-ca-cert\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253281 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-podinfo\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253389 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-socket\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253431 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-credential-socket\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253770 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253569 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-certs\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.253941 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.253913 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-data\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.254219 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.254193 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59d64e8c-04b8-41e6-80ab-47ef99beda44-istiod-ca-cert\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.255721 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.255703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-envoy\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.256079 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.256062 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-podinfo\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.263488 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.263461 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb8w7\" (UniqueName: \"kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-kube-api-access-vb8w7\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.263862 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.263845 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-token\") pod \"e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.396149 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.396062 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:33.551627 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.551603 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg"] Jul 21 17:41:33.553710 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:41:33.553676 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d64e8c_04b8_41e6_80ab_47ef99beda44.slice/crio-45608777e7e9ff8bd8c19646e71f7427324eaee13dfce4d838c3167b8553c692 WatchSource:0}: Error finding container 45608777e7e9ff8bd8c19646e71f7427324eaee13dfce4d838c3167b8553c692: Status 404 returned error can't find the container with id 45608777e7e9ff8bd8c19646e71f7427324eaee13dfce4d838c3167b8553c692 Jul 21 17:41:33.555946 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.555908 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:33.556045 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.555985 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:33.556045 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:33.556019 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:34.076399 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:34.076358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" event={"ID":"59d64e8c-04b8-41e6-80ab-47ef99beda44","Type":"ContainerStarted","Data":"116e7ccf46c5b21b2044b039f305a944bd5f589a623cb3d11a8c99b95d0b101b"} Jul 21 17:41:34.076585 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:34.076417 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" event={"ID":"59d64e8c-04b8-41e6-80ab-47ef99beda44","Type":"ContainerStarted","Data":"45608777e7e9ff8bd8c19646e71f7427324eaee13dfce4d838c3167b8553c692"} Jul 21 17:41:34.099788 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:34.099729 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" podStartSLOduration=1.099711228 podStartE2EDuration="1.099711228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:41:34.097161398 +0000 UTC m=+2395.523987491" watchObservedRunningTime="2026-07-21 17:41:34.099711228 +0000 UTC m=+2395.526537320" Jul 21 17:41:34.397093 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:34.396999 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:34.402219 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:34.402192 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:35.081962 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:35.081928 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:35.082822 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:35.082793 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:39.238654 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:39.238624 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:41:39.239122 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:39.239028 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:41:43.071844 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:43.071782 2562 patch_prober.go:28] interesting pod/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 21 17:41:43.072545 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:43.072484 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 21 17:41:44.130498 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:44.130464 2562 generic.go:356] "Generic (PLEG): container finished" podID="07e12d81-a357-4610-a5ca-1420c360e541" containerID="de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f" exitCode=0 Jul 21 17:41:44.130958 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:44.130543 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" event={"ID":"07e12d81-a357-4610-a5ca-1420c360e541","Type":"ContainerDied","Data":"de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f"} Jul 21 17:41:44.131004 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:44.130970 2562 scope.go:117] "RemoveContainer" containerID="de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f" Jul 21 17:41:44.131949 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:44.131920 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:44.132043 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:44.131987 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:44.132043 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:44.132019 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:45.136747 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:45.136712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" event={"ID":"07e12d81-a357-4610-a5ca-1420c360e541","Type":"ContainerStarted","Data":"31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc"} Jul 21 17:41:45.799144 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:45.798709 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:45.799144 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:45.798845 2562 patch_prober.go:28] interesting pod/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 21 17:41:45.799144 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:45.798890 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 21 17:41:46.798371 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:46.798323 2562 patch_prober.go:28] interesting pod/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 21 17:41:46.798804 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:46.798402 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 21 17:41:47.798012 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:47.797974 2562 patch_prober.go:28] interesting pod/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 21 17:41:47.798186 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:47.798030 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 21 17:41:48.798477 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:48.798427 2562 patch_prober.go:28] interesting pod/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 21 17:41:48.799015 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:48.798542 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 21 17:41:49.801799 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:49.801763 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:49.802272 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:49.802166 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:49.802925 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:49.802904 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:41:50.520356 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:50.519012 2562 patch_prober.go:28] interesting pod/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:54254->10.132.0.57:15021: read: connection reset by peer" start-of-body= Jul 21 17:41:50.520356 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:50.519072 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:54254->10.132.0.57:15021: read: connection reset by peer" Jul 21 17:41:51.182246 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:51.182212 2562 generic.go:356] "Generic (PLEG): container finished" podID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerID="116e7ccf46c5b21b2044b039f305a944bd5f589a623cb3d11a8c99b95d0b101b" exitCode=0 Jul 21 17:41:51.182652 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:51.182287 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" event={"ID":"59d64e8c-04b8-41e6-80ab-47ef99beda44","Type":"ContainerDied","Data":"116e7ccf46c5b21b2044b039f305a944bd5f589a623cb3d11a8c99b95d0b101b"} Jul 21 17:41:51.182899 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:51.182880 2562 scope.go:117] "RemoveContainer" containerID="116e7ccf46c5b21b2044b039f305a944bd5f589a623cb3d11a8c99b95d0b101b" Jul 21 17:41:51.184175 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:51.184145 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:51.184257 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:51.184212 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:51.184257 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:51.184242 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 21 17:41:52.190072 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:52.190038 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" event={"ID":"59d64e8c-04b8-41e6-80ab-47ef99beda44","Type":"ContainerStarted","Data":"a7d6ebc1c5e5b6e2416dc46e4f43fc108e9cd459cb102f38ac07768034ecb3a3"} Jul 21 17:41:52.396551 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:52.396483 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:52.396783 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:52.396760 2562 patch_prober.go:28] interesting pod/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 21 17:41:52.396837 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:52.396809 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 21 17:41:53.397299 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:53.397256 2562 patch_prober.go:28] interesting pod/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 21 17:41:53.397730 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:53.397330 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 21 17:41:54.396633 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:54.396596 2562 patch_prober.go:28] interesting pod/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 21 17:41:54.396879 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:54.396652 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 21 17:41:55.397288 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:55.397244 2562 patch_prober.go:28] interesting pod/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 21 17:41:55.397807 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:55.397306 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 21 17:41:56.400683 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:56.400652 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:56.401105 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:56.401032 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:41:56.401681 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:41:56.401663 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:46:39.294476 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:46:39.294408 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:46:39.296867 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:46:39.296843 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:48:16.463175 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:16.463096 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc"] Jul 21 17:48:16.463670 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:16.463317 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" containerID="cri-o://31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc" gracePeriod=30 Jul 21 17:48:19.804673 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:19.804626 2562 patch_prober.go:28] interesting pod/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 21 17:48:19.805116 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:19.804689 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 17:48:21.736320 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.736254 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:48:21.885029 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.884982 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzlf7\" (UniqueName: \"kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-kube-api-access-jzlf7\") pod \"07e12d81-a357-4610-a5ca-1420c360e541\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " Jul 21 17:48:21.885029 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885027 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-istio-token\") pod \"07e12d81-a357-4610-a5ca-1420c360e541\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " Jul 21 17:48:21.885290 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885056 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-credential-socket\") pod \"07e12d81-a357-4610-a5ca-1420c360e541\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " Jul 21 17:48:21.885290 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885112 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-envoy\") pod \"07e12d81-a357-4610-a5ca-1420c360e541\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " Jul 21 17:48:21.885290 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885155 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-certs\") pod \"07e12d81-a357-4610-a5ca-1420c360e541\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " Jul 21 17:48:21.885290 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885197 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e12d81-a357-4610-a5ca-1420c360e541-istio-podinfo\") pod \"07e12d81-a357-4610-a5ca-1420c360e541\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " Jul 21 17:48:21.885290 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885224 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-socket\") pod \"07e12d81-a357-4610-a5ca-1420c360e541\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " Jul 21 17:48:21.885290 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885262 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e12d81-a357-4610-a5ca-1420c360e541-istiod-ca-cert\") pod \"07e12d81-a357-4610-a5ca-1420c360e541\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " Jul 21 17:48:21.885639 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885303 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-data\") pod \"07e12d81-a357-4610-a5ca-1420c360e541\" (UID: \"07e12d81-a357-4610-a5ca-1420c360e541\") " Jul 21 17:48:21.885639 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885383 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07e12d81-a357-4610-a5ca-1420c360e541" (UID: "07e12d81-a357-4610-a5ca-1420c360e541"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:48:21.885639 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885468 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07e12d81-a357-4610-a5ca-1420c360e541" (UID: "07e12d81-a357-4610-a5ca-1420c360e541"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:48:21.885802 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885662 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07e12d81-a357-4610-a5ca-1420c360e541" (UID: "07e12d81-a357-4610-a5ca-1420c360e541"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:48:21.885863 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885801 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:21.885863 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.885826 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:21.886276 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.886254 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-data" (OuterVolumeSpecName: "istio-data") pod "07e12d81-a357-4610-a5ca-1420c360e541" (UID: "07e12d81-a357-4610-a5ca-1420c360e541"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:48:21.886366 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.886290 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e12d81-a357-4610-a5ca-1420c360e541-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07e12d81-a357-4610-a5ca-1420c360e541" (UID: "07e12d81-a357-4610-a5ca-1420c360e541"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:48:21.887657 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.887600 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-kube-api-access-jzlf7" (OuterVolumeSpecName: "kube-api-access-jzlf7") pod "07e12d81-a357-4610-a5ca-1420c360e541" (UID: "07e12d81-a357-4610-a5ca-1420c360e541"). InnerVolumeSpecName "kube-api-access-jzlf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:48:21.887770 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.887683 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07e12d81-a357-4610-a5ca-1420c360e541-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07e12d81-a357-4610-a5ca-1420c360e541" (UID: "07e12d81-a357-4610-a5ca-1420c360e541"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:48:21.887987 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.887962 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07e12d81-a357-4610-a5ca-1420c360e541" (UID: "07e12d81-a357-4610-a5ca-1420c360e541"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:48:21.888073 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.888016 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-istio-token" (OuterVolumeSpecName: "istio-token") pod "07e12d81-a357-4610-a5ca-1420c360e541" (UID: "07e12d81-a357-4610-a5ca-1420c360e541"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:48:21.987149 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.987058 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzlf7\" (UniqueName: \"kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-kube-api-access-jzlf7\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:21.987149 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.987095 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e12d81-a357-4610-a5ca-1420c360e541-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:21.987149 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.987104 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:21.987149 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.987111 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e12d81-a357-4610-a5ca-1420c360e541-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:21.987149 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.987119 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:21.987149 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.987127 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e12d81-a357-4610-a5ca-1420c360e541-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:21.987149 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:21.987135 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e12d81-a357-4610-a5ca-1420c360e541-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:22.169173 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.169144 2562 generic.go:356] "Generic (PLEG): container finished" podID="07e12d81-a357-4610-a5ca-1420c360e541" containerID="31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc" exitCode=0 Jul 21 17:48:22.169341 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.169195 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" Jul 21 17:48:22.169341 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.169208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" event={"ID":"07e12d81-a357-4610-a5ca-1420c360e541","Type":"ContainerDied","Data":"31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc"} Jul 21 17:48:22.169341 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.169252 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc" event={"ID":"07e12d81-a357-4610-a5ca-1420c360e541","Type":"ContainerDied","Data":"88d68b079319b1e1f9467bec711c384186e8eed5b7c736c1c39ed2bcd9b21931"} Jul 21 17:48:22.169341 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.169274 2562 scope.go:117] "RemoveContainer" containerID="31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc" Jul 21 17:48:22.178970 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.178949 2562 scope.go:117] "RemoveContainer" containerID="de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f" Jul 21 17:48:22.187454 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.187433 2562 scope.go:117] "RemoveContainer" containerID="31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc" Jul 21 17:48:22.187768 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:48:22.187747 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc\": container with ID starting with 31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc not found: ID does not exist" containerID="31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc" Jul 21 17:48:22.187812 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.187779 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc"} err="failed to get container status \"31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc\": rpc error: code = NotFound desc = could not find container \"31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc\": container with ID starting with 31044465b788c96bd0ebd58fda45990613893139d7e138b741785e119b0cbcbc not found: ID does not exist" Jul 21 17:48:22.187812 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.187798 2562 scope.go:117] "RemoveContainer" containerID="de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f" Jul 21 17:48:22.188029 ip-10-0-136-64 kubenswrapper[2562]: E0721 17:48:22.188008 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f\": container with ID starting with de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f not found: ID does not exist" containerID="de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f" Jul 21 17:48:22.188067 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.188036 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f"} err="failed to get container status \"de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f\": rpc error: code = NotFound desc = could not find container \"de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f\": container with ID starting with de0c72ad63af5318f36feb143b19cb1a901f2a3e3013c2de8161986e3d5b726f not found: ID does not exist" Jul 21 17:48:22.193723 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.193696 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc"] Jul 21 17:48:22.198338 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:22.198314 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-6fedc9-openshift-default-79f6c75bc-8fckc"] Jul 21 17:48:23.114722 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:23.114689 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e12d81-a357-4610-a5ca-1420c360e541" path="/var/lib/kubelet/pods/07e12d81-a357-4610-a5ca-1420c360e541/volumes" Jul 21 17:48:39.145833 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:39.145797 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg"] Jul 21 17:48:39.146301 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:39.146018 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" containerID="cri-o://a7d6ebc1c5e5b6e2416dc46e4f43fc108e9cd459cb102f38ac07768034ecb3a3" gracePeriod=30 Jul 21 17:48:41.403507 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:41.403461 2562 patch_prober.go:28] interesting pod/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 21 17:48:41.403900 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:41.403551 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 17:48:44.289536 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.289482 2562 generic.go:356] "Generic (PLEG): container finished" podID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerID="a7d6ebc1c5e5b6e2416dc46e4f43fc108e9cd459cb102f38ac07768034ecb3a3" exitCode=0 Jul 21 17:48:44.289939 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.289555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" event={"ID":"59d64e8c-04b8-41e6-80ab-47ef99beda44","Type":"ContainerDied","Data":"a7d6ebc1c5e5b6e2416dc46e4f43fc108e9cd459cb102f38ac07768034ecb3a3"} Jul 21 17:48:44.289939 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.289619 2562 scope.go:117] "RemoveContainer" containerID="116e7ccf46c5b21b2044b039f305a944bd5f589a623cb3d11a8c99b95d0b101b" Jul 21 17:48:44.412305 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.412225 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:48:44.503245 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503210 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59d64e8c-04b8-41e6-80ab-47ef99beda44-istiod-ca-cert\") pod \"59d64e8c-04b8-41e6-80ab-47ef99beda44\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " Jul 21 17:48:44.503435 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503297 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-token\") pod \"59d64e8c-04b8-41e6-80ab-47ef99beda44\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " Jul 21 17:48:44.503435 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503386 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-envoy\") pod \"59d64e8c-04b8-41e6-80ab-47ef99beda44\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " Jul 21 17:48:44.503579 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503436 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-credential-socket\") pod \"59d64e8c-04b8-41e6-80ab-47ef99beda44\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " Jul 21 17:48:44.503579 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503462 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-data\") pod \"59d64e8c-04b8-41e6-80ab-47ef99beda44\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " Jul 21 17:48:44.503579 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503482 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb8w7\" (UniqueName: \"kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-kube-api-access-vb8w7\") pod \"59d64e8c-04b8-41e6-80ab-47ef99beda44\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " Jul 21 17:48:44.503579 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503526 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-podinfo\") pod \"59d64e8c-04b8-41e6-80ab-47ef99beda44\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " Jul 21 17:48:44.503579 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503569 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-socket\") pod \"59d64e8c-04b8-41e6-80ab-47ef99beda44\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " Jul 21 17:48:44.503837 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503610 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-certs\") pod \"59d64e8c-04b8-41e6-80ab-47ef99beda44\" (UID: \"59d64e8c-04b8-41e6-80ab-47ef99beda44\") " Jul 21 17:48:44.503837 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503706 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59d64e8c-04b8-41e6-80ab-47ef99beda44" (UID: "59d64e8c-04b8-41e6-80ab-47ef99beda44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:48:44.503958 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.503863 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59d64e8c-04b8-41e6-80ab-47ef99beda44" (UID: "59d64e8c-04b8-41e6-80ab-47ef99beda44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:48:44.504025 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.504005 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59d64e8c-04b8-41e6-80ab-47ef99beda44" (UID: "59d64e8c-04b8-41e6-80ab-47ef99beda44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:48:44.504078 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.504041 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-credential-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:44.504078 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.504060 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-socket\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:44.504189 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.504165 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59d64e8c-04b8-41e6-80ab-47ef99beda44-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59d64e8c-04b8-41e6-80ab-47ef99beda44" (UID: "59d64e8c-04b8-41e6-80ab-47ef99beda44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:48:44.504241 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.504168 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-data" (OuterVolumeSpecName: "istio-data") pod "59d64e8c-04b8-41e6-80ab-47ef99beda44" (UID: "59d64e8c-04b8-41e6-80ab-47ef99beda44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:48:44.506144 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.506094 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59d64e8c-04b8-41e6-80ab-47ef99beda44" (UID: "59d64e8c-04b8-41e6-80ab-47ef99beda44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 17:48:44.506144 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.506108 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-kube-api-access-vb8w7" (OuterVolumeSpecName: "kube-api-access-vb8w7") pod "59d64e8c-04b8-41e6-80ab-47ef99beda44" (UID: "59d64e8c-04b8-41e6-80ab-47ef99beda44"). InnerVolumeSpecName "kube-api-access-vb8w7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:48:44.506322 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.506175 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-token" (OuterVolumeSpecName: "istio-token") pod "59d64e8c-04b8-41e6-80ab-47ef99beda44" (UID: "59d64e8c-04b8-41e6-80ab-47ef99beda44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:48:44.506322 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.506178 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59d64e8c-04b8-41e6-80ab-47ef99beda44" (UID: "59d64e8c-04b8-41e6-80ab-47ef99beda44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:48:44.605365 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.605331 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-token\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:44.605365 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.605361 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-envoy\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:44.605365 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.605370 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-data\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:44.605623 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.605380 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb8w7\" (UniqueName: \"kubernetes.io/projected/59d64e8c-04b8-41e6-80ab-47ef99beda44-kube-api-access-vb8w7\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:44.605623 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.605390 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59d64e8c-04b8-41e6-80ab-47ef99beda44-istio-podinfo\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:44.605623 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.605397 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59d64e8c-04b8-41e6-80ab-47ef99beda44-workload-certs\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:44.605623 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:44.605404 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59d64e8c-04b8-41e6-80ab-47ef99beda44-istiod-ca-cert\") on node \"ip-10-0-136-64.ec2.internal\" DevicePath \"\"" Jul 21 17:48:45.273030 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:45.273003 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jq58n_65e9c902-08f4-4ead-b81e-f45df067c321/manager/0.log" Jul 21 17:48:45.295888 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:45.295853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" event={"ID":"59d64e8c-04b8-41e6-80ab-47ef99beda44","Type":"ContainerDied","Data":"45608777e7e9ff8bd8c19646e71f7427324eaee13dfce4d838c3167b8553c692"} Jul 21 17:48:45.296299 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:45.295915 2562 scope.go:117] "RemoveContainer" containerID="a7d6ebc1c5e5b6e2416dc46e4f43fc108e9cd459cb102f38ac07768034ecb3a3" Jul 21 17:48:45.296299 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:45.295869 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg" Jul 21 17:48:45.317196 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:45.317161 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg"] Jul 21 17:48:45.326239 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:45.326203 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-5a36a6-openshift-default-7dfd5bf487-svpzg"] Jul 21 17:48:45.515176 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:45.515064 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68d5cf45d-fm98t_28eefc4a-657b-449a-8f5c-2f93dbd9c26c/manager/0.log" Jul 21 17:48:45.874887 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:45.874855 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc55bc8b7-2gr45_37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac/copy-manifests/0.log" Jul 21 17:48:45.882856 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:45.882834 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc55bc8b7-2gr45_37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac/manager/0.log" Jul 21 17:48:46.485448 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:46.485417 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d974694cd-2l295_7742a32e-b49c-4ed2-89bc-4c6cb1f6a5ee/maas-api/0.log" Jul 21 17:48:46.602044 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:46.602011 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744235-l5tlh_3ec657d4-58ff-4a54-85ab-e232c61b2c45/cleanup/0.log" Jul 21 17:48:46.935829 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:46.935800 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-9mcx5_8ba09a88-a40f-43fa-aaab-549dca89f710/postgres/0.log" Jul 21 17:48:47.115807 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:47.115773 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" path="/var/lib/kubelet/pods/59d64e8c-04b8-41e6-80ab-47ef99beda44/volumes" Jul 21 17:48:48.426529 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:48.426484 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wprcx_23346d36-2921-49eb-858c-23fcf7030df4/manager/0.log" Jul 21 17:48:49.355171 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:49.355139 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g6rgm_cec55c52-727e-4062-a3a7-aa573d9cdfba/istio-proxy/0.log" Jul 21 17:48:49.811555 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:49.811502 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klnfb_5731c75f-2ccd-41a4-8827-05a6e91f3354/istio-proxy/1.log" Jul 21 17:48:49.931731 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:49.931695 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-v4dsr_d3b8cac7-d482-40aa-bbf2-a34e4bf184eb/payload-pre-processing/0.log" Jul 21 17:48:50.166591 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:50.166486 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69d6dcbc6-52rk5_a86149c7-2cc8-4325-8228-2224094207ce/router/0.log" Jul 21 17:48:50.505422 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:50.505328 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-6mhfv_bfa35b30-ab25-4d9f-9798-050e99644dd6/main/0.log" Jul 21 17:48:50.721835 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:50.721808 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ng2pk_3258f759-baa1-434d-a3bf-cb62a07cd5d8/main/0.log" Jul 21 17:48:59.940128 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:48:59.940093 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9wmh5_2bb9fc30-3e5e-41bb-abfc-11d27086161b/global-pull-secret-syncer/0.log" Jul 21 17:49:00.122065 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:00.122032 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zfhq4_6ae9e8a1-8e64-4c18-a812-aca9b6948847/konnectivity-agent/0.log" Jul 21 17:49:00.173637 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:00.173601 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-64.ec2.internal_7d63a5b170b7d76783b7c341a24c4e00/haproxy/0.log" Jul 21 17:49:05.436490 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:05.436460 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wprcx_23346d36-2921-49eb-858c-23fcf7030df4/manager/0.log" Jul 21 17:49:07.762166 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:07.762127 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-dchw4_06d7cf7a-e354-4bf0-89d3-c3440c3e9555/cluster-monitoring-operator/0.log" Jul 21 17:49:08.060071 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:08.060043 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5z2qw_95211389-a5a3-4793-bb85-3d20b1ee8ae1/node-exporter/0.log" Jul 21 17:49:08.086932 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:08.086903 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5z2qw_95211389-a5a3-4793-bb85-3d20b1ee8ae1/kube-rbac-proxy/0.log" Jul 21 17:49:08.113916 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:08.113887 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5z2qw_95211389-a5a3-4793-bb85-3d20b1ee8ae1/init-textfile/0.log" Jul 21 17:49:10.002106 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.002078 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-n7w78_37365c91-f747-4023-bc82-3fcdf8749a15/networking-console-plugin/0.log" Jul 21 17:49:10.007798 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.007770 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6"] Jul 21 17:49:10.008172 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008157 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" Jul 21 17:49:10.008226 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008173 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" Jul 21 17:49:10.008226 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008186 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" Jul 21 17:49:10.008226 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008194 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" Jul 21 17:49:10.008226 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008212 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" Jul 21 17:49:10.008226 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008217 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" Jul 21 17:49:10.008226 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008227 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" Jul 21 17:49:10.008481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008233 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" Jul 21 17:49:10.008481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008244 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" Jul 21 17:49:10.008481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008249 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" Jul 21 17:49:10.008481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008324 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="150e5f38-ee7d-491b-8530-139ad1e2f165" containerName="istio-proxy" Jul 21 17:49:10.008481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008337 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" Jul 21 17:49:10.008481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008347 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e12d81-a357-4610-a5ca-1420c360e541" containerName="istio-proxy" Jul 21 17:49:10.008481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008358 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" Jul 21 17:49:10.008481 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.008364 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="59d64e8c-04b8-41e6-80ab-47ef99beda44" containerName="istio-proxy" Jul 21 17:49:10.011728 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.011712 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.014465 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.014443 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b76jr\"/\"openshift-service-ca.crt\"" Jul 21 17:49:10.015442 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.015424 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b76jr\"/\"default-dockercfg-4vv7m\"" Jul 21 17:49:10.015569 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.015452 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b76jr\"/\"kube-root-ca.crt\"" Jul 21 17:49:10.022934 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.022908 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6"] Jul 21 17:49:10.149061 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.149014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-proc\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.149258 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.149070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhtws\" (UniqueName: \"kubernetes.io/projected/844f9d18-b6df-4820-81fc-f49965b7e7f6-kube-api-access-bhtws\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.149258 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.149138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-lib-modules\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.149258 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.149196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-sys\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.149363 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.149269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-podres\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.249900 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.249862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-proc\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.249900 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.249905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhtws\" (UniqueName: \"kubernetes.io/projected/844f9d18-b6df-4820-81fc-f49965b7e7f6-kube-api-access-bhtws\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.250113 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.250008 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-proc\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.250113 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.250031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-lib-modules\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.250113 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.250088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-sys\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.250209 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.250156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-podres\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.250246 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.250200 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-lib-modules\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.250246 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.250224 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-sys\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.250310 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.250284 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/844f9d18-b6df-4820-81fc-f49965b7e7f6-podres\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.259225 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.259160 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhtws\" (UniqueName: \"kubernetes.io/projected/844f9d18-b6df-4820-81fc-f49965b7e7f6-kube-api-access-bhtws\") pod \"perf-node-gather-daemonset-bjvs6\" (UID: \"844f9d18-b6df-4820-81fc-f49965b7e7f6\") " pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.322289 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.322247 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:10.468609 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.468581 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6"] Jul 21 17:49:10.470751 ip-10-0-136-64 kubenswrapper[2562]: W0721 17:49:10.470725 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod844f9d18_b6df_4820_81fc_f49965b7e7f6.slice/crio-34c3c6c7fb5a9c7410fc6bb465a0231d0232cbcb1a793a5d6a057080bc720a98 WatchSource:0}: Error finding container 34c3c6c7fb5a9c7410fc6bb465a0231d0232cbcb1a793a5d6a057080bc720a98: Status 404 returned error can't find the container with id 34c3c6c7fb5a9c7410fc6bb465a0231d0232cbcb1a793a5d6a057080bc720a98 Jul 21 17:49:10.712426 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.712387 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/1.log" Jul 21 17:49:10.717944 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:10.717918 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zlwt2_8974afe7-625b-40f6-bb4a-5c9d82359cdc/console-operator/2.log" Jul 21 17:49:11.226800 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:11.226764 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-7d9vn_2dc16e5e-8eaf-4157-9c55-80d0e9b50a74/download-server/0.log" Jul 21 17:49:11.425163 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:11.425125 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" event={"ID":"844f9d18-b6df-4820-81fc-f49965b7e7f6","Type":"ContainerStarted","Data":"2a800ac167ae7258744418f240ad52142fc64f6416b26acd3066629c9c604304"} Jul 21 17:49:11.425401 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:11.425189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" event={"ID":"844f9d18-b6df-4820-81fc-f49965b7e7f6","Type":"ContainerStarted","Data":"34c3c6c7fb5a9c7410fc6bb465a0231d0232cbcb1a793a5d6a057080bc720a98"} Jul 21 17:49:11.425401 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:11.425218 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:11.444610 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:11.444560 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" podStartSLOduration=2.44454488 podStartE2EDuration="2.44454488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:49:11.441899352 +0000 UTC m=+2852.868725458" watchObservedRunningTime="2026-07-21 17:49:11.44454488 +0000 UTC m=+2852.871370973" Jul 21 17:49:11.835629 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:11.835595 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-5z4q8_4381557d-43c7-4dfa-9ee1-4767702c9036/volume-data-source-validator/0.log" Jul 21 17:49:13.023578 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:13.023534 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ntx42_74f5d180-f2a1-4374-9f31-871aa10b67cb/dns/0.log" Jul 21 17:49:13.047605 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:13.047575 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ntx42_74f5d180-f2a1-4374-9f31-871aa10b67cb/kube-rbac-proxy/0.log" Jul 21 17:49:13.075715 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:13.075686 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7mn88_bea7850a-c3ef-4e12-93ad-d45749c5fcb3/dns-node-resolver/0.log" Jul 21 17:49:13.788929 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:13.788897 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dcwzd_1bb84b52-52bc-4234-93c0-fd885a659f48/node-ca/0.log" Jul 21 17:49:14.779923 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:14.779893 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g6rgm_cec55c52-727e-4062-a3a7-aa573d9cdfba/istio-proxy/0.log" Jul 21 17:49:15.041893 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:15.041868 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klnfb_5731c75f-2ccd-41a4-8827-05a6e91f3354/istio-proxy/0.log" Jul 21 17:49:15.068809 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:15.068767 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klnfb_5731c75f-2ccd-41a4-8827-05a6e91f3354/istio-proxy/1.log" Jul 21 17:49:15.109059 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:15.109021 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-v4dsr_d3b8cac7-d482-40aa-bbf2-a34e4bf184eb/payload-pre-processing/0.log" Jul 21 17:49:15.170697 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:15.170662 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69d6dcbc6-52rk5_a86149c7-2cc8-4325-8228-2224094207ce/router/0.log" Jul 21 17:49:15.906351 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:15.906320 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2sbmq_9500322d-e6bc-4636-bc5f-6162ab5a7f15/serve-healthcheck-canary/0.log" Jul 21 17:49:16.449169 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:16.449134 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-v5cw2_1997ec8d-0dca-46b0-99da-b416ea6c50ec/insights-operator/0.log" Jul 21 17:49:16.451325 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:16.451305 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-v5cw2_1997ec8d-0dca-46b0-99da-b416ea6c50ec/insights-operator/1.log" Jul 21 17:49:16.555797 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:16.555766 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ngcdm_c4a26670-77aa-4eac-afc3-f896fbf0e4ab/kube-rbac-proxy/0.log" Jul 21 17:49:16.582232 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:16.582206 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ngcdm_c4a26670-77aa-4eac-afc3-f896fbf0e4ab/exporter/0.log" Jul 21 17:49:16.608269 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:16.608235 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ngcdm_c4a26670-77aa-4eac-afc3-f896fbf0e4ab/extractor/0.log" Jul 21 17:49:17.441022 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:17.440994 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b76jr/perf-node-gather-daemonset-bjvs6" Jul 21 17:49:18.948736 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:18.948713 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jq58n_65e9c902-08f4-4ead-b81e-f45df067c321/manager/0.log" Jul 21 17:49:19.394696 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:19.394668 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-68d5cf45d-fm98t_28eefc4a-657b-449a-8f5c-2f93dbd9c26c/manager/0.log" Jul 21 17:49:19.551351 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:19.551317 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc55bc8b7-2gr45_37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac/manager/0.log" Jul 21 17:49:19.581267 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:19.581233 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc55bc8b7-2gr45_37f6a5e3-5aad-4ef8-9d40-ddb299fa0cac/copy-manifests/0.log" Jul 21 17:49:20.333444 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:20.333407 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g6rgm_cec55c52-727e-4062-a3a7-aa573d9cdfba/istio-proxy/0.log" Jul 21 17:49:20.547356 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:20.547325 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klnfb_5731c75f-2ccd-41a4-8827-05a6e91f3354/istio-proxy/0.log" Jul 21 17:49:20.572994 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:20.572962 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klnfb_5731c75f-2ccd-41a4-8827-05a6e91f3354/istio-proxy/1.log" Jul 21 17:49:20.595088 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:20.595053 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-v4dsr_d3b8cac7-d482-40aa-bbf2-a34e4bf184eb/payload-pre-processing/0.log" Jul 21 17:49:20.633683 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:20.633655 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69d6dcbc6-52rk5_a86149c7-2cc8-4325-8228-2224094207ce/router/0.log" Jul 21 17:49:21.167003 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:21.166968 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f64fdf99-tj2l2_0ff421c9-33bb-43d4-bbd0-9f529b2c8f6b/manager/0.log" Jul 21 17:49:21.889962 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:21.889937 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g6rgm_cec55c52-727e-4062-a3a7-aa573d9cdfba/istio-proxy/0.log" Jul 21 17:49:22.111655 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:22.111621 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klnfb_5731c75f-2ccd-41a4-8827-05a6e91f3354/istio-proxy/0.log" Jul 21 17:49:22.136047 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:22.136015 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-klnfb_5731c75f-2ccd-41a4-8827-05a6e91f3354/istio-proxy/1.log" Jul 21 17:49:22.159044 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:22.158962 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-v4dsr_d3b8cac7-d482-40aa-bbf2-a34e4bf184eb/payload-pre-processing/0.log" Jul 21 17:49:22.207169 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:22.207138 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69d6dcbc6-52rk5_a86149c7-2cc8-4325-8228-2224094207ce/router/0.log" Jul 21 17:49:26.258628 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:26.258590 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-fqvzl_2a2c9009-1651-4a04-a9af-55992b289903/migrator/0.log" Jul 21 17:49:26.283534 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:26.283483 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-fqvzl_2a2c9009-1651-4a04-a9af-55992b289903/graceful-termination/0.log" Jul 21 17:49:26.661442 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:26.661414 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-p5lk7_105321d0-98bd-4ecf-b05b-162f7cde46f4/kube-storage-version-migrator-operator/1.log" Jul 21 17:49:26.662300 ip-10-0-136-64 kubenswrapper[2562]: I0721 17:49:26.662278 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-p5lk7_105321d0-98bd-4ecf-b05b-162f7cde46f4/kube-storage-version-migrator-operator/0.log"