Jul 13 17:32:00.758746 ip-10-0-142-186 systemd[1]: Starting Kubernetes Kubelet... Jul 13 17:32:01.077275 ip-10-0-142-186 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 17:32:01.077275 ip-10-0-142-186 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 17:32:01.077275 ip-10-0-142-186 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 17:32:01.077275 ip-10-0-142-186 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 17:32:01.077275 ip-10-0-142-186 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 17:32:01.077979 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.077894 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 17:32:01.081814 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081797 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:32:01.081814 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081813 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:32:01.081814 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081817 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081820 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081823 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081826 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081828 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081831 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081834 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081836 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081839 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081841 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081845 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081847 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081850 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081852 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081855 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081857 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081860 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081862 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081865 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081868 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:32:01.081901 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081870 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081873 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081877 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081880 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081883 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081886 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081888 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081891 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081894 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081896 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081898 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081901 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081903 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081906 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081909 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081912 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081915 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081917 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081920 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:32:01.082350 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081923 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081925 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081929 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081933 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081936 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081938 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081941 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081943 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081946 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081948 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081950 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081953 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081955 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081958 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081960 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081964 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081966 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081969 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081971 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081974 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:32:01.082803 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081976 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081980 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081984 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081987 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081989 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081992 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081994 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.081997 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082000 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082003 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082005 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082008 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082011 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082014 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082017 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082019 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082023 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082025 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082028 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:32:01.083263 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082030 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082033 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082035 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082037 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082040 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082042 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082045 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082047 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082051 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082054 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082056 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082059 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082062 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082064 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082066 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082069 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082071 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082074 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082076 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082758 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:32:01.083708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082764 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082767 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082770 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082772 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082775 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082777 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082781 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082783 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082786 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082788 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082791 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082793 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082796 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082798 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082801 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082803 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082806 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082809 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082812 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082814 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:32:01.084155 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082818 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082820 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082823 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082826 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082828 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082831 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082833 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082836 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082838 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082841 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082843 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082846 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082848 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082851 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082853 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082856 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082859 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082861 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082864 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082870 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:32:01.084639 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082873 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082876 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082878 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082881 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082884 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082886 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082890 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082895 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082900 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082903 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082906 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082909 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082911 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082914 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082916 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082919 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082921 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082924 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082926 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:32:01.085228 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082929 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082932 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082935 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082937 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082940 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082942 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082944 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082947 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082949 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082951 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082954 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082956 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082959 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082962 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082966 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082969 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082972 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082975 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082978 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:32:01.085696 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082980 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082983 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082985 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082989 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082992 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082994 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082997 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.082999 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083001 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083004 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083006 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083009 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083011 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083014 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083017 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083019 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083021 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083024 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083027 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083029 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:32:01.086136 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083409 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083415 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083418 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083421 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083424 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083427 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083430 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083433 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083435 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083438 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083440 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083443 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083446 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083449 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083451 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083454 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083456 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083475 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083484 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083486 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:32:01.086631 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083489 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083492 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083494 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083497 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083501 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083505 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083508 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083511 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083513 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083516 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083519 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083521 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083524 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083526 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083529 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083532 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083534 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083536 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083539 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:32:01.087113 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083542 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083544 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083547 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083550 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083552 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083555 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083557 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083560 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083564 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083567 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083570 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083574 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083577 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083580 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083583 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083586 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083588 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083590 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083593 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:32:01.087565 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083595 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083598 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083600 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083603 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083606 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083608 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083610 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083613 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083615 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083618 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083621 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083623 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083625 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083630 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083638 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083641 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083644 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083646 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083649 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:32:01.088050 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083651 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083654 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083657 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083659 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083662 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083665 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083668 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083670 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083674 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083677 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083680 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083683 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083685 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083688 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083691 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083694 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083696 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083699 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083702 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083705 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:32:01.088500 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083707 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.083710 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083774 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083780 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083786 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083790 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083795 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083798 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083805 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083810 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083815 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083819 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083822 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083826 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083828 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083833 2581 flags.go:64] FLAG: --cgroup-root="" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083837 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083842 2581 flags.go:64] FLAG: --client-ca-file="" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083844 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083847 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083852 2581 flags.go:64] FLAG: --cluster-domain="" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083854 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083857 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083860 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 17:32:01.088959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083864 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083867 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083870 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083873 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083876 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083879 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083882 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083885 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083888 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083890 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083894 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083897 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083900 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083903 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083905 2581 flags.go:64] FLAG: --enable-server="true" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083908 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083912 2581 flags.go:64] FLAG: --event-burst="100" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083916 2581 flags.go:64] FLAG: --event-qps="50" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083919 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083922 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083925 2581 flags.go:64] FLAG: --eviction-hard="" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083929 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083932 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083935 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083938 2581 flags.go:64] FLAG: --eviction-soft="" Jul 13 17:32:01.089573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083942 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083945 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083947 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083950 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083953 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083956 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083959 2581 flags.go:64] FLAG: --feature-gates="" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083962 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083965 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083968 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083971 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083974 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083977 2581 flags.go:64] FLAG: --help="false" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083980 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083982 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083985 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083988 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083991 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083995 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.083997 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084000 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084003 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084006 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 17:32:01.090183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084008 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084011 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084015 2581 flags.go:64] FLAG: --kube-reserved="" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084018 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084021 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084024 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084026 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084029 2581 flags.go:64] FLAG: --lock-file="" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084031 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084035 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084038 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084043 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084046 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084048 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084051 2581 flags.go:64] FLAG: --logging-format="text" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084054 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084057 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084060 2581 flags.go:64] FLAG: --manifest-url="" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084063 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084067 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084069 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084073 2581 flags.go:64] FLAG: --max-pods="110" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084076 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084079 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084082 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 17:32:01.090772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084085 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084088 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084091 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084094 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084100 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084103 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084106 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084109 2581 flags.go:64] FLAG: --pod-cidr="" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084111 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084117 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084120 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084123 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084126 2581 flags.go:64] FLAG: --port="10250" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084129 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084131 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03000d3506396ee24" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084134 2581 flags.go:64] FLAG: --qos-reserved="" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084138 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084141 2581 flags.go:64] FLAG: --register-node="true" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084144 2581 flags.go:64] FLAG: --register-with-taints="" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084147 2581 flags.go:64] FLAG: --registry-burst="10" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084150 2581 flags.go:64] FLAG: --registry-qps="5" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084152 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084155 2581 flags.go:64] FLAG: --reserved-memory="" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084159 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084162 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 17:32:01.091351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084165 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084167 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084170 2581 flags.go:64] FLAG: --runonce="false" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084174 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084176 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084179 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084182 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084184 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084187 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084190 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084193 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084196 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084198 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084203 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084205 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084208 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084211 2581 flags.go:64] FLAG: --system-cgroups="" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084214 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084219 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084222 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084225 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084229 2581 flags.go:64] FLAG: --tls-min-version="" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084232 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084235 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084238 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 17:32:01.091964 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084240 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084243 2581 flags.go:64] FLAG: --v="2" Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084247 2581 flags.go:64] FLAG: --version="false" Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084251 2581 flags.go:64] FLAG: --vmodule="" Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084254 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.084257 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084366 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084370 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084373 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084376 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084379 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084381 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084384 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084386 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084389 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084391 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084394 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084397 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084399 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084402 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084406 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:32:01.092571 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084409 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084411 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084416 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084419 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084422 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084425 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084428 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084430 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084433 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084436 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084438 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084441 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084443 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084445 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084448 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084451 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084453 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084456 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084472 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084475 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:32:01.093098 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084477 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084480 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084482 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084485 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084487 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084490 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084492 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084495 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084497 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084500 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084503 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084506 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084509 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084511 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084514 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084517 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084520 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084522 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084527 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:32:01.093592 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084530 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084533 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084536 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084538 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084541 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084543 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084546 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084548 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084551 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084554 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084556 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084559 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084561 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084564 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084566 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084570 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084573 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084576 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084579 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084581 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:32:01.094039 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084584 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084586 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084588 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084591 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084595 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084597 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084600 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084603 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084605 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084608 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084610 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084613 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084616 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084619 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084621 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084623 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084626 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084628 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084631 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084633 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:32:01.094538 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084635 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084638 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084640 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084643 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.084646 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.085123 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.091450 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.091475 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.091493 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.091499 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091552 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091558 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091561 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091564 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091567 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:32:01.095004 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091569 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091572 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091574 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091577 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091579 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091582 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091584 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091587 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091589 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091592 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091595 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091597 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091600 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091602 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091604 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091607 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091609 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091612 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091614 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:32:01.095359 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091617 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091619 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091622 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091624 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091627 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091632 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091634 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091637 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091639 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091642 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091644 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091647 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091650 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091652 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091655 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091657 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091659 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091662 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091664 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091666 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:32:01.095825 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091669 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091671 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091674 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091676 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091679 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091681 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091685 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091688 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091691 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091694 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091697 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091699 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091702 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091705 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091708 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091710 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091713 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091716 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091719 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091721 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:32:01.096280 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091724 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091726 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091729 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091731 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091734 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091737 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091740 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091744 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091747 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091749 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091752 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091754 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091757 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091759 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091761 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091764 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091766 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091769 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091771 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:32:01.096769 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091773 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091776 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091778 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091780 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091783 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091785 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091788 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091790 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091793 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091795 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091798 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091801 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091803 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091806 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091809 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:32:01.097223 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091811 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.091816 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091928 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091933 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091936 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091939 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091941 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091944 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091947 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091950 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091952 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091955 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091958 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091960 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091963 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 17:32:01.097641 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091966 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091970 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091972 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091975 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091979 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091983 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091986 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091989 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091991 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091994 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091997 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.091999 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092002 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092004 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092007 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092010 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092013 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092015 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092017 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 17:32:01.098017 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092020 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092022 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092025 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092027 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092030 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092032 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092035 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092037 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092040 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092043 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092045 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092048 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092050 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092053 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092055 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092058 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092060 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092063 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092065 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092068 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 17:32:01.098482 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092070 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092072 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092075 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092077 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092080 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092083 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092086 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092089 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092091 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092094 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092097 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092099 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092102 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092104 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092106 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092109 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092111 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092114 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092116 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 17:32:01.099081 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092119 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092121 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092124 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092126 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092129 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092131 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092133 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092136 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092138 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092141 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092143 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092146 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092149 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092153 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092155 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092158 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092160 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092163 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092165 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 17:32:01.100035 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092168 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092170 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092172 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092175 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092178 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092180 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092183 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092186 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:01.092188 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.092193 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.092289 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.094264 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.095546 2581 server.go:1019] "Starting client certificate rotation" Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.095644 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 17:32:01.100501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.095675 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 17:32:01.100843 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.097729 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 17:32:01.102318 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.102296 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 17:32:01.111780 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.111761 2581 log.go:25] "Validated CRI v1 runtime API" Jul 13 17:32:01.113795 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.113780 2581 log.go:25] "Validated CRI v1 image API" Jul 13 17:32:01.115120 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.115099 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 17:32:01.118698 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.118675 2581 fs.go:135] Filesystem UUIDs: map[096e96ab-95c0-4d07-8b60-eb4add10f6be:/dev/nvme0n1p3 3619f9af-4795-45d7-9900-ba6e91482511:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 13 17:32:01.118764 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.118695 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 17:32:01.121094 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.121073 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 17:32:01.123587 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.123482 2581 manager.go:216] Machine: {Timestamp:2026-07-13 17:32:01.122254109 +0000 UTC m=+0.265591173 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201975 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de9b99b284384d440f28c4585bad2 SystemUUID:ec2de9b9-9b28-4384-d440-f28c4585bad2 BootID:54616f50-1c5d-4b94-880e-dc504ff2122f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:93:ba:d5:b9:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:93:ba:d5:b9:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:23:31:fe:d5:a7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 17:32:01.123587 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.123578 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 17:32:01.123689 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.123654 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 17:32:01.126228 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.126203 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 17:32:01.126369 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.126231 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 17:32:01.126877 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.126867 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 17:32:01.126907 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.126878 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 17:32:01.126907 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.126886 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 17:32:01.127385 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.127376 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 17:32:01.128529 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.128519 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 17:32:01.131199 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.131187 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 13 17:32:01.131304 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.131295 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 17:32:01.131335 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.131325 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 13 17:32:01.131368 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.131339 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 17:32:01.131368 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.131351 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 17:32:01.131368 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.131360 2581 kubelet.go:398] "Adding apiserver pod source" Jul 13 17:32:01.131368 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.131368 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 17:32:01.131713 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.131699 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 17:32:01.131768 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.131724 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 17:32:01.133443 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.133424 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 17:32:01.136321 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.135291 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 17:32:01.136404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136354 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 17:32:01.136661 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136643 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 17:32:01.136772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136666 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 17:32:01.136772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136684 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 17:32:01.136772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136693 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 17:32:01.136772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136704 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 17:32:01.136772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136712 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 17:32:01.136970 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136913 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 17:32:01.136970 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136923 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 17:32:01.136970 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136933 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 17:32:01.136970 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136942 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 17:32:01.137123 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136972 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 17:32:01.137123 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.136993 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 17:32:01.137594 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.137579 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 17:32:01.137669 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.137609 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 17:32:01.140958 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.140941 2581 server.go:1268] "Started kubelet" Jul 13 17:32:01.141081 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.141026 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 17:32:01.141213 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.141105 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 17:32:01.141213 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.141097 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 17:32:01.141854 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.141835 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 17:32:01.141854 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.141838 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 17:32:01.141972 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.141947 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 17:32:01.141860 ip-10-0-142-186 systemd[1]: Started Kubernetes Kubelet. Jul 13 17:32:01.142168 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.142113 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 17:32:01.143006 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.142990 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 13 17:32:01.143925 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.143908 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gglgn" Jul 13 17:32:01.145398 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.144723 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-186.ec2.internal.18c1e9bc03b78ad3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-186.ec2.internal,UID:ip-10-0-142-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-186.ec2.internal,},FirstTimestamp:2026-07-13 17:32:01.140910803 +0000 UTC m=+0.284247870,LastTimestamp:2026-07-13 17:32:01.140910803 +0000 UTC m=+0.284247870,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-186.ec2.internal,}" Jul 13 17:32:01.146087 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.146069 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 17:32:01.148473 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.148444 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 17:32:01.148549 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.148473 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 17:32:01.148549 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.148542 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:01.149165 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149040 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 17:32:01.149165 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149046 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 17:32:01.149165 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149068 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 17:32:01.149331 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149182 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 13 17:32:01.149331 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149190 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 13 17:32:01.149526 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149512 2581 factory.go:153] Registering CRI-O factory Jul 13 17:32:01.149620 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149531 2581 factory.go:223] Registration of the crio container factory successfully Jul 13 17:32:01.149620 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149580 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 17:32:01.149620 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149589 2581 factory.go:55] Registering systemd factory Jul 13 17:32:01.149620 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149598 2581 factory.go:223] Registration of the systemd container factory successfully Jul 13 17:32:01.149620 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149619 2581 factory.go:103] Registering Raw factory Jul 13 17:32:01.149775 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.149631 2581 manager.go:1196] Started watching for new ooms in manager Jul 13 17:32:01.150040 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.150025 2581 manager.go:349] Starting recovery of all containers Jul 13 17:32:01.150114 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.150092 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 17:32:01.151695 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.151669 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gglgn" Jul 13 17:32:01.161667 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.161629 2581 manager.go:354] Recovery completed Jul 13 17:32:01.165435 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.165410 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-186.ec2.internal\" not found" node="ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.166440 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.166428 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:32:01.168336 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.168323 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:32:01.168402 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.168349 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:32:01.168402 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.168359 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:32:01.169702 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.169662 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 17:32:01.169702 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.169674 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 17:32:01.169702 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.169692 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 13 17:32:01.169929 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.169914 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:32:01.170621 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.170602 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:32:01.170689 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.170635 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:32:01.170689 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.170649 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:32:01.170919 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.170906 2581 policy_none.go:49] "None policy: Start" Jul 13 17:32:01.170950 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.170924 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 17:32:01.170950 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.170943 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 17:32:01.171779 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.171766 2581 policy_none.go:47] "Start" Jul 13 17:32:01.210153 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.210012 2581 manager.go:337] "Starting Device Plugin manager" Jul 13 17:32:01.210252 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.210170 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 17:32:01.210252 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.210184 2581 server.go:87] "Starting device plugin registration server" Jul 13 17:32:01.210421 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.210410 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 17:32:01.210477 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.210423 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 17:32:01.210526 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.210513 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 17:32:01.210605 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.210590 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 17:32:01.210605 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.210603 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 17:32:01.211135 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.211116 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 17:32:01.211207 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.211161 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:01.269952 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.269899 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 17:32:01.272032 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.271081 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 17:32:01.272032 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.271115 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 17:32:01.272032 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.271137 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 17:32:01.272032 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.271168 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 17:32:01.273819 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.273799 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:32:01.311030 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.311005 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:32:01.312692 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.312677 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:32:01.312758 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.312706 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:32:01.312758 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.312722 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:32:01.312758 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.312749 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.318712 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.318698 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.318760 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.318718 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-186.ec2.internal\": node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:01.331743 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.331681 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:01.372177 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.372124 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal"] Jul 13 17:32:01.372304 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.372230 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:32:01.373608 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.373592 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:32:01.373685 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.373619 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:32:01.373685 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.373634 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:32:01.375809 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.375797 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:32:01.375922 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.375908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.375959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.375939 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:32:01.376880 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.376860 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:32:01.376961 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.376884 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:32:01.376961 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.376860 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:32:01.376961 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.376919 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:32:01.376961 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.376931 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:32:01.376961 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.376892 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:32:01.379283 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.379269 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.379352 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.379299 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 17:32:01.379967 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.379952 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientMemory" Jul 13 17:32:01.380049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.379983 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 17:32:01.380049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.379995 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeHasSufficientPID" Jul 13 17:32:01.392983 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.392964 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-186.ec2.internal\" not found" node="ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.397346 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.397330 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-186.ec2.internal\" not found" node="ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.432673 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.432645 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:01.450472 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.450433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.450536 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.450480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.450536 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.450498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/065a773ad515b5bc840f4897c38a83d1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-186.ec2.internal\" (UID: \"065a773ad515b5bc840f4897c38a83d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.534559 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.534520 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:01.551750 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.551707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.551750 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.551751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.551937 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.551769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/065a773ad515b5bc840f4897c38a83d1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-186.ec2.internal\" (UID: \"065a773ad515b5bc840f4897c38a83d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.551937 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.551789 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.551937 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.551807 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/065a773ad515b5bc840f4897c38a83d1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-186.ec2.internal\" (UID: \"065a773ad515b5bc840f4897c38a83d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.551937 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.551810 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e01791c68bd38683d67bccbd056d2f10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal\" (UID: \"e01791c68bd38683d67bccbd056d2f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.634864 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.634827 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:01.697061 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.697019 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.700452 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:01.700434 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 13 17:32:01.735541 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.735505 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:01.840788 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.840737 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:01.941996 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:01.941917 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:02.045554 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:02.045519 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:02.096431 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.096386 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 17:32:02.096944 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.096618 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 17:32:02.135213 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.135188 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:32:02.146340 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:02.146316 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:02.155323 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.155280 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 17:27:01 +0000 UTC" deadline="2028-03-19 01:04:51.983922089 +0000 UTC" Jul 13 17:32:02.155323 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.155320 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14743h32m49.828604733s" Jul 13 17:32:02.247269 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:02.247200 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:02.347717 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:02.347668 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:02.370712 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:02.370680 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01791c68bd38683d67bccbd056d2f10.slice/crio-1cba63947b1351a849069f7d1f5ad368e8d0566500cd77e25bcacfe924f4166e WatchSource:0}: Error finding container 1cba63947b1351a849069f7d1f5ad368e8d0566500cd77e25bcacfe924f4166e: Status 404 returned error can't find the container with id 1cba63947b1351a849069f7d1f5ad368e8d0566500cd77e25bcacfe924f4166e Jul 13 17:32:02.375668 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:02.375629 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065a773ad515b5bc840f4897c38a83d1.slice/crio-ff26f0c423734331e860380061fe43d2fa03ddccae0247c72c596f62c2ca0735 WatchSource:0}: Error finding container ff26f0c423734331e860380061fe43d2fa03ddccae0247c72c596f62c2ca0735: Status 404 returned error can't find the container with id ff26f0c423734331e860380061fe43d2fa03ddccae0247c72c596f62c2ca0735 Jul 13 17:32:02.376305 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.376291 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 17:32:02.448856 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:02.448827 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:02.555896 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:02.555817 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-186.ec2.internal\" not found" Jul 13 17:32:02.596583 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.596563 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:32:02.649118 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.649087 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" Jul 13 17:32:02.654667 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.654646 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:32:02.660362 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.660346 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 17:32:02.661228 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.661215 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" Jul 13 17:32:02.670106 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:02.670091 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 17:32:03.132381 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.132346 2581 apiserver.go:52] "Watching apiserver" Jul 13 17:32:03.140905 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.140879 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 17:32:03.141942 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.141919 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-dbxjz","openshift-network-operator/iptables-alerter-22664","kube-system/konnectivity-agent-9h2rs","kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g","openshift-image-registry/node-ca-9gc6l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal","openshift-multus/multus-additional-cni-plugins-m99k8","openshift-ovn-kubernetes/ovnkube-node-n8m7v","kube-system/global-pull-secret-syncer-5ll5w","openshift-cluster-node-tuning-operator/tuned-vsgg7","openshift-dns/node-resolver-zvkj2","openshift-multus/multus-bwshl","openshift-multus/network-metrics-daemon-szztn"] Jul 13 17:32:03.144610 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.144589 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.147081 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.146911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.147184 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.147093 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d5jqr\"" Jul 13 17:32:03.147484 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.147461 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 17:32:03.147591 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.147518 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 17:32:03.147591 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.147582 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 17:32:03.147700 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.147645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 17:32:03.150055 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.149522 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 17:32:03.150055 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.149759 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 17:32:03.150055 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.149804 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vch8s\"" Jul 13 17:32:03.150744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.150376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:03.150744 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.150456 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:03.150744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.150639 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 17:32:03.151119 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.151094 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 17:32:03.152925 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.152907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.155282 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.155251 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.155634 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.155613 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 17:32:03.155736 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.155721 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5jj2x\"" Jul 13 17:32:03.155825 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.155798 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 17:32:03.155959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.155935 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 17:32:03.157931 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.157910 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.158574 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.158552 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 17:32:03.159118 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.159084 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vp779\"" Jul 13 17:32:03.159209 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.159132 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 17:32:03.159209 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.159093 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 17:32:03.160418 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.160397 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 17:32:03.160718 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.160697 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.161567 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.161550 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m5khn\"" Jul 13 17:32:03.162126 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.161699 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 17:32:03.162210 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.161852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-var-lib-cni-bin\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162277 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dfba3445-911e-435b-9263-98f5400b5cfa-multus-daemon-config\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162335 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9pkz\" (UniqueName: \"kubernetes.io/projected/dfba3445-911e-435b-9263-98f5400b5cfa-kube-api-access-q9pkz\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162335 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-system-cni-dir\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162335 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfba3445-911e-435b-9263-98f5400b5cfa-cni-binary-copy\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162485 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqhqc\" (UniqueName: \"kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc\") pod \"network-check-target-dbxjz\" (UID: \"516b84e6-3a82-4946-ab74-8f1f2190a324\") " pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:03.162485 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-multus-cni-dir\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162620 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-cnibin\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162620 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-os-release\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162620 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162567 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-run-k8s-cni-cncf-io\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162620 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-run-netns\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-var-lib-cni-multus\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-hostroot\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ec6b8df-8ba5-430c-b3d5-c586e846b8dc-iptables-alerter-script\") pod \"iptables-alerter-22664\" (UID: \"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc\") " pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.162820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-multus-conf-dir\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-run-multus-certs\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.162820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162800 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-etc-kubernetes\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.163122 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ec6b8df-8ba5-430c-b3d5-c586e846b8dc-host-slash\") pod \"iptables-alerter-22664\" (UID: \"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc\") " pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.163122 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9b8w\" (UniqueName: \"kubernetes.io/projected/3ec6b8df-8ba5-430c-b3d5-c586e846b8dc-kube-api-access-s9b8w\") pod \"iptables-alerter-22664\" (UID: \"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc\") " pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.163122 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162871 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 17:32:03.163122 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-var-lib-kubelet\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.163122 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.162910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-multus-socket-dir-parent\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.163344 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.163260 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.164560 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.164513 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 17:32:03.164986 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.164968 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w8bbl\"" Jul 13 17:32:03.165072 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.165048 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 17:32:03.165612 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.165594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:03.165709 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.165638 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 17:32:03.166203 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.166183 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 17:32:03.166291 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.166188 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b58qp\"" Jul 13 17:32:03.168382 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.168183 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:03.168382 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.168247 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:03.168382 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.168191 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 17:32:03.168945 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.168928 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 17:32:03.169126 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.169103 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8n9xl\"" Jul 13 17:32:03.171213 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.171191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.174037 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.173874 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 17:32:03.174037 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.173919 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:03.174037 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.173979 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:03.174892 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.174873 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 17:32:03.174892 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.174882 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 17:32:03.175355 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.175325 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hsdkw\"" Jul 13 17:32:03.175896 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.175843 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 17:32:03.176146 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.176127 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 17:32:03.176146 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.176139 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 17:32:03.225575 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.225528 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vq4fh" Jul 13 17:32:03.236903 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.236842 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vq4fh" Jul 13 17:32:03.250531 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.250507 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 17:32:03.260421 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.260398 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 17:32:03.263603 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ec6b8df-8ba5-430c-b3d5-c586e846b8dc-host-slash\") pod \"iptables-alerter-22664\" (UID: \"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc\") " pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.263706 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53dbd180-faf7-4c7e-b53f-d97476cc88f4-konnectivity-ca\") pod \"konnectivity-agent-9h2rs\" (UID: \"53dbd180-faf7-4c7e-b53f-d97476cc88f4\") " pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:03.263706 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmps7\" (UniqueName: \"kubernetes.io/projected/5d6545be-de38-4af4-bcc5-6495e8280e84-kube-api-access-vmps7\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:03.263706 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.263706 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-cnibin\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.263906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263709 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ec6b8df-8ba5-430c-b3d5-c586e846b8dc-host-slash\") pod \"iptables-alerter-22664\" (UID: \"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc\") " pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.263906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-var-lib-kubelet\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.263906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-multus-socket-dir-parent\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.263906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-var-lib-cni-bin\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.263906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9pkz\" (UniqueName: \"kubernetes.io/projected/dfba3445-911e-435b-9263-98f5400b5cfa-kube-api-access-q9pkz\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.263906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-kubelet\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.263906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-run-openvswitch\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.263906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-dbus\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:03.263906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-multus-socket-dir-parent\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.263958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfba3445-911e-435b-9263-98f5400b5cfa-cni-binary-copy\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-os-release\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c59e5220-b40c-4200-8518-1245a923e31e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-modprobe-d\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264083 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-var-lib-cni-bin\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxh67\" (UniqueName: \"kubernetes.io/projected/af59a64e-da84-437a-9e91-dab550d19522-kube-api-access-mxh67\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft64p\" (UniqueName: \"kubernetes.io/projected/cbda534c-8561-4185-b12e-8be196ee1f45-kube-api-access-ft64p\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-kubelet-config\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264206 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9b8w\" (UniqueName: \"kubernetes.io/projected/3ec6b8df-8ba5-430c-b3d5-c586e846b8dc-kube-api-access-s9b8w\") pod \"iptables-alerter-22664\" (UID: \"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc\") " pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/379bbd4a-8b61-4fdd-b17b-e1e77e063c32-hosts-file\") pod \"node-resolver-zvkj2\" (UID: \"379bbd4a-8b61-4fdd-b17b-e1e77e063c32\") " pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ec6b8df-8ba5-430c-b3d5-c586e846b8dc-iptables-alerter-script\") pod \"iptables-alerter-22664\" (UID: \"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc\") " pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-log-socket\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c59e5220-b40c-4200-8518-1245a923e31e-cni-binary-copy\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.264337 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-sys\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264363 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-multus-conf-dir\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-etc-kubernetes\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-cni-bin\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264435 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/467e00ec-3e11-4c74-bde3-dc536c806ca5-serviceca\") pod \"node-ca-9gc6l\" (UID: \"467e00ec-3e11-4c74-bde3-dc536c806ca5\") " pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pfwt\" (UniqueName: \"kubernetes.io/projected/c59e5220-b40c-4200-8518-1245a923e31e-kube-api-access-8pfwt\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-sysconfig\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-kubernetes\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dfba3445-911e-435b-9263-98f5400b5cfa-multus-daemon-config\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264649 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfba3445-911e-435b-9263-98f5400b5cfa-cni-binary-copy\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53dbd180-faf7-4c7e-b53f-d97476cc88f4-agent-certs\") pod \"konnectivity-agent-9h2rs\" (UID: \"53dbd180-faf7-4c7e-b53f-d97476cc88f4\") " pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cbda534c-8561-4185-b12e-8be196ee1f45-env-overrides\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-etc-selinux\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264755 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-multus-conf-dir\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264759 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-sysctl-conf\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-etc-kubernetes\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.265192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af59a64e-da84-437a-9e91-dab550d19522-etc-tuned\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-run-netns\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-registration-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/467e00ec-3e11-4c74-bde3-dc536c806ca5-host\") pod \"node-ca-9gc6l\" (UID: \"467e00ec-3e11-4c74-bde3-dc536c806ca5\") " pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/379bbd4a-8b61-4fdd-b17b-e1e77e063c32-tmp-dir\") pod \"node-resolver-zvkj2\" (UID: \"379bbd4a-8b61-4fdd-b17b-e1e77e063c32\") " pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-multus-cni-dir\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.264989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-cnibin\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-run-k8s-cni-cncf-io\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265050 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ec6b8df-8ba5-430c-b3d5-c586e846b8dc-iptables-alerter-script\") pod \"iptables-alerter-22664\" (UID: \"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc\") " pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-run-netns\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-run-netns\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265104 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n76f\" (UniqueName: \"kubernetes.io/projected/379bbd4a-8b61-4fdd-b17b-e1e77e063c32-kube-api-access-6n76f\") pod \"node-resolver-zvkj2\" (UID: \"379bbd4a-8b61-4fdd-b17b-e1e77e063c32\") " pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-node-log\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af59a64e-da84-437a-9e91-dab550d19522-tmp\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265216 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-run-k8s-cni-cncf-io\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-systemd-units\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265250 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dfba3445-911e-435b-9263-98f5400b5cfa-multus-daemon-config\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.266349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265262 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-var-lib-openvswitch\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265272 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-cnibin\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84tqr\" (UniqueName: \"kubernetes.io/projected/14f3e849-3683-4422-aace-7fd72110709a-kube-api-access-84tqr\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-run\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-lib-modules\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cbda534c-8561-4185-b12e-8be196ee1f45-ovnkube-config\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265406 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-multus-cni-dir\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbda534c-8561-4185-b12e-8be196ee1f45-ovn-node-metrics-cert\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-var-lib-cni-multus\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-hostroot\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-slash\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265503 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-var-lib-cni-multus\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-cni-netd\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265526 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-hostroot\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265554 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-system-cni-dir\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c59e5220-b40c-4200-8518-1245a923e31e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-run-multus-certs\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.267208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-socket-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-run-multus-certs\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-sysctl-d\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-var-lib-kubelet\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-etc-openvswitch\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265750 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-system-cni-dir\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhqc\" (UniqueName: \"kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc\") pod \"network-check-target-dbxjz\" (UID: \"516b84e6-3a82-4946-ab74-8f1f2190a324\") " pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265790 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-host-var-lib-kubelet\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265830 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-system-cni-dir\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-run-systemd\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.265976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-run-ovn-kubernetes\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.266015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cbda534c-8561-4185-b12e-8be196ee1f45-ovnkube-script-lib\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.266049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-systemd\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.266087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-os-release\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.266115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-run-ovn\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.266141 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-device-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.268049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.266164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-sys-fs\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.269041 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.266179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfba3445-911e-435b-9263-98f5400b5cfa-os-release\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.269041 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.266187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzcv7\" (UniqueName: \"kubernetes.io/projected/467e00ec-3e11-4c74-bde3-dc536c806ca5-kube-api-access-fzcv7\") pod \"node-ca-9gc6l\" (UID: \"467e00ec-3e11-4c74-bde3-dc536c806ca5\") " pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.269041 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.266220 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-host\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.276267 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.276225 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:32:03.276267 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.276252 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:32:03.276267 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.276266 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gqhqc for pod openshift-network-diagnostics/network-check-target-dbxjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:03.276478 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.276336 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc podName:516b84e6-3a82-4946-ab74-8f1f2190a324 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:03.776316028 +0000 UTC m=+2.919653102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gqhqc" (UniqueName: "kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc") pod "network-check-target-dbxjz" (UID: "516b84e6-3a82-4946-ab74-8f1f2190a324") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:03.276478 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.276436 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 17:32:03.276732 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.276558 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" event={"ID":"e01791c68bd38683d67bccbd056d2f10","Type":"ContainerStarted","Data":"1cba63947b1351a849069f7d1f5ad368e8d0566500cd77e25bcacfe924f4166e"} Jul 13 17:32:03.278566 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.278541 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" event={"ID":"065a773ad515b5bc840f4897c38a83d1","Type":"ContainerStarted","Data":"ff26f0c423734331e860380061fe43d2fa03ddccae0247c72c596f62c2ca0735"} Jul 13 17:32:03.280940 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.280884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9b8w\" (UniqueName: \"kubernetes.io/projected/3ec6b8df-8ba5-430c-b3d5-c586e846b8dc-kube-api-access-s9b8w\") pod \"iptables-alerter-22664\" (UID: \"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc\") " pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.282732 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.282710 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9pkz\" (UniqueName: \"kubernetes.io/projected/dfba3445-911e-435b-9263-98f5400b5cfa-kube-api-access-q9pkz\") pod \"multus-bwshl\" (UID: \"dfba3445-911e-435b-9263-98f5400b5cfa\") " pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.366564 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-systemd-units\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.366564 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-var-lib-openvswitch\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84tqr\" (UniqueName: \"kubernetes.io/projected/14f3e849-3683-4422-aace-7fd72110709a-kube-api-access-84tqr\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-run\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-lib-modules\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366659 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-var-lib-openvswitch\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366659 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-systemd-units\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cbda534c-8561-4185-b12e-8be196ee1f45-ovnkube-config\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbda534c-8561-4185-b12e-8be196ee1f45-ovn-node-metrics-cert\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366743 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-run\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-slash\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-cni-netd\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-system-cni-dir\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.366814 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c59e5220-b40c-4200-8518-1245a923e31e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-socket-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-slash\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366851 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-lib-modules\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-sysctl-d\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-etc-openvswitch\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366904 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-cni-netd\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366914 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-system-cni-dir\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-run-systemd\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366961 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-etc-openvswitch\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.366994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-run-ovn-kubernetes\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-run-systemd\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367013 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-socket-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cbda534c-8561-4185-b12e-8be196ee1f45-ovnkube-script-lib\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-sysctl-d\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367052 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-run-ovn-kubernetes\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.367404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-systemd\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.368079 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367330 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cbda534c-8561-4185-b12e-8be196ee1f45-ovnkube-config\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.368079 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367417 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c59e5220-b40c-4200-8518-1245a923e31e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.368079 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-run-ovn\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.368079 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-device-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.368079 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.367815 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-systemd\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.368079 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.367823 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:03.368344 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-sys-fs\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.368344 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.368303 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs podName:5d6545be-de38-4af4-bcc5-6495e8280e84 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:03.868274047 +0000 UTC m=+3.011611120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs") pod "network-metrics-daemon-szztn" (UID: "5d6545be-de38-4af4-bcc5-6495e8280e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:03.368344 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368310 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-device-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.368344 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzcv7\" (UniqueName: \"kubernetes.io/projected/467e00ec-3e11-4c74-bde3-dc536c806ca5-kube-api-access-fzcv7\") pod \"node-ca-9gc6l\" (UID: \"467e00ec-3e11-4c74-bde3-dc536c806ca5\") " pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.368550 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-host\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.368550 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368377 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cbda534c-8561-4185-b12e-8be196ee1f45-ovnkube-script-lib\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.368550 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368455 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-sys-fs\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.368550 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53dbd180-faf7-4c7e-b53f-d97476cc88f4-konnectivity-ca\") pod \"konnectivity-agent-9h2rs\" (UID: \"53dbd180-faf7-4c7e-b53f-d97476cc88f4\") " pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:03.368550 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmps7\" (UniqueName: \"kubernetes.io/projected/5d6545be-de38-4af4-bcc5-6495e8280e84-kube-api-access-vmps7\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:03.368802 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.368894 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368870 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-run-ovn\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.368894 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-cnibin\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.369088 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368911 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-cnibin\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.369088 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-var-lib-kubelet\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.369088 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368937 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-host\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.369088 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.368989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-kubelet\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.369088 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-run-openvswitch\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.369088 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-dbus\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:03.369375 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:03.369375 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.369375 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369183 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.369375 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-os-release\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.369375 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.369259 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:03.369375 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369282 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-dbus\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:03.369375 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c59e5220-b40c-4200-8518-1245a923e31e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.369744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-os-release\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.369744 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.369523 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret podName:d1a5f0ed-3a5f-43ac-9443-5e51a5190b41 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:03.869486991 +0000 UTC m=+3.012824046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret") pod "global-pull-secret-syncer-5ll5w" (UID: "d1a5f0ed-3a5f-43ac-9443-5e51a5190b41") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:03.369744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369590 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-run-openvswitch\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.369744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369630 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbda534c-8561-4185-b12e-8be196ee1f45-ovn-node-metrics-cert\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.369967 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369772 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.369967 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369743 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-var-lib-kubelet\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.369967 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369828 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-kubelet\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.369967 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-modprobe-d\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.369967 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxh67\" (UniqueName: \"kubernetes.io/projected/af59a64e-da84-437a-9e91-dab550d19522-kube-api-access-mxh67\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.369967 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft64p\" (UniqueName: \"kubernetes.io/projected/cbda534c-8561-4185-b12e-8be196ee1f45-kube-api-access-ft64p\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.370275 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.369995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-kubelet-config\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:03.370275 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/379bbd4a-8b61-4fdd-b17b-e1e77e063c32-hosts-file\") pod \"node-resolver-zvkj2\" (UID: \"379bbd4a-8b61-4fdd-b17b-e1e77e063c32\") " pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.370275 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-log-socket\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.370275 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c59e5220-b40c-4200-8518-1245a923e31e-cni-binary-copy\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.370275 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-sys\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.370275 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-cni-bin\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.370275 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/467e00ec-3e11-4c74-bde3-dc536c806ca5-serviceca\") pod \"node-ca-9gc6l\" (UID: \"467e00ec-3e11-4c74-bde3-dc536c806ca5\") " pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.370275 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pfwt\" (UniqueName: \"kubernetes.io/projected/c59e5220-b40c-4200-8518-1245a923e31e-kube-api-access-8pfwt\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.370275 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-sysconfig\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-kubernetes\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53dbd180-faf7-4c7e-b53f-d97476cc88f4-agent-certs\") pod \"konnectivity-agent-9h2rs\" (UID: \"53dbd180-faf7-4c7e-b53f-d97476cc88f4\") " pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cbda534c-8561-4185-b12e-8be196ee1f45-env-overrides\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-etc-selinux\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-sysctl-conf\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370450 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c59e5220-b40c-4200-8518-1245a923e31e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af59a64e-da84-437a-9e91-dab550d19522-etc-tuned\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370540 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-modprobe-d\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370555 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/379bbd4a-8b61-4fdd-b17b-e1e77e063c32-hosts-file\") pod \"node-resolver-zvkj2\" (UID: \"379bbd4a-8b61-4fdd-b17b-e1e77e063c32\") " pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-run-netns\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370607 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-sysconfig\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-registration-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/467e00ec-3e11-4c74-bde3-dc536c806ca5-host\") pod \"node-ca-9gc6l\" (UID: \"467e00ec-3e11-4c74-bde3-dc536c806ca5\") " pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/379bbd4a-8b61-4fdd-b17b-e1e77e063c32-tmp-dir\") pod \"node-resolver-zvkj2\" (UID: \"379bbd4a-8b61-4fdd-b17b-e1e77e063c32\") " pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370698 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c59e5220-b40c-4200-8518-1245a923e31e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.370820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n76f\" (UniqueName: \"kubernetes.io/projected/379bbd4a-8b61-4fdd-b17b-e1e77e063c32-kube-api-access-6n76f\") pod \"node-resolver-zvkj2\" (UID: \"379bbd4a-8b61-4fdd-b17b-e1e77e063c32\") " pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.371696 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-node-log\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.371696 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af59a64e-da84-437a-9e91-dab550d19522-tmp\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.371696 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370801 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-etc-selinux\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.371696 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.370873 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-cni-bin\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.371696 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.371143 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/379bbd4a-8b61-4fdd-b17b-e1e77e063c32-tmp-dir\") pod \"node-resolver-zvkj2\" (UID: \"379bbd4a-8b61-4fdd-b17b-e1e77e063c32\") " pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.371696 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.371401 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-node-log\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.371696 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.371553 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cbda534c-8561-4185-b12e-8be196ee1f45-env-overrides\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.372068 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.371739 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14f3e849-3683-4422-aace-7fd72110709a-registration-dir\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.372068 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.371823 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-kubelet-config\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:03.372068 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.371886 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-log-socket\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.372068 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.371933 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c59e5220-b40c-4200-8518-1245a923e31e-cni-binary-copy\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.372068 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.371953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbda534c-8561-4185-b12e-8be196ee1f45-host-run-netns\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.372068 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.372030 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/467e00ec-3e11-4c74-bde3-dc536c806ca5-serviceca\") pod \"node-ca-9gc6l\" (UID: \"467e00ec-3e11-4c74-bde3-dc536c806ca5\") " pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.372372 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.372106 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-kubernetes\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.372372 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.372236 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/467e00ec-3e11-4c74-bde3-dc536c806ca5-host\") pod \"node-ca-9gc6l\" (UID: \"467e00ec-3e11-4c74-bde3-dc536c806ca5\") " pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.372372 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.372343 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-etc-sysctl-conf\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.372529 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.372429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af59a64e-da84-437a-9e91-dab550d19522-sys\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.374338 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.373995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af59a64e-da84-437a-9e91-dab550d19522-tmp\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.374338 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.374164 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53dbd180-faf7-4c7e-b53f-d97476cc88f4-agent-certs\") pod \"konnectivity-agent-9h2rs\" (UID: \"53dbd180-faf7-4c7e-b53f-d97476cc88f4\") " pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:03.375430 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.375404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af59a64e-da84-437a-9e91-dab550d19522-etc-tuned\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.375724 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.375704 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84tqr\" (UniqueName: \"kubernetes.io/projected/14f3e849-3683-4422-aace-7fd72110709a-kube-api-access-84tqr\") pod \"aws-ebs-csi-driver-node-55c4g\" (UID: \"14f3e849-3683-4422-aace-7fd72110709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.376648 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.376628 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53dbd180-faf7-4c7e-b53f-d97476cc88f4-konnectivity-ca\") pod \"konnectivity-agent-9h2rs\" (UID: \"53dbd180-faf7-4c7e-b53f-d97476cc88f4\") " pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:03.383075 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.383011 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzcv7\" (UniqueName: \"kubernetes.io/projected/467e00ec-3e11-4c74-bde3-dc536c806ca5-kube-api-access-fzcv7\") pod \"node-ca-9gc6l\" (UID: \"467e00ec-3e11-4c74-bde3-dc536c806ca5\") " pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.383328 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.383302 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmps7\" (UniqueName: \"kubernetes.io/projected/5d6545be-de38-4af4-bcc5-6495e8280e84-kube-api-access-vmps7\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:03.384875 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.384850 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pfwt\" (UniqueName: \"kubernetes.io/projected/c59e5220-b40c-4200-8518-1245a923e31e-kube-api-access-8pfwt\") pod \"multus-additional-cni-plugins-m99k8\" (UID: \"c59e5220-b40c-4200-8518-1245a923e31e\") " pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.385190 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.385174 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n76f\" (UniqueName: \"kubernetes.io/projected/379bbd4a-8b61-4fdd-b17b-e1e77e063c32-kube-api-access-6n76f\") pod \"node-resolver-zvkj2\" (UID: \"379bbd4a-8b61-4fdd-b17b-e1e77e063c32\") " pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.385547 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.385519 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxh67\" (UniqueName: \"kubernetes.io/projected/af59a64e-da84-437a-9e91-dab550d19522-kube-api-access-mxh67\") pod \"tuned-vsgg7\" (UID: \"af59a64e-da84-437a-9e91-dab550d19522\") " pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.385660 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.385642 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft64p\" (UniqueName: \"kubernetes.io/projected/cbda534c-8561-4185-b12e-8be196ee1f45-kube-api-access-ft64p\") pod \"ovnkube-node-n8m7v\" (UID: \"cbda534c-8561-4185-b12e-8be196ee1f45\") " pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.460603 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.460583 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bwshl" Jul 13 17:32:03.470173 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.470139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-22664" Jul 13 17:32:03.471965 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:03.471935 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfba3445_911e_435b_9263_98f5400b5cfa.slice/crio-424b08c8e411249650b2f8313a9c15cdf3f66a90414757d42aba28304f7f7017 WatchSource:0}: Error finding container 424b08c8e411249650b2f8313a9c15cdf3f66a90414757d42aba28304f7f7017: Status 404 returned error can't find the container with id 424b08c8e411249650b2f8313a9c15cdf3f66a90414757d42aba28304f7f7017 Jul 13 17:32:03.479708 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:03.479682 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec6b8df_8ba5_430c_b3d5_c586e846b8dc.slice/crio-6adb3adb493e00ab26d2b2a365b1c33da93f4f43add632adfca8a0002b63474a WatchSource:0}: Error finding container 6adb3adb493e00ab26d2b2a365b1c33da93f4f43add632adfca8a0002b63474a: Status 404 returned error can't find the container with id 6adb3adb493e00ab26d2b2a365b1c33da93f4f43add632adfca8a0002b63474a Jul 13 17:32:03.480448 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.480417 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" Jul 13 17:32:03.486526 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.486484 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9gc6l" Jul 13 17:32:03.489815 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:03.489788 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f3e849_3683_4422_aace_7fd72110709a.slice/crio-72819f45cfa1aa9b0121e4d079cc9732a645b17fd2b6a54ab6232dc6d71b61fd WatchSource:0}: Error finding container 72819f45cfa1aa9b0121e4d079cc9732a645b17fd2b6a54ab6232dc6d71b61fd: Status 404 returned error can't find the container with id 72819f45cfa1aa9b0121e4d079cc9732a645b17fd2b6a54ab6232dc6d71b61fd Jul 13 17:32:03.495180 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.495155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m99k8" Jul 13 17:32:03.496010 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:03.495985 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod467e00ec_3e11_4c74_bde3_dc536c806ca5.slice/crio-586a53a7b192faf4a599caba7cedbd248d2ff2351d518617807fd9f8ce72ec94 WatchSource:0}: Error finding container 586a53a7b192faf4a599caba7cedbd248d2ff2351d518617807fd9f8ce72ec94: Status 404 returned error can't find the container with id 586a53a7b192faf4a599caba7cedbd248d2ff2351d518617807fd9f8ce72ec94 Jul 13 17:32:03.504749 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.504726 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" Jul 13 17:32:03.505558 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:03.505532 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59e5220_b40c_4200_8518_1245a923e31e.slice/crio-318d5a7e7ce5d25ff8dab47d69dca755a848c867000f3476616c75343e62dd77 WatchSource:0}: Error finding container 318d5a7e7ce5d25ff8dab47d69dca755a848c867000f3476616c75343e62dd77: Status 404 returned error can't find the container with id 318d5a7e7ce5d25ff8dab47d69dca755a848c867000f3476616c75343e62dd77 Jul 13 17:32:03.512041 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.512013 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zvkj2" Jul 13 17:32:03.514678 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:03.514647 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf59a64e_da84_437a_9e91_dab550d19522.slice/crio-dd84bdc6a6ed12d8e3306be08e41dac0912f79d7981bf60e6c09e58eae1dd97d WatchSource:0}: Error finding container dd84bdc6a6ed12d8e3306be08e41dac0912f79d7981bf60e6c09e58eae1dd97d: Status 404 returned error can't find the container with id dd84bdc6a6ed12d8e3306be08e41dac0912f79d7981bf60e6c09e58eae1dd97d Jul 13 17:32:03.522119 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:03.522095 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod379bbd4a_8b61_4fdd_b17b_e1e77e063c32.slice/crio-8192c478b2fe580a71ab5f124adf4b4372ffcb09961207383633e87992ba442a WatchSource:0}: Error finding container 8192c478b2fe580a71ab5f124adf4b4372ffcb09961207383633e87992ba442a: Status 404 returned error can't find the container with id 8192c478b2fe580a71ab5f124adf4b4372ffcb09961207383633e87992ba442a Jul 13 17:32:03.526612 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.526591 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:03.533643 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.533625 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:03.537023 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:03.536981 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53dbd180_faf7_4c7e_b53f_d97476cc88f4.slice/crio-41d3ae4f5693a978dc9d771a0c174a3eb4912bbfeedb6d69eebc7d9efd2d37d2 WatchSource:0}: Error finding container 41d3ae4f5693a978dc9d771a0c174a3eb4912bbfeedb6d69eebc7d9efd2d37d2: Status 404 returned error can't find the container with id 41d3ae4f5693a978dc9d771a0c174a3eb4912bbfeedb6d69eebc7d9efd2d37d2 Jul 13 17:32:03.542888 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:03.542865 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbda534c_8561_4185_b12e_8be196ee1f45.slice/crio-29eea2c514cbf7e081507a243cde8ee8e475e9f0d5b9e4d6514ac4d362a1a4d0 WatchSource:0}: Error finding container 29eea2c514cbf7e081507a243cde8ee8e475e9f0d5b9e4d6514ac4d362a1a4d0: Status 404 returned error can't find the container with id 29eea2c514cbf7e081507a243cde8ee8e475e9f0d5b9e4d6514ac4d362a1a4d0 Jul 13 17:32:03.875280 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.875243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhqc\" (UniqueName: \"kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc\") pod \"network-check-target-dbxjz\" (UID: \"516b84e6-3a82-4946-ab74-8f1f2190a324\") " pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:03.875280 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.875284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:03.875605 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:03.875316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:03.875605 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.875450 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:03.875605 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.875452 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:03.875605 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.875456 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:32:03.875605 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.875556 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:32:03.875605 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.875573 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gqhqc for pod openshift-network-diagnostics/network-check-target-dbxjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:03.875605 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.875541 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret podName:d1a5f0ed-3a5f-43ac-9443-5e51a5190b41 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:04.875521131 +0000 UTC m=+4.018858212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret") pod "global-pull-secret-syncer-5ll5w" (UID: "d1a5f0ed-3a5f-43ac-9443-5e51a5190b41") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:03.875924 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.875625 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs podName:5d6545be-de38-4af4-bcc5-6495e8280e84 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:04.875611158 +0000 UTC m=+4.018948212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs") pod "network-metrics-daemon-szztn" (UID: "5d6545be-de38-4af4-bcc5-6495e8280e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:03.875924 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:03.875638 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc podName:516b84e6-3a82-4946-ab74-8f1f2190a324 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:04.875630135 +0000 UTC m=+4.018967188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqhqc" (UniqueName: "kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc") pod "network-check-target-dbxjz" (UID: "516b84e6-3a82-4946-ab74-8f1f2190a324") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:04.240632 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.240543 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:27:03 +0000 UTC" deadline="2028-03-27 20:34:56.914199794 +0000 UTC" Jul 13 17:32:04.240632 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.240591 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14955h2m52.673614147s" Jul 13 17:32:04.272508 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.272464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:04.272687 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:04.272618 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:04.273146 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.273124 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:04.273253 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:04.273233 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:04.283404 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.283312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-22664" event={"ID":"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc","Type":"ContainerStarted","Data":"6adb3adb493e00ab26d2b2a365b1c33da93f4f43add632adfca8a0002b63474a"} Jul 13 17:32:04.285531 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.285496 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" event={"ID":"cbda534c-8561-4185-b12e-8be196ee1f45","Type":"ContainerStarted","Data":"29eea2c514cbf7e081507a243cde8ee8e475e9f0d5b9e4d6514ac4d362a1a4d0"} Jul 13 17:32:04.287044 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.286958 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zvkj2" event={"ID":"379bbd4a-8b61-4fdd-b17b-e1e77e063c32","Type":"ContainerStarted","Data":"8192c478b2fe580a71ab5f124adf4b4372ffcb09961207383633e87992ba442a"} Jul 13 17:32:04.288716 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.288643 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" event={"ID":"af59a64e-da84-437a-9e91-dab550d19522","Type":"ContainerStarted","Data":"dd84bdc6a6ed12d8e3306be08e41dac0912f79d7981bf60e6c09e58eae1dd97d"} Jul 13 17:32:04.290343 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.290280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m99k8" event={"ID":"c59e5220-b40c-4200-8518-1245a923e31e","Type":"ContainerStarted","Data":"318d5a7e7ce5d25ff8dab47d69dca755a848c867000f3476616c75343e62dd77"} Jul 13 17:32:04.292232 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.292156 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" event={"ID":"14f3e849-3683-4422-aace-7fd72110709a","Type":"ContainerStarted","Data":"72819f45cfa1aa9b0121e4d079cc9732a645b17fd2b6a54ab6232dc6d71b61fd"} Jul 13 17:32:04.294206 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.294130 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bwshl" event={"ID":"dfba3445-911e-435b-9263-98f5400b5cfa","Type":"ContainerStarted","Data":"424b08c8e411249650b2f8313a9c15cdf3f66a90414757d42aba28304f7f7017"} Jul 13 17:32:04.295879 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.295807 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9h2rs" event={"ID":"53dbd180-faf7-4c7e-b53f-d97476cc88f4","Type":"ContainerStarted","Data":"41d3ae4f5693a978dc9d771a0c174a3eb4912bbfeedb6d69eebc7d9efd2d37d2"} Jul 13 17:32:04.299970 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.299918 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9gc6l" event={"ID":"467e00ec-3e11-4c74-bde3-dc536c806ca5","Type":"ContainerStarted","Data":"586a53a7b192faf4a599caba7cedbd248d2ff2351d518617807fd9f8ce72ec94"} Jul 13 17:32:04.885890 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.885578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhqc\" (UniqueName: \"kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc\") pod \"network-check-target-dbxjz\" (UID: \"516b84e6-3a82-4946-ab74-8f1f2190a324\") " pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:04.885890 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.885632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:04.885890 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:04.885681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:04.885890 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:04.885719 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:32:04.885890 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:04.885744 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:32:04.885890 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:04.885761 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gqhqc for pod openshift-network-diagnostics/network-check-target-dbxjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:04.885890 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:04.885809 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:04.885890 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:04.885815 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc podName:516b84e6-3a82-4946-ab74-8f1f2190a324 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:06.885795613 +0000 UTC m=+6.029132665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqhqc" (UniqueName: "kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc") pod "network-check-target-dbxjz" (UID: "516b84e6-3a82-4946-ab74-8f1f2190a324") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:04.885890 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:04.885866 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret podName:d1a5f0ed-3a5f-43ac-9443-5e51a5190b41 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:06.885850802 +0000 UTC m=+6.029187859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret") pod "global-pull-secret-syncer-5ll5w" (UID: "d1a5f0ed-3a5f-43ac-9443-5e51a5190b41") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:04.885890 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:04.885886 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:04.886487 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:04.885919 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs podName:5d6545be-de38-4af4-bcc5-6495e8280e84 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:06.885908698 +0000 UTC m=+6.029245751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs") pod "network-metrics-daemon-szztn" (UID: "5d6545be-de38-4af4-bcc5-6495e8280e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:05.241998 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:05.241665 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:27:03 +0000 UTC" deadline="2028-04-23 02:00:06.995740486 +0000 UTC" Jul 13 17:32:05.241998 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:05.241933 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15584h28m1.753815211s" Jul 13 17:32:05.273201 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:05.272650 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:05.273201 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:05.272777 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:05.339470 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:05.339186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" event={"ID":"065a773ad515b5bc840f4897c38a83d1","Type":"ContainerStarted","Data":"637532b5431708c2580599f7fd3ffd6db78a6ae9f17a76eb67cbf82a3be477e5"} Jul 13 17:32:06.272313 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:06.272278 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:06.272849 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:06.272415 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:06.272849 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:06.272516 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:06.272849 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:06.272607 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:06.904853 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:06.904810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhqc\" (UniqueName: \"kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc\") pod \"network-check-target-dbxjz\" (UID: \"516b84e6-3a82-4946-ab74-8f1f2190a324\") " pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:06.905059 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:06.904870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:06.905059 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:06.904915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:06.905196 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:06.905077 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:06.905196 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:06.905142 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret podName:d1a5f0ed-3a5f-43ac-9443-5e51a5190b41 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:10.905124216 +0000 UTC m=+10.048461275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret") pod "global-pull-secret-syncer-5ll5w" (UID: "d1a5f0ed-3a5f-43ac-9443-5e51a5190b41") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:06.905596 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:06.905575 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:32:06.905698 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:06.905603 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:32:06.905698 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:06.905617 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gqhqc for pod openshift-network-diagnostics/network-check-target-dbxjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:06.905698 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:06.905666 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc podName:516b84e6-3a82-4946-ab74-8f1f2190a324 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:10.905649493 +0000 UTC m=+10.048986553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqhqc" (UniqueName: "kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc") pod "network-check-target-dbxjz" (UID: "516b84e6-3a82-4946-ab74-8f1f2190a324") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:06.905864 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:06.905732 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:06.905864 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:06.905766 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs podName:5d6545be-de38-4af4-bcc5-6495e8280e84 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:10.905754131 +0000 UTC m=+10.049091186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs") pod "network-metrics-daemon-szztn" (UID: "5d6545be-de38-4af4-bcc5-6495e8280e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:07.272226 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:07.272131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:07.272398 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:07.272353 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:08.271413 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:08.271380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:08.271608 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:08.271538 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:08.271608 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:08.271576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:08.271742 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:08.271676 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:09.272158 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:09.271989 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:09.272158 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:09.272143 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:10.271619 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:10.271576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:10.271811 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:10.271622 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:10.271811 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:10.271724 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:10.271930 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:10.271859 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:10.941729 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:10.941692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhqc\" (UniqueName: \"kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc\") pod \"network-check-target-dbxjz\" (UID: \"516b84e6-3a82-4946-ab74-8f1f2190a324\") " pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:10.942170 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:10.941751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:10.942170 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:10.941791 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:10.942170 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:10.941899 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:32:10.942170 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:10.941925 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:32:10.942170 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:10.941939 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gqhqc for pod openshift-network-diagnostics/network-check-target-dbxjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:10.942170 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:10.941944 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:10.942170 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:10.941984 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc podName:516b84e6-3a82-4946-ab74-8f1f2190a324 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:18.941970359 +0000 UTC m=+18.085307422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqhqc" (UniqueName: "kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc") pod "network-check-target-dbxjz" (UID: "516b84e6-3a82-4946-ab74-8f1f2190a324") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:10.942170 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:10.941992 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:10.942170 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:10.942003 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs podName:5d6545be-de38-4af4-bcc5-6495e8280e84 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:18.94199322 +0000 UTC m=+18.085330272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs") pod "network-metrics-daemon-szztn" (UID: "5d6545be-de38-4af4-bcc5-6495e8280e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:10.942170 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:10.942040 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret podName:d1a5f0ed-3a5f-43ac-9443-5e51a5190b41 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:18.942023834 +0000 UTC m=+18.085360899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret") pod "global-pull-secret-syncer-5ll5w" (UID: "d1a5f0ed-3a5f-43ac-9443-5e51a5190b41") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:11.272429 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:11.272274 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:11.272429 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:11.272413 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:12.271947 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:12.271481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:12.271947 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:12.271511 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:12.271947 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:12.271610 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:12.271947 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:12.271743 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:13.271456 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:13.271421 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:13.271658 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:13.271562 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:14.272347 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:14.272309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:14.272776 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:14.272309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:14.272776 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:14.272423 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:14.272776 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:14.272522 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:15.271764 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:15.271731 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:15.271937 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:15.271859 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:16.271938 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:16.271906 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:16.272351 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:16.272031 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:16.272351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:16.272067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:16.272351 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:16.272184 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:17.271683 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:17.271647 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:17.271859 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:17.271780 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:18.271802 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:18.271768 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:18.271802 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:18.271797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:18.272297 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:18.271882 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:18.272297 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:18.272006 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:19.008400 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:19.008362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhqc\" (UniqueName: \"kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc\") pod \"network-check-target-dbxjz\" (UID: \"516b84e6-3a82-4946-ab74-8f1f2190a324\") " pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:19.008400 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:19.008405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:19.008646 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:19.008444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:19.008646 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:19.008557 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:19.008646 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:19.008570 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:19.008646 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:19.008615 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret podName:d1a5f0ed-3a5f-43ac-9443-5e51a5190b41 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:35.008602584 +0000 UTC m=+34.151939635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret") pod "global-pull-secret-syncer-5ll5w" (UID: "d1a5f0ed-3a5f-43ac-9443-5e51a5190b41") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:19.008646 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:19.008553 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:32:19.008646 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:19.008631 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs podName:5d6545be-de38-4af4-bcc5-6495e8280e84 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:35.008623801 +0000 UTC m=+34.151960852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs") pod "network-metrics-daemon-szztn" (UID: "5d6545be-de38-4af4-bcc5-6495e8280e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:19.008646 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:19.008642 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:32:19.008921 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:19.008656 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gqhqc for pod openshift-network-diagnostics/network-check-target-dbxjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:19.008921 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:19.008703 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc podName:516b84e6-3a82-4946-ab74-8f1f2190a324 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:35.008686788 +0000 UTC m=+34.152023841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqhqc" (UniqueName: "kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc") pod "network-check-target-dbxjz" (UID: "516b84e6-3a82-4946-ab74-8f1f2190a324") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:19.271906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:19.271836 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:19.272285 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:19.271967 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:20.271984 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:20.271951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:20.272420 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:20.272057 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:20.272420 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:20.272106 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:20.272420 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:20.272206 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:21.272802 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:21.272769 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:21.273235 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:21.272870 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:22.271585 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:22.271549 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:22.271744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:22.271589 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:22.271744 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:22.271678 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:22.271857 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:22.271808 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:23.272365 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.272221 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:23.272365 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:23.272343 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:23.383360 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.383260 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" event={"ID":"14f3e849-3683-4422-aace-7fd72110709a","Type":"ContainerStarted","Data":"74603017b8dd3f001f8fd91a5f60fb97e059d303ccd548f022aca6f6781bd665"} Jul 13 17:32:23.385347 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.385323 2581 generic.go:356] "Generic (PLEG): container finished" podID="e01791c68bd38683d67bccbd056d2f10" containerID="30e5fbbc3fc8f217cf476259484dc97809975120c7ffbd6789c33d7a9b693249" exitCode=0 Jul 13 17:32:23.385446 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.385395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" event={"ID":"e01791c68bd38683d67bccbd056d2f10","Type":"ContainerDied","Data":"30e5fbbc3fc8f217cf476259484dc97809975120c7ffbd6789c33d7a9b693249"} Jul 13 17:32:23.386610 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.386589 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9h2rs" event={"ID":"53dbd180-faf7-4c7e-b53f-d97476cc88f4","Type":"ContainerStarted","Data":"413f30fc7e37ef0349604d527cd35d0a83cd047da14c14e67347d78fbefa3649"} Jul 13 17:32:23.387885 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.387868 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9gc6l" event={"ID":"467e00ec-3e11-4c74-bde3-dc536c806ca5","Type":"ContainerStarted","Data":"141be02a08c8ac5ceb419a3da13fb0ee87a3878e98bceede4fa27aa3ade70f84"} Jul 13 17:32:23.390790 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.390639 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" event={"ID":"cbda534c-8561-4185-b12e-8be196ee1f45","Type":"ContainerStarted","Data":"f8118856a5422f1fcffc2519c7abff394d0f283f9a032fadcf85561e1b6fc47b"} Jul 13 17:32:23.393678 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.393407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zvkj2" event={"ID":"379bbd4a-8b61-4fdd-b17b-e1e77e063c32","Type":"ContainerStarted","Data":"2f50c30c4d8944e0c8f2a54efffbbae6f603cf7ec49ced45797985518915c8ca"} Jul 13 17:32:23.394884 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.394841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" event={"ID":"af59a64e-da84-437a-9e91-dab550d19522","Type":"ContainerStarted","Data":"c9b2c6362419605b61c8950f95bf5728e81510e897e1c069b7b09da4608eeced"} Jul 13 17:32:23.396439 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.396418 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m99k8" event={"ID":"c59e5220-b40c-4200-8518-1245a923e31e","Type":"ContainerStarted","Data":"69f08cf9b3f1b7083fa2ca5be2785c0f17edcc06094eaea4e612a1b5625feeb0"} Jul 13 17:32:23.398974 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.398939 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-186.ec2.internal" podStartSLOduration=20.398928482 podStartE2EDuration="20.398928482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:05.355292927 +0000 UTC m=+4.498630003" watchObservedRunningTime="2026-07-13 17:32:23.398928482 +0000 UTC m=+22.542265555" Jul 13 17:32:23.411739 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.411700 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9gc6l" podStartSLOduration=2.8730756729999998 podStartE2EDuration="22.411685934s" totalImagesPullingTime="19.538610261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:23.41120365 +0000 UTC m=+22.554540722" watchObservedRunningTime="2026-07-13 17:32:23.411685934 +0000 UTC m=+22.555023007" Jul 13 17:32:23.426305 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.426151 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zvkj2" podStartSLOduration=2.913521582 podStartE2EDuration="22.426132735s" totalImagesPullingTime="19.512611153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:23.425002087 +0000 UTC m=+22.568339159" watchObservedRunningTime="2026-07-13 17:32:23.426132735 +0000 UTC m=+22.569469810" Jul 13 17:32:23.463410 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.463368 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vsgg7" podStartSLOduration=2.941656502 podStartE2EDuration="22.463353051s" totalImagesPullingTime="19.521696549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:23.462728225 +0000 UTC m=+22.606065301" watchObservedRunningTime="2026-07-13 17:32:23.463353051 +0000 UTC m=+22.606690124" Jul 13 17:32:23.511836 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.511810 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:23.565375 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:23.565344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:24.134146 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.134104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:24.185006 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.184917 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:24.271560 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.271524 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:24.271560 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.271555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:24.271834 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:24.271647 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:24.271834 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:24.271764 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:24.399571 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.399546 2581 generic.go:356] "Generic (PLEG): container finished" podID="c59e5220-b40c-4200-8518-1245a923e31e" containerID="69f08cf9b3f1b7083fa2ca5be2785c0f17edcc06094eaea4e612a1b5625feeb0" exitCode=0 Jul 13 17:32:24.400276 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.399639 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m99k8" event={"ID":"c59e5220-b40c-4200-8518-1245a923e31e","Type":"ContainerDied","Data":"69f08cf9b3f1b7083fa2ca5be2785c0f17edcc06094eaea4e612a1b5625feeb0"} Jul 13 17:32:24.400965 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.400935 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bwshl" event={"ID":"dfba3445-911e-435b-9263-98f5400b5cfa","Type":"ContainerStarted","Data":"c7862b132f8102eb87be2ea2d1690c9c69d9b85649fccc16f4576ce1012c6221"} Jul 13 17:32:24.402472 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.402444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" event={"ID":"e01791c68bd38683d67bccbd056d2f10","Type":"ContainerStarted","Data":"be55dec7ee01fdeedcbcc2ff74113ee2498671e9a93be36d896827282c4a8a28"} Jul 13 17:32:24.403819 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.403801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-22664" event={"ID":"3ec6b8df-8ba5-430c-b3d5-c586e846b8dc","Type":"ContainerStarted","Data":"69695202b760e3cb5d92b9729ad65b26988f0a7615155c6ad540b6fdd95f442c"} Jul 13 17:32:24.406625 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.406603 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" event={"ID":"cbda534c-8561-4185-b12e-8be196ee1f45","Type":"ContainerStarted","Data":"4c975b8a8c904b30e3aacb258a398fd3740aa554d489331dc19e8a5f6c1843b6"} Jul 13 17:32:24.406699 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.406672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" event={"ID":"cbda534c-8561-4185-b12e-8be196ee1f45","Type":"ContainerStarted","Data":"b0d1329f35a537994523e0944d7a09e1faa7e69b3d4f6852a4e7f02a64be779d"} Jul 13 17:32:24.406751 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.406701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" event={"ID":"cbda534c-8561-4185-b12e-8be196ee1f45","Type":"ContainerStarted","Data":"64c5b8e29a9f6442efd2383239cb8d69a16b9e65a2c879045311fb4efe98d697"} Jul 13 17:32:24.406788 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.406760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" event={"ID":"cbda534c-8561-4185-b12e-8be196ee1f45","Type":"ContainerStarted","Data":"67b025966d69b8b835619b20c09cf40fa87747e385c3856c0db8efc6dc71b011"} Jul 13 17:32:24.406822 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.406795 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" event={"ID":"cbda534c-8561-4185-b12e-8be196ee1f45","Type":"ContainerStarted","Data":"5330caedc3adb7ba88815bb610870844da7b5034d237ca49e069d2eeccce91b2"} Jul 13 17:32:24.420150 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.420117 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9h2rs" podStartSLOduration=11.016630052 podStartE2EDuration="22.420106615s" totalImagesPullingTime="11.403476563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:23.480851287 +0000 UTC m=+22.624188360" watchObservedRunningTime="2026-07-13 17:32:24.420106615 +0000 UTC m=+23.563443749" Jul 13 17:32:24.448537 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.448454 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bwshl" podStartSLOduration=3.65142703 podStartE2EDuration="23.448437103s" totalImagesPullingTime="19.797010073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:24.448370869 +0000 UTC m=+23.591707944" watchObservedRunningTime="2026-07-13 17:32:24.448437103 +0000 UTC m=+23.591774175" Jul 13 17:32:24.448772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.448753 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-186.ec2.internal" podStartSLOduration=21.448748189 podStartE2EDuration="21.448748189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:24.432104626 +0000 UTC m=+23.575441698" watchObservedRunningTime="2026-07-13 17:32:24.448748189 +0000 UTC m=+23.592085278" Jul 13 17:32:24.464033 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.463982 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-22664" podStartSLOduration=3.909416331 podStartE2EDuration="23.463968816s" totalImagesPullingTime="19.554552485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:24.463494849 +0000 UTC m=+23.606831919" watchObservedRunningTime="2026-07-13 17:32:24.463968816 +0000 UTC m=+23.607305889" Jul 13 17:32:24.569978 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.569954 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 17:32:24.575442 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.575422 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:24.675959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.675933 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:24.728708 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.728640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:24.849021 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:24.848990 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:25.222511 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.222379 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T17:32:24.569975679Z","UUID":"2eca29a1-bece-4262-b1e1-0b8bc494e480","Handler":null,"Name":"","Endpoint":""} Jul 13 17:32:25.224032 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.224004 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 17:32:25.224158 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.224055 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 17:32:25.271437 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.271406 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:25.271641 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:25.271554 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:25.411512 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.411477 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" event={"ID":"14f3e849-3683-4422-aace-7fd72110709a","Type":"ContainerStarted","Data":"526a688c386036cc36951ff038cd130a0482bb5be698c9c5abd0e6caab2514d0"} Jul 13 17:32:25.506949 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.506858 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:25.558783 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.558756 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:25.666781 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.666755 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:25.725586 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.725549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:25.853489 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.853450 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:25.882931 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.882894 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:25.883583 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.883564 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:25.903569 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.903547 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:25.967325 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:25.967296 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:26.069955 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.069925 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:26.272003 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.271979 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:26.272223 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.271979 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:26.272223 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:26.272114 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:26.272223 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:26.272165 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:26.416058 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.415968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" event={"ID":"14f3e849-3683-4422-aace-7fd72110709a","Type":"ContainerStarted","Data":"85f914ea861a11b0f5c805ca2d97f17bea44c9bec35616420ca77aece2759600"} Jul 13 17:32:26.419551 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.419519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" event={"ID":"cbda534c-8561-4185-b12e-8be196ee1f45","Type":"ContainerStarted","Data":"884773dc4d592ec50471f476be4f01186f31fed9b6f0d4b20859e0cff973fc06"} Jul 13 17:32:26.419812 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.419785 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:26.420223 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.420206 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9h2rs" Jul 13 17:32:26.433470 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.433277 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55c4g" podStartSLOduration=3.273564356 podStartE2EDuration="25.43326158s" totalImagesPullingTime="22.159697224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:26.432699875 +0000 UTC m=+25.576036948" watchObservedRunningTime="2026-07-13 17:32:26.43326158 +0000 UTC m=+25.576598655" Jul 13 17:32:26.504474 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.504433 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:26.712093 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.711989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:26.816119 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:26.816078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:27.110348 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:27.110314 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:27.160849 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:27.160807 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:27.271435 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:27.271401 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:27.271635 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:27.271549 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:27.286195 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:27.286167 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:27.338487 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:27.338442 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:28.271689 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:28.271658 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:28.272097 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:28.271659 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:28.272097 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:28.271792 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:28.272097 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:28.271894 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:29.272274 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.272108 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:29.272870 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:29.272361 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:29.429363 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.429330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" event={"ID":"cbda534c-8561-4185-b12e-8be196ee1f45","Type":"ContainerStarted","Data":"8fb52e86945921cbfb5dd09069d74164f249e76ead7e1c919c67b20cbe1fc364"} Jul 13 17:32:29.429616 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.429595 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:29.429766 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.429668 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:29.429766 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.429713 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:29.431320 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.431299 2581 generic.go:356] "Generic (PLEG): container finished" podID="c59e5220-b40c-4200-8518-1245a923e31e" containerID="a47fdb58275a9f814391c8209271e5d7cbd31216dd075cdab921eeffcd699835" exitCode=0 Jul 13 17:32:29.431432 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.431336 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m99k8" event={"ID":"c59e5220-b40c-4200-8518-1245a923e31e","Type":"ContainerDied","Data":"a47fdb58275a9f814391c8209271e5d7cbd31216dd075cdab921eeffcd699835"} Jul 13 17:32:29.444735 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.444716 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:29.444836 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.444815 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:32:29.458139 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.458102 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" podStartSLOduration=7.924289628 podStartE2EDuration="27.458091309s" totalImagesPullingTime="19.533801681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:29.45637479 +0000 UTC m=+28.599711862" watchObservedRunningTime="2026-07-13 17:32:29.458091309 +0000 UTC m=+28.601428382" Jul 13 17:32:29.991780 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:29.991749 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:30.050162 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:30.050126 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:30.271683 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:30.271602 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:30.271683 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:30.271633 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:30.271893 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:30.271725 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:30.271893 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:30.271862 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:30.564683 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:30.564611 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5ll5w"] Jul 13 17:32:30.565065 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:30.564709 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:30.565065 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:30.564795 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:30.567493 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:30.567454 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dbxjz"] Jul 13 17:32:30.567606 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:30.567548 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:30.567655 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:30.567628 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:30.576205 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:30.576182 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-szztn"] Jul 13 17:32:30.576347 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:30.576273 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:30.576409 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:30.576385 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:31.437270 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:31.437238 2581 generic.go:356] "Generic (PLEG): container finished" podID="c59e5220-b40c-4200-8518-1245a923e31e" containerID="190ab35d1363f56de9fe8c2a66f770117d79dbbaa58647760a3f5d774349e55e" exitCode=0 Jul 13 17:32:31.437452 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:31.437320 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m99k8" event={"ID":"c59e5220-b40c-4200-8518-1245a923e31e","Type":"ContainerDied","Data":"190ab35d1363f56de9fe8c2a66f770117d79dbbaa58647760a3f5d774349e55e"} Jul 13 17:32:32.271707 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:32.271664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:32.271707 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:32.271702 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:32.272267 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:32.271794 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:32.272267 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:32.271804 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:32.272267 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:32.271883 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:32.272267 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:32.271954 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:33.443320 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:33.443287 2581 generic.go:356] "Generic (PLEG): container finished" podID="c59e5220-b40c-4200-8518-1245a923e31e" containerID="a4708f050aa662bc7dcb9130b2ad3d4a3da6841b3242519f1dff10dffa849851" exitCode=0 Jul 13 17:32:33.443894 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:33.443328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m99k8" event={"ID":"c59e5220-b40c-4200-8518-1245a923e31e","Type":"ContainerDied","Data":"a4708f050aa662bc7dcb9130b2ad3d4a3da6841b3242519f1dff10dffa849851"} Jul 13 17:32:34.271836 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:34.271808 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:34.271836 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:34.271838 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:34.272069 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:34.271912 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:34.272069 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:34.271808 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:34.272069 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:34.272007 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:34.272181 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:34.272084 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:35.030180 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:35.030097 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhqc\" (UniqueName: \"kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc\") pod \"network-check-target-dbxjz\" (UID: \"516b84e6-3a82-4946-ab74-8f1f2190a324\") " pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:35.030180 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:35.030142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:35.030630 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:35.030181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:35.030630 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:35.030267 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 17:32:35.030630 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:35.030291 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 17:32:35.030630 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:35.030294 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:35.030630 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:35.030305 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gqhqc for pod openshift-network-diagnostics/network-check-target-dbxjz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:35.030630 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:35.030349 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:35.030630 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:35.030356 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc podName:516b84e6-3a82-4946-ab74-8f1f2190a324 nodeName:}" failed. No retries permitted until 2026-07-13 17:33:07.030339518 +0000 UTC m=+66.173676587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gqhqc" (UniqueName: "kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc") pod "network-check-target-dbxjz" (UID: "516b84e6-3a82-4946-ab74-8f1f2190a324") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 17:32:35.030630 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:35.030413 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs podName:5d6545be-de38-4af4-bcc5-6495e8280e84 nodeName:}" failed. No retries permitted until 2026-07-13 17:33:07.030397279 +0000 UTC m=+66.173734335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs") pod "network-metrics-daemon-szztn" (UID: "5d6545be-de38-4af4-bcc5-6495e8280e84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 17:32:35.030630 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:35.030426 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret podName:d1a5f0ed-3a5f-43ac-9443-5e51a5190b41 nodeName:}" failed. No retries permitted until 2026-07-13 17:33:07.030418356 +0000 UTC m=+66.173755411 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret") pod "global-pull-secret-syncer-5ll5w" (UID: "d1a5f0ed-3a5f-43ac-9443-5e51a5190b41") : object "kube-system"/"original-pull-secret" not registered Jul 13 17:32:36.271783 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:36.271747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:36.272244 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:36.271850 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:36.272244 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:36.271864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:36.272244 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:36.271856 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbxjz" podUID="516b84e6-3a82-4946-ab74-8f1f2190a324" Jul 13 17:32:36.272244 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:36.271966 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szztn" podUID="5d6545be-de38-4af4-bcc5-6495e8280e84" Jul 13 17:32:36.272244 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:36.272037 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5ll5w" podUID="d1a5f0ed-3a5f-43ac-9443-5e51a5190b41" Jul 13 17:32:36.675261 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:36.675225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:37.220020 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.219988 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-186.ec2.internal" event="NodeReady" Jul 13 17:32:37.220192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.220130 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 17:32:37.255731 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.255695 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69fb45f8d5-zf5jw"] Jul 13 17:32:37.258088 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.258048 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.262603 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.262579 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 17:32:37.264788 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.264761 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 17:32:37.264913 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.264770 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 17:32:37.264913 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.264829 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k92hg\"" Jul 13 17:32:37.269352 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.269329 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xrnds"] Jul 13 17:32:37.270353 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.270337 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 17:32:37.271408 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.271392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.273824 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.273804 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 17:32:37.274227 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.274006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-225kz\"" Jul 13 17:32:37.274884 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.274857 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 17:32:37.275568 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.275549 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2fbmk"] Jul 13 17:32:37.277266 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.277142 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69fb45f8d5-zf5jw"] Jul 13 17:32:37.277266 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.277245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2fbmk" Jul 13 17:32:37.281243 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.281224 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 17:32:37.281243 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.281230 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dnkkg\"" Jul 13 17:32:37.281382 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.281335 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 17:32:37.281633 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.281605 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 17:32:37.283456 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.283408 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xrnds"] Jul 13 17:32:37.296432 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.296412 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2fbmk"] Jul 13 17:32:37.323096 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.323070 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:37.323747 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.323730 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8"] Jul 13 17:32:37.325720 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.325695 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8" Jul 13 17:32:37.328088 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.328070 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 13 17:32:37.328160 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.328085 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 13 17:32:37.328248 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.328232 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-27gtx\"" Jul 13 17:32:37.336172 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.336151 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8"] Jul 13 17:32:37.392548 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.392519 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:37.448821 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.448784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv4bx\" (UniqueName: \"kubernetes.io/projected/ff64bdec-6a35-4682-b14e-dea701370067-kube-api-access-bv4bx\") pod \"migrator-7f59b54f6c-fmxf8\" (UID: \"ff64bdec-6a35-4682-b14e-dea701370067\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8" Jul 13 17:32:37.448956 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.448830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-certificates\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.448956 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.448899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qmgh\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-kube-api-access-4qmgh\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.448956 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.448940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ptvh\" (UniqueName: \"kubernetes.io/projected/c9c07d18-f85a-422f-992c-dff31f06c5ae-kube-api-access-5ptvh\") pod \"ingress-canary-2fbmk\" (UID: \"c9c07d18-f85a-422f-992c-dff31f06c5ae\") " pod="openshift-ingress-canary/ingress-canary-2fbmk" Jul 13 17:32:37.449067 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.448991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fc843c4-f826-4302-8944-5d7888eb0b72-ca-trust-extracted\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.449067 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.449017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-bound-sa-token\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.449067 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.449037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-config-volume\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.449067 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.449059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-tmp-dir\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.449207 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.449080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-installation-pull-secrets\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.449207 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.449105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnq24\" (UniqueName: \"kubernetes.io/projected/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-kube-api-access-nnq24\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.449207 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.449133 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9c07d18-f85a-422f-992c-dff31f06c5ae-cert\") pod \"ingress-canary-2fbmk\" (UID: \"c9c07d18-f85a-422f-992c-dff31f06c5ae\") " pod="openshift-ingress-canary/ingress-canary-2fbmk" Jul 13 17:32:37.449207 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.449153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-image-registry-private-configuration\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.449207 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.449187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.449379 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.449255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.449379 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.449296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-trusted-ca\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.457828 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.457804 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:37.550162 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-tmp-dir\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.550268 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-installation-pull-secrets\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.550268 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnq24\" (UniqueName: \"kubernetes.io/projected/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-kube-api-access-nnq24\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.550268 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9c07d18-f85a-422f-992c-dff31f06c5ae-cert\") pod \"ingress-canary-2fbmk\" (UID: \"c9c07d18-f85a-422f-992c-dff31f06c5ae\") " pod="openshift-ingress-canary/ingress-canary-2fbmk" Jul 13 17:32:37.550416 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-image-registry-private-configuration\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.550416 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.550416 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.550564 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-trusted-ca\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.550564 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-tmp-dir\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.550564 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv4bx\" (UniqueName: \"kubernetes.io/projected/ff64bdec-6a35-4682-b14e-dea701370067-kube-api-access-bv4bx\") pod \"migrator-7f59b54f6c-fmxf8\" (UID: \"ff64bdec-6a35-4682-b14e-dea701370067\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8" Jul 13 17:32:37.550692 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:37.550597 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 17:32:37.550692 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:37.550646 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls podName:dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:38.050628648 +0000 UTC m=+37.193965714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls") pod "dns-default-xrnds" (UID: "dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99") : secret "dns-default-metrics-tls" not found Jul 13 17:32:37.550865 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-certificates\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.550865 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:37.550856 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 17:32:37.551027 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:37.550874 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69fb45f8d5-zf5jw: secret "image-registry-tls" not found Jul 13 17:32:37.551027 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qmgh\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-kube-api-access-4qmgh\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.551027 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:37.550918 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls podName:7fc843c4-f826-4302-8944-5d7888eb0b72 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:38.050902863 +0000 UTC m=+37.194239918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls") pod "image-registry-69fb45f8d5-zf5jw" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72") : secret "image-registry-tls" not found Jul 13 17:32:37.551027 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ptvh\" (UniqueName: \"kubernetes.io/projected/c9c07d18-f85a-422f-992c-dff31f06c5ae-kube-api-access-5ptvh\") pod \"ingress-canary-2fbmk\" (UID: \"c9c07d18-f85a-422f-992c-dff31f06c5ae\") " pod="openshift-ingress-canary/ingress-canary-2fbmk" Jul 13 17:32:37.551027 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fc843c4-f826-4302-8944-5d7888eb0b72-ca-trust-extracted\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.551027 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.550995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-bound-sa-token\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.551027 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.551019 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-config-volume\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.551405 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.551116 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-certificates\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.551534 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.551514 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-config-volume\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.551636 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.551548 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fc843c4-f826-4302-8944-5d7888eb0b72-ca-trust-extracted\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.551812 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.551791 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-trusted-ca\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.554847 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.554826 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-image-registry-private-configuration\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.554925 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.554826 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-installation-pull-secrets\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.554925 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.554882 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9c07d18-f85a-422f-992c-dff31f06c5ae-cert\") pod \"ingress-canary-2fbmk\" (UID: \"c9c07d18-f85a-422f-992c-dff31f06c5ae\") " pod="openshift-ingress-canary/ingress-canary-2fbmk" Jul 13 17:32:37.560264 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.560240 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qmgh\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-kube-api-access-4qmgh\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.560380 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.560343 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnq24\" (UniqueName: \"kubernetes.io/projected/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-kube-api-access-nnq24\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:37.560445 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.560394 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv4bx\" (UniqueName: \"kubernetes.io/projected/ff64bdec-6a35-4682-b14e-dea701370067-kube-api-access-bv4bx\") pod \"migrator-7f59b54f6c-fmxf8\" (UID: \"ff64bdec-6a35-4682-b14e-dea701370067\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8" Jul 13 17:32:37.564118 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.561103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ptvh\" (UniqueName: \"kubernetes.io/projected/c9c07d18-f85a-422f-992c-dff31f06c5ae-kube-api-access-5ptvh\") pod \"ingress-canary-2fbmk\" (UID: \"c9c07d18-f85a-422f-992c-dff31f06c5ae\") " pod="openshift-ingress-canary/ingress-canary-2fbmk" Jul 13 17:32:37.564118 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.560919 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-bound-sa-token\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:37.588872 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.588840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2fbmk" Jul 13 17:32:37.636755 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.636729 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8" Jul 13 17:32:37.720421 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.720323 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2fbmk"] Jul 13 17:32:37.723809 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:37.723769 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c07d18_f85a_422f_992c_dff31f06c5ae.slice/crio-ca68d76d17c39942d3ae761aa48d6bf95442f1e691707bbf98d7966105bafee2 WatchSource:0}: Error finding container ca68d76d17c39942d3ae761aa48d6bf95442f1e691707bbf98d7966105bafee2: Status 404 returned error can't find the container with id ca68d76d17c39942d3ae761aa48d6bf95442f1e691707bbf98d7966105bafee2 Jul 13 17:32:37.815748 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.815719 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-skflw"] Jul 13 17:32:37.817548 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.817529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:37.820523 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.820502 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6jxkx\"" Jul 13 17:32:37.820639 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.820547 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 17:32:37.820639 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.820572 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 17:32:37.820639 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.820555 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 17:32:37.820639 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.820552 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 17:32:37.831343 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.831321 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-skflw"] Jul 13 17:32:37.832563 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.832203 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8"] Jul 13 17:32:37.834772 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:37.834740 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff64bdec_6a35_4682_b14e_dea701370067.slice/crio-f0d88d26db6f5aadff38416bb651ae61c9d3ed15f5f757882ba248c4dda69c7c WatchSource:0}: Error finding container f0d88d26db6f5aadff38416bb651ae61c9d3ed15f5f757882ba248c4dda69c7c: Status 404 returned error can't find the container with id f0d88d26db6f5aadff38416bb651ae61c9d3ed15f5f757882ba248c4dda69c7c Jul 13 17:32:37.854901 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.854873 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:37.909763 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.909737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:37.954262 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.954240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34deecc7-c772-4443-acff-dafaa5c2ee14-crio-socket\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:37.954341 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.954291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:37.954341 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.954335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34deecc7-c772-4443-acff-dafaa5c2ee14-data-volume\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:37.954421 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.954382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:37.954470 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:37.954417 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg2c5\" (UniqueName: \"kubernetes.io/projected/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-api-access-cg2c5\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.055672 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.055589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.055672 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.055628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34deecc7-c772-4443-acff-dafaa5c2ee14-data-volume\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.055881 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.055683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:38.055881 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.055715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.055881 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.055743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:38.055881 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.055766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg2c5\" (UniqueName: \"kubernetes.io/projected/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-api-access-cg2c5\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.055881 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.055809 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 17:32:38.055881 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.055845 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:32:38.055881 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.055862 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 17:32:38.055881 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.055875 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69fb45f8d5-zf5jw: secret "image-registry-tls" not found Jul 13 17:32:38.056156 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.055815 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 17:32:38.056156 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.055921 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls podName:7fc843c4-f826-4302-8944-5d7888eb0b72 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:39.055901515 +0000 UTC m=+38.199238583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls") pod "image-registry-69fb45f8d5-zf5jw" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72") : secret "image-registry-tls" not found Jul 13 17:32:38.056156 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.055955 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:38.55593942 +0000 UTC m=+37.699276472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : secret "insights-runtime-extractor-tls" not found Jul 13 17:32:38.056156 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.055970 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34deecc7-c772-4443-acff-dafaa5c2ee14-data-volume\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.056156 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.055976 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:38.555967081 +0000 UTC m=+37.699304137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : configmap "kube-rbac-proxy" not found Jul 13 17:32:38.056156 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.056018 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls podName:dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:39.056004121 +0000 UTC m=+38.199341173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls") pod "dns-default-xrnds" (UID: "dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99") : secret "dns-default-metrics-tls" not found Jul 13 17:32:38.056156 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.056067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34deecc7-c772-4443-acff-dafaa5c2ee14-crio-socket\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.056373 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.056243 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34deecc7-c772-4443-acff-dafaa5c2ee14-crio-socket\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.064698 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.064681 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg2c5\" (UniqueName: \"kubernetes.io/projected/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-api-access-cg2c5\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.247646 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.247615 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:38.272015 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.271987 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:32:38.272015 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.272000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:32:38.272167 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.272147 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:32:38.274999 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.274819 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 17:32:38.274999 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.274860 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 17:32:38.274999 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.274897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jvwf\"" Jul 13 17:32:38.274999 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.274958 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 17:32:38.275831 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.275811 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vn7td\"" Jul 13 17:32:38.275949 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.275880 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 17:32:38.457522 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.457490 2581 generic.go:356] "Generic (PLEG): container finished" podID="c59e5220-b40c-4200-8518-1245a923e31e" containerID="53b971e7e4b3f0ffb6fcb49ee60dbd66a94e7d04cfa4723ce69f27ca47ccc6a3" exitCode=0 Jul 13 17:32:38.457697 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.457536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m99k8" event={"ID":"c59e5220-b40c-4200-8518-1245a923e31e","Type":"ContainerDied","Data":"53b971e7e4b3f0ffb6fcb49ee60dbd66a94e7d04cfa4723ce69f27ca47ccc6a3"} Jul 13 17:32:38.458894 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.458869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8" event={"ID":"ff64bdec-6a35-4682-b14e-dea701370067","Type":"ContainerStarted","Data":"f0d88d26db6f5aadff38416bb651ae61c9d3ed15f5f757882ba248c4dda69c7c"} Jul 13 17:32:38.460131 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.460107 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2fbmk" event={"ID":"c9c07d18-f85a-422f-992c-dff31f06c5ae","Type":"ContainerStarted","Data":"ca68d76d17c39942d3ae761aa48d6bf95442f1e691707bbf98d7966105bafee2"} Jul 13 17:32:38.560287 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.559655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.560287 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.559753 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 17:32:38.560287 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.559807 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:39.559788824 +0000 UTC m=+38.703125891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : configmap "kube-rbac-proxy" not found Jul 13 17:32:38.560287 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.559956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:38.560287 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.560233 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:32:38.560287 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:38.560283 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:39.560267454 +0000 UTC m=+38.703604521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : secret "insights-runtime-extractor-tls" not found Jul 13 17:32:38.671574 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.671321 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:38.726070 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.725986 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:38.952891 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:38.952857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:39.009845 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.009771 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:39.063993 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.063960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:39.064145 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.064003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:39.064145 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:39.064123 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 17:32:39.064145 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:39.064126 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 17:32:39.064259 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:39.064189 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls podName:dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:41.064173767 +0000 UTC m=+40.207510821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls") pod "dns-default-xrnds" (UID: "dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99") : secret "dns-default-metrics-tls" not found Jul 13 17:32:39.064259 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:39.064134 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69fb45f8d5-zf5jw: secret "image-registry-tls" not found Jul 13 17:32:39.064259 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:39.064261 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls podName:7fc843c4-f826-4302-8944-5d7888eb0b72 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:41.064247493 +0000 UTC m=+40.207584560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls") pod "image-registry-69fb45f8d5-zf5jw" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72") : secret "image-registry-tls" not found Jul 13 17:32:39.465372 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.465341 2581 generic.go:356] "Generic (PLEG): container finished" podID="c59e5220-b40c-4200-8518-1245a923e31e" containerID="c0a8f06378393794b536a51c9715c675d458856c67f1ece13fd2073af76e137a" exitCode=0 Jul 13 17:32:39.465979 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.465422 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m99k8" event={"ID":"c59e5220-b40c-4200-8518-1245a923e31e","Type":"ContainerDied","Data":"c0a8f06378393794b536a51c9715c675d458856c67f1ece13fd2073af76e137a"} Jul 13 17:32:39.467082 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.467047 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8" event={"ID":"ff64bdec-6a35-4682-b14e-dea701370067","Type":"ContainerStarted","Data":"50abbb318ec5c528e57b30d6ae1229feb7237d89e475403da637eeb118df065c"} Jul 13 17:32:39.467190 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.467092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8" event={"ID":"ff64bdec-6a35-4682-b14e-dea701370067","Type":"ContainerStarted","Data":"d6342bad8fb2b757330e89c5f4244abbee655602c68769d18116bab49cd60e48"} Jul 13 17:32:39.505317 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.505254 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fmxf8" podStartSLOduration=1.118942369 podStartE2EDuration="2.505233741s" totalImagesPullingTime="1.386291372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:39.504726276 +0000 UTC m=+38.648063369" watchObservedRunningTime="2026-07-13 17:32:39.505233741 +0000 UTC m=+38.648570816" Jul 13 17:32:39.568407 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.568379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:39.568669 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:39.568499 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 17:32:39.568669 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:39.568559 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:41.568540829 +0000 UTC m=+40.711877880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : configmap "kube-rbac-proxy" not found Jul 13 17:32:39.568669 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.568659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:39.568839 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:39.568786 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:32:39.568882 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:39.568840 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:41.568821052 +0000 UTC m=+40.712158105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : secret "insights-runtime-extractor-tls" not found Jul 13 17:32:39.826573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:39.826492 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:40.409947 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.409874 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zvkj2_379bbd4a-8b61-4fdd-b17b-e1e77e063c32/dns-node-resolver/0.log" Jul 13 17:32:40.474521 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.474482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m99k8" event={"ID":"c59e5220-b40c-4200-8518-1245a923e31e","Type":"ContainerStarted","Data":"cfa194da82463cd62e8250aaffec2fecdad5eab616649d977ab21e7af1ac60fa"} Jul 13 17:32:40.496881 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.496823 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m99k8" podStartSLOduration=9.436214461 podStartE2EDuration="39.496802569s" totalImagesPullingTime="30.060588108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:40.494911335 +0000 UTC m=+39.638248410" watchObservedRunningTime="2026-07-13 17:32:40.496802569 +0000 UTC m=+39.640139641" Jul 13 17:32:40.548009 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.547980 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-v5d5j"] Jul 13 17:32:40.578697 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.578671 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-v5d5j"] Jul 13 17:32:40.578857 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.578772 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.581125 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.581098 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 13 17:32:40.581125 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.581113 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-r25t9\"" Jul 13 17:32:40.581125 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.581124 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 13 17:32:40.581332 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.581180 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 13 17:32:40.581332 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.581208 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 13 17:32:40.625918 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.625894 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:40.676336 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.676271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7qsb\" (UniqueName: \"kubernetes.io/projected/a296a8a3-c141-4f62-a246-c823770cdb26-kube-api-access-v7qsb\") pod \"service-ca-79f68b9f4f-v5d5j\" (UID: \"a296a8a3-c141-4f62-a246-c823770cdb26\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.676336 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.676328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a296a8a3-c141-4f62-a246-c823770cdb26-signing-cabundle\") pod \"service-ca-79f68b9f4f-v5d5j\" (UID: \"a296a8a3-c141-4f62-a246-c823770cdb26\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.676505 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.676386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a296a8a3-c141-4f62-a246-c823770cdb26-signing-key\") pod \"service-ca-79f68b9f4f-v5d5j\" (UID: \"a296a8a3-c141-4f62-a246-c823770cdb26\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.681924 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.681905 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:40.777538 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.777506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7qsb\" (UniqueName: \"kubernetes.io/projected/a296a8a3-c141-4f62-a246-c823770cdb26-kube-api-access-v7qsb\") pod \"service-ca-79f68b9f4f-v5d5j\" (UID: \"a296a8a3-c141-4f62-a246-c823770cdb26\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.777656 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.777592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a296a8a3-c141-4f62-a246-c823770cdb26-signing-cabundle\") pod \"service-ca-79f68b9f4f-v5d5j\" (UID: \"a296a8a3-c141-4f62-a246-c823770cdb26\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.777693 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.777662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a296a8a3-c141-4f62-a246-c823770cdb26-signing-key\") pod \"service-ca-79f68b9f4f-v5d5j\" (UID: \"a296a8a3-c141-4f62-a246-c823770cdb26\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.778331 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.778314 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a296a8a3-c141-4f62-a246-c823770cdb26-signing-cabundle\") pod \"service-ca-79f68b9f4f-v5d5j\" (UID: \"a296a8a3-c141-4f62-a246-c823770cdb26\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.780766 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.780747 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a296a8a3-c141-4f62-a246-c823770cdb26-signing-key\") pod \"service-ca-79f68b9f4f-v5d5j\" (UID: \"a296a8a3-c141-4f62-a246-c823770cdb26\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.786064 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.786043 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7qsb\" (UniqueName: \"kubernetes.io/projected/a296a8a3-c141-4f62-a246-c823770cdb26-kube-api-access-v7qsb\") pod \"service-ca-79f68b9f4f-v5d5j\" (UID: \"a296a8a3-c141-4f62-a246-c823770cdb26\") " pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.885932 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.885907 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:40.890870 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.890852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" Jul 13 17:32:40.990894 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:40.990865 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:41.011759 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.011737 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9gc6l_467e00ec-3e11-4c74-bde3-dc536c806ca5/node-ca/0.log" Jul 13 17:32:41.027010 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.026978 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-v5d5j"] Jul 13 17:32:41.031670 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:41.031645 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda296a8a3_c141_4f62_a246_c823770cdb26.slice/crio-debfdf0e70eda9a214eed57bfdd137f018dd2c2e2baf257b08a3fad701f8c982 WatchSource:0}: Error finding container debfdf0e70eda9a214eed57bfdd137f018dd2c2e2baf257b08a3fad701f8c982: Status 404 returned error can't find the container with id debfdf0e70eda9a214eed57bfdd137f018dd2c2e2baf257b08a3fad701f8c982 Jul 13 17:32:41.080565 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.080535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:41.080719 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.080576 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:41.080719 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:41.080678 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 17:32:41.080719 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:41.080689 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69fb45f8d5-zf5jw: secret "image-registry-tls" not found Jul 13 17:32:41.080719 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:41.080693 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 17:32:41.080881 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:41.080735 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls podName:7fc843c4-f826-4302-8944-5d7888eb0b72 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.080721856 +0000 UTC m=+44.224058910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls") pod "image-registry-69fb45f8d5-zf5jw" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72") : secret "image-registry-tls" not found Jul 13 17:32:41.080881 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:41.080810 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls podName:dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.080791488 +0000 UTC m=+44.224128544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls") pod "dns-default-xrnds" (UID: "dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99") : secret "dns-default-metrics-tls" not found Jul 13 17:32:41.481310 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.481271 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2fbmk" event={"ID":"c9c07d18-f85a-422f-992c-dff31f06c5ae","Type":"ContainerStarted","Data":"a993baaa53bd4ddc7bce12fb7b76b291e9afc85427364d57993b03e1111f500b"} Jul 13 17:32:41.482430 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.482408 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" event={"ID":"a296a8a3-c141-4f62-a246-c823770cdb26","Type":"ContainerStarted","Data":"debfdf0e70eda9a214eed57bfdd137f018dd2c2e2baf257b08a3fad701f8c982"} Jul 13 17:32:41.498843 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.498802 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2fbmk" podStartSLOduration=1.3379106649999999 podStartE2EDuration="4.498787386s" totalImagesPullingTime="3.160876721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:41.497891877 +0000 UTC m=+40.641228951" watchObservedRunningTime="2026-07-13 17:32:41.498787386 +0000 UTC m=+40.642124489" Jul 13 17:32:41.585169 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.585132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:41.585326 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:41.585289 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:32:41.585394 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:41.585380 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.585359412 +0000 UTC m=+44.728696476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : secret "insights-runtime-extractor-tls" not found Jul 13 17:32:41.585452 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.585406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:41.585518 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:41.585479 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 17:32:41.585558 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:41.585547 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.585529212 +0000 UTC m=+44.728866275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : configmap "kube-rbac-proxy" not found Jul 13 17:32:41.643028 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.643000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:41.813705 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:41.813634 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2fbmk_c9c07d18-f85a-422f-992c-dff31f06c5ae/serve-healthcheck-canary/0.log" Jul 13 17:32:42.211441 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:42.211411 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fmxf8_ff64bdec-6a35-4682-b14e-dea701370067/migrator/0.log" Jul 13 17:32:42.410892 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:42.410862 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fmxf8_ff64bdec-6a35-4682-b14e-dea701370067/graceful-termination/0.log" Jul 13 17:32:43.655478 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:43.655424 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:45.114190 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:45.114158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:45.114626 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:45.114197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:45.114626 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:45.114319 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 17:32:45.114626 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:45.114330 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69fb45f8d5-zf5jw: secret "image-registry-tls" not found Jul 13 17:32:45.114626 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:45.114340 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 17:32:45.114626 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:45.114380 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls podName:7fc843c4-f826-4302-8944-5d7888eb0b72 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:53.114364614 +0000 UTC m=+52.257701665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls") pod "image-registry-69fb45f8d5-zf5jw" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72") : secret "image-registry-tls" not found Jul 13 17:32:45.114626 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:45.114401 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls podName:dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:53.114384953 +0000 UTC m=+52.257722019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls") pod "dns-default-xrnds" (UID: "dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99") : secret "dns-default-metrics-tls" not found Jul 13 17:32:45.492950 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:45.492866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" event={"ID":"a296a8a3-c141-4f62-a246-c823770cdb26","Type":"ContainerStarted","Data":"373f7bb4a3f3384677eacae541ae5df684251f8b705544938eff023b1619cecc"} Jul 13 17:32:45.508597 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:45.508553 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-v5d5j" podStartSLOduration=2.109159326 podStartE2EDuration="5.508538876s" totalImagesPullingTime="3.39937955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:45.507257923 +0000 UTC m=+44.650595001" watchObservedRunningTime="2026-07-13 17:32:45.508538876 +0000 UTC m=+44.651875948" Jul 13 17:32:45.617769 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:45.617739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:45.617915 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:45.617822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:45.617915 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:45.617879 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:32:45.617915 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:45.617892 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 17:32:45.618008 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:45.617940 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:53.617925755 +0000 UTC m=+52.761262806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : secret "insights-runtime-extractor-tls" not found Jul 13 17:32:45.618008 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:45.617957 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:53.617950736 +0000 UTC m=+52.761287787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : configmap "kube-rbac-proxy" not found Jul 13 17:32:45.776426 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:45.776345 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:45.969077 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:45.969043 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:46.070032 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:46.069956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:46.168250 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:46.168215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:46.271132 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:46.271070 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:46.486030 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:46.485999 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:47.473932 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:47.473895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:47.684657 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:47.684613 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" limit=1024 Jul 13 17:32:53.180832 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.180801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:53.181209 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.180840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:53.182998 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.182966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99-metrics-tls\") pod \"dns-default-xrnds\" (UID: \"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99\") " pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:53.183239 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.183219 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls\") pod \"image-registry-69fb45f8d5-zf5jw\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:53.470300 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.470216 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:53.482353 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.482325 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:53.623990 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.623964 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69fb45f8d5-zf5jw"] Jul 13 17:32:53.626654 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:53.626630 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc843c4_f826_4302_8944_5d7888eb0b72.slice/crio-819809ca88c9b223054130ad99575334b8d9831870972e5ab87e1bb0225492a2 WatchSource:0}: Error finding container 819809ca88c9b223054130ad99575334b8d9831870972e5ab87e1bb0225492a2: Status 404 returned error can't find the container with id 819809ca88c9b223054130ad99575334b8d9831870972e5ab87e1bb0225492a2 Jul 13 17:32:53.638124 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.638103 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xrnds"] Jul 13 17:32:53.640885 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:53.640863 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd43cb07_d3fd_4fa8_b91f_f9ce5912bb99.slice/crio-24b3d687b4bac15238ca2202d59d2e0315ce78f9154d288b2bbaa6f400e8f437 WatchSource:0}: Error finding container 24b3d687b4bac15238ca2202d59d2e0315ce78f9154d288b2bbaa6f400e8f437: Status 404 returned error can't find the container with id 24b3d687b4bac15238ca2202d59d2e0315ce78f9154d288b2bbaa6f400e8f437 Jul 13 17:32:53.685261 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.685235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:53.685360 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.685324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:53.685420 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:53.685380 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 17:32:53.685494 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:32:53.685443 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls podName:34deecc7-c772-4443-acff-dafaa5c2ee14 nodeName:}" failed. No retries permitted until 2026-07-13 17:33:09.685422433 +0000 UTC m=+68.828759489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skflw" (UID: "34deecc7-c772-4443-acff-dafaa5c2ee14") : secret "insights-runtime-extractor-tls" not found Jul 13 17:32:53.685816 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:53.685796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34deecc7-c772-4443-acff-dafaa5c2ee14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:32:54.517634 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:54.517590 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xrnds" event={"ID":"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99","Type":"ContainerStarted","Data":"24b3d687b4bac15238ca2202d59d2e0315ce78f9154d288b2bbaa6f400e8f437"} Jul 13 17:32:54.519161 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:54.519130 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" event={"ID":"7fc843c4-f826-4302-8944-5d7888eb0b72","Type":"ContainerStarted","Data":"d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462"} Jul 13 17:32:54.519289 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:54.519178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" event={"ID":"7fc843c4-f826-4302-8944-5d7888eb0b72","Type":"ContainerStarted","Data":"819809ca88c9b223054130ad99575334b8d9831870972e5ab87e1bb0225492a2"} Jul 13 17:32:54.519354 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:54.519281 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:32:54.539610 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:54.539568 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" podStartSLOduration=25.539550906 podStartE2EDuration="25.539550906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:54.538357023 +0000 UTC m=+53.681694096" watchObservedRunningTime="2026-07-13 17:32:54.539550906 +0000 UTC m=+53.682887971" Jul 13 17:32:56.527059 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:56.527020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xrnds" event={"ID":"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99","Type":"ContainerStarted","Data":"4a9f73a5fb6aa1f6edb333f2e969ecd7f3dafbbe1764819168fb29533be99075"} Jul 13 17:32:56.527483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:56.527086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xrnds" event={"ID":"dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99","Type":"ContainerStarted","Data":"0979f9c2c921b94477ebe215ca5fde189e5f961307c5e6f53756d28f7e48ff95"} Jul 13 17:32:56.527483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:56.527172 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xrnds" Jul 13 17:32:56.544806 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:56.544767 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xrnds" podStartSLOduration=17.489369461 podStartE2EDuration="19.54475306s" totalImagesPullingTime="2.055383599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:56.543420594 +0000 UTC m=+55.686757668" watchObservedRunningTime="2026-07-13 17:32:56.54475306 +0000 UTC m=+55.688090132" Jul 13 17:32:59.254943 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.254908 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq"] Jul 13 17:32:59.258645 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.258625 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.259407 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.259387 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd"] Jul 13 17:32:59.262438 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.262419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" Jul 13 17:32:59.262685 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.262669 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 17:32:59.262947 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.262912 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 17:32:59.262947 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.262923 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 17:32:59.264057 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.264041 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 13 17:32:59.265253 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.265234 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 13 17:32:59.265323 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.265232 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-98z8b\"" Jul 13 17:32:59.268834 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.268818 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq"] Jul 13 17:32:59.280504 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.280483 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd"] Jul 13 17:32:59.291374 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.291350 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69fb45f8d5-zf5jw"] Jul 13 17:32:59.327206 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.327175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zng9\" (UniqueName: \"kubernetes.io/projected/e4bc123c-200a-4eda-9788-7b93c48f3b74-kube-api-access-4zng9\") pod \"klusterlet-addon-workmgr-76b6cb56d9-75hjq\" (UID: \"e4bc123c-200a-4eda-9788-7b93c48f3b74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.327206 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.327212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4bc123c-200a-4eda-9788-7b93c48f3b74-klusterlet-config\") pod \"klusterlet-addon-workmgr-76b6cb56d9-75hjq\" (UID: \"e4bc123c-200a-4eda-9788-7b93c48f3b74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.327430 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.327252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-267tf\" (UniqueName: \"kubernetes.io/projected/f94cd4fa-f63f-48e8-a04a-77bdbeac19e6-kube-api-access-267tf\") pod \"managed-serviceaccount-addon-agent-564859c584-tgmnd\" (UID: \"f94cd4fa-f63f-48e8-a04a-77bdbeac19e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" Jul 13 17:32:59.327430 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.327303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f94cd4fa-f63f-48e8-a04a-77bdbeac19e6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-564859c584-tgmnd\" (UID: \"f94cd4fa-f63f-48e8-a04a-77bdbeac19e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" Jul 13 17:32:59.327430 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.327413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4bc123c-200a-4eda-9788-7b93c48f3b74-tmp\") pod \"klusterlet-addon-workmgr-76b6cb56d9-75hjq\" (UID: \"e4bc123c-200a-4eda-9788-7b93c48f3b74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.349970 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.349940 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-p288b"] Jul 13 17:32:59.352957 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.352943 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-p288b" Jul 13 17:32:59.354828 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.354803 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78fcd886cc-74ncv"] Jul 13 17:32:59.355685 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.355663 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 17:32:59.355805 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.355670 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 17:32:59.355805 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.355734 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6zwzd\"" Jul 13 17:32:59.357671 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.357652 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.363997 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.363976 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-p288b"] Jul 13 17:32:59.369910 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.369884 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78fcd886cc-74ncv"] Jul 13 17:32:59.428142 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l4k5\" (UniqueName: \"kubernetes.io/projected/71eba6d9-6eb1-4e21-a3a2-cd73a5a5be78-kube-api-access-4l4k5\") pod \"downloads-68c9cbb497-p288b\" (UID: \"71eba6d9-6eb1-4e21-a3a2-cd73a5a5be78\") " pod="openshift-console/downloads-68c9cbb497-p288b" Jul 13 17:32:59.428142 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe541a74-b32a-411d-8c55-389759dee843-trusted-ca\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.428356 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe541a74-b32a-411d-8c55-389759dee843-installation-pull-secrets\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.428356 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4bc123c-200a-4eda-9788-7b93c48f3b74-tmp\") pod \"klusterlet-addon-workmgr-76b6cb56d9-75hjq\" (UID: \"e4bc123c-200a-4eda-9788-7b93c48f3b74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.428356 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428220 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe541a74-b32a-411d-8c55-389759dee843-image-registry-private-configuration\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.428356 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe541a74-b32a-411d-8c55-389759dee843-registry-certificates\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.428356 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zng9\" (UniqueName: \"kubernetes.io/projected/e4bc123c-200a-4eda-9788-7b93c48f3b74-kube-api-access-4zng9\") pod \"klusterlet-addon-workmgr-76b6cb56d9-75hjq\" (UID: \"e4bc123c-200a-4eda-9788-7b93c48f3b74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.428549 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4bc123c-200a-4eda-9788-7b93c48f3b74-klusterlet-config\") pod \"klusterlet-addon-workmgr-76b6cb56d9-75hjq\" (UID: \"e4bc123c-200a-4eda-9788-7b93c48f3b74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.428549 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-267tf\" (UniqueName: \"kubernetes.io/projected/f94cd4fa-f63f-48e8-a04a-77bdbeac19e6-kube-api-access-267tf\") pod \"managed-serviceaccount-addon-agent-564859c584-tgmnd\" (UID: \"f94cd4fa-f63f-48e8-a04a-77bdbeac19e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" Jul 13 17:32:59.428549 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe541a74-b32a-411d-8c55-389759dee843-registry-tls\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.428549 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe541a74-b32a-411d-8c55-389759dee843-ca-trust-extracted\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.428549 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f94cd4fa-f63f-48e8-a04a-77bdbeac19e6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-564859c584-tgmnd\" (UID: \"f94cd4fa-f63f-48e8-a04a-77bdbeac19e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" Jul 13 17:32:59.428716 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428550 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4bc123c-200a-4eda-9788-7b93c48f3b74-tmp\") pod \"klusterlet-addon-workmgr-76b6cb56d9-75hjq\" (UID: \"e4bc123c-200a-4eda-9788-7b93c48f3b74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.428716 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbs2k\" (UniqueName: \"kubernetes.io/projected/fe541a74-b32a-411d-8c55-389759dee843-kube-api-access-mbs2k\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.428716 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.428608 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe541a74-b32a-411d-8c55-389759dee843-bound-sa-token\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.431039 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.431012 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4bc123c-200a-4eda-9788-7b93c48f3b74-klusterlet-config\") pod \"klusterlet-addon-workmgr-76b6cb56d9-75hjq\" (UID: \"e4bc123c-200a-4eda-9788-7b93c48f3b74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.431158 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.431099 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f94cd4fa-f63f-48e8-a04a-77bdbeac19e6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-564859c584-tgmnd\" (UID: \"f94cd4fa-f63f-48e8-a04a-77bdbeac19e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" Jul 13 17:32:59.437567 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.437536 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-267tf\" (UniqueName: \"kubernetes.io/projected/f94cd4fa-f63f-48e8-a04a-77bdbeac19e6-kube-api-access-267tf\") pod \"managed-serviceaccount-addon-agent-564859c584-tgmnd\" (UID: \"f94cd4fa-f63f-48e8-a04a-77bdbeac19e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" Jul 13 17:32:59.437744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.437719 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zng9\" (UniqueName: \"kubernetes.io/projected/e4bc123c-200a-4eda-9788-7b93c48f3b74-kube-api-access-4zng9\") pod \"klusterlet-addon-workmgr-76b6cb56d9-75hjq\" (UID: \"e4bc123c-200a-4eda-9788-7b93c48f3b74\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.529414 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.529334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l4k5\" (UniqueName: \"kubernetes.io/projected/71eba6d9-6eb1-4e21-a3a2-cd73a5a5be78-kube-api-access-4l4k5\") pod \"downloads-68c9cbb497-p288b\" (UID: \"71eba6d9-6eb1-4e21-a3a2-cd73a5a5be78\") " pod="openshift-console/downloads-68c9cbb497-p288b" Jul 13 17:32:59.529414 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.529365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe541a74-b32a-411d-8c55-389759dee843-trusted-ca\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.529414 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.529383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe541a74-b32a-411d-8c55-389759dee843-installation-pull-secrets\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.529414 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.529406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe541a74-b32a-411d-8c55-389759dee843-image-registry-private-configuration\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.529743 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.529423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe541a74-b32a-411d-8c55-389759dee843-registry-certificates\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.529743 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.529491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe541a74-b32a-411d-8c55-389759dee843-registry-tls\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.529743 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.529507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe541a74-b32a-411d-8c55-389759dee843-ca-trust-extracted\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.529743 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.529543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbs2k\" (UniqueName: \"kubernetes.io/projected/fe541a74-b32a-411d-8c55-389759dee843-kube-api-access-mbs2k\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.529743 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.529567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe541a74-b32a-411d-8c55-389759dee843-bound-sa-token\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.530309 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.530230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fe541a74-b32a-411d-8c55-389759dee843-ca-trust-extracted\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.534203 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.530951 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fe541a74-b32a-411d-8c55-389759dee843-registry-certificates\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.534203 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.531252 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe541a74-b32a-411d-8c55-389759dee843-trusted-ca\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.534203 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.532531 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fe541a74-b32a-411d-8c55-389759dee843-image-registry-private-configuration\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.534203 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.532626 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fe541a74-b32a-411d-8c55-389759dee843-installation-pull-secrets\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.534203 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.532717 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fe541a74-b32a-411d-8c55-389759dee843-registry-tls\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.542362 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.542341 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbs2k\" (UniqueName: \"kubernetes.io/projected/fe541a74-b32a-411d-8c55-389759dee843-kube-api-access-mbs2k\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.542450 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.542407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe541a74-b32a-411d-8c55-389759dee843-bound-sa-token\") pod \"image-registry-78fcd886cc-74ncv\" (UID: \"fe541a74-b32a-411d-8c55-389759dee843\") " pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.542565 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.542550 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l4k5\" (UniqueName: \"kubernetes.io/projected/71eba6d9-6eb1-4e21-a3a2-cd73a5a5be78-kube-api-access-4l4k5\") pod \"downloads-68c9cbb497-p288b\" (UID: \"71eba6d9-6eb1-4e21-a3a2-cd73a5a5be78\") " pod="openshift-console/downloads-68c9cbb497-p288b" Jul 13 17:32:59.568117 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.568098 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:32:59.581796 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.581779 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" Jul 13 17:32:59.664744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.664678 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-p288b" Jul 13 17:32:59.668178 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.667913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:32:59.697537 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.697368 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq"] Jul 13 17:32:59.702725 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:59.702692 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4bc123c_200a_4eda_9788_7b93c48f3b74.slice/crio-ce04432d2acc225bf5ac8477052fae843c088a91387b813fc26260aa0465763f WatchSource:0}: Error finding container ce04432d2acc225bf5ac8477052fae843c088a91387b813fc26260aa0465763f: Status 404 returned error can't find the container with id ce04432d2acc225bf5ac8477052fae843c088a91387b813fc26260aa0465763f Jul 13 17:32:59.717029 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.716999 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd"] Jul 13 17:32:59.722481 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:59.722417 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf94cd4fa_f63f_48e8_a04a_77bdbeac19e6.slice/crio-6af2ce9afb9acb89fb19459b64c0707abecf81d1999ed098dda56026b0a834c4 WatchSource:0}: Error finding container 6af2ce9afb9acb89fb19459b64c0707abecf81d1999ed098dda56026b0a834c4: Status 404 returned error can't find the container with id 6af2ce9afb9acb89fb19459b64c0707abecf81d1999ed098dda56026b0a834c4 Jul 13 17:32:59.799422 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.799400 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78fcd886cc-74ncv"] Jul 13 17:32:59.801475 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:59.801437 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe541a74_b32a_411d_8c55_389759dee843.slice/crio-3fa34393dcfe13f4034d0f8de32c29e2e6812df54a97421716c331b3129d6ec8 WatchSource:0}: Error finding container 3fa34393dcfe13f4034d0f8de32c29e2e6812df54a97421716c331b3129d6ec8: Status 404 returned error can't find the container with id 3fa34393dcfe13f4034d0f8de32c29e2e6812df54a97421716c331b3129d6ec8 Jul 13 17:32:59.820289 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:32:59.820265 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-p288b"] Jul 13 17:32:59.842441 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:32:59.842413 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71eba6d9_6eb1_4e21_a3a2_cd73a5a5be78.slice/crio-b9ed8db4fc2418d72b8c6214866dd4abec975d02edd0dafa94c1fea2dc7edd66 WatchSource:0}: Error finding container b9ed8db4fc2418d72b8c6214866dd4abec975d02edd0dafa94c1fea2dc7edd66: Status 404 returned error can't find the container with id b9ed8db4fc2418d72b8c6214866dd4abec975d02edd0dafa94c1fea2dc7edd66 Jul 13 17:33:00.545139 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:00.545023 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-p288b" event={"ID":"71eba6d9-6eb1-4e21-a3a2-cd73a5a5be78","Type":"ContainerStarted","Data":"b9ed8db4fc2418d72b8c6214866dd4abec975d02edd0dafa94c1fea2dc7edd66"} Jul 13 17:33:00.547782 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:00.547725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" event={"ID":"f94cd4fa-f63f-48e8-a04a-77bdbeac19e6","Type":"ContainerStarted","Data":"6af2ce9afb9acb89fb19459b64c0707abecf81d1999ed098dda56026b0a834c4"} Jul 13 17:33:00.550093 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:00.550068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" event={"ID":"fe541a74-b32a-411d-8c55-389759dee843","Type":"ContainerStarted","Data":"a01ba2332103648a91a0dad4bf59333834f4e8181f0843eff195048c8ffc6e54"} Jul 13 17:33:00.550217 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:00.550114 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" event={"ID":"fe541a74-b32a-411d-8c55-389759dee843","Type":"ContainerStarted","Data":"3fa34393dcfe13f4034d0f8de32c29e2e6812df54a97421716c331b3129d6ec8"} Jul 13 17:33:00.550406 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:00.550363 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:33:00.552680 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:00.552566 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" event={"ID":"e4bc123c-200a-4eda-9788-7b93c48f3b74","Type":"ContainerStarted","Data":"ce04432d2acc225bf5ac8477052fae843c088a91387b813fc26260aa0465763f"} Jul 13 17:33:00.572899 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:00.572842 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" podStartSLOduration=1.5728240759999998 podStartE2EDuration="1.572824076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:00.572407078 +0000 UTC m=+59.715744151" watchObservedRunningTime="2026-07-13 17:33:00.572824076 +0000 UTC m=+59.716161144" Jul 13 17:33:01.467760 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:01.467699 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n8m7v" Jul 13 17:33:04.032880 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.032848 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5db665c46d-5k7f4"] Jul 13 17:33:04.035958 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.035929 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.038657 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.038629 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 17:33:04.038828 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.038810 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 17:33:04.038899 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.038863 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 17:33:04.039177 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.039023 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 17:33:04.039640 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.039411 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cjph7\"" Jul 13 17:33:04.039640 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.039440 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 17:33:04.047927 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.047900 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5db665c46d-5k7f4"] Jul 13 17:33:04.179962 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.179921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-config\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.180161 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.180016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-service-ca\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.180161 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.180049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-serving-cert\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.180161 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.180110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-oauth-config\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.180329 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.180171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k689b\" (UniqueName: \"kubernetes.io/projected/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-kube-api-access-k689b\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.180329 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.180202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-oauth-serving-cert\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.280726 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.280677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-config\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.280919 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.280775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-service-ca\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.280919 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.280804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-serving-cert\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.280919 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.280831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-oauth-config\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.280919 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.280874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k689b\" (UniqueName: \"kubernetes.io/projected/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-kube-api-access-k689b\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.280919 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.280898 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-oauth-serving-cert\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.281788 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.281735 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-oauth-serving-cert\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.281904 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.281839 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-service-ca\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.281904 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.281871 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-config\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.284497 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.284363 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-oauth-config\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.284497 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.284370 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-serving-cert\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.290711 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.290682 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k689b\" (UniqueName: \"kubernetes.io/projected/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-kube-api-access-k689b\") pod \"console-5db665c46d-5k7f4\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.347645 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.347611 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:04.701238 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:04.701150 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5db665c46d-5k7f4"] Jul 13 17:33:04.705404 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:33:04.705380 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92263fb_ad92_4bb7_a93f_e24f7e3ffa9a.slice/crio-9e0a11ec7e393868086df93c56ad8f0cb9b78ed188abfb498a3dfb5a8c6d8bd1 WatchSource:0}: Error finding container 9e0a11ec7e393868086df93c56ad8f0cb9b78ed188abfb498a3dfb5a8c6d8bd1: Status 404 returned error can't find the container with id 9e0a11ec7e393868086df93c56ad8f0cb9b78ed188abfb498a3dfb5a8c6d8bd1 Jul 13 17:33:05.575095 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:05.575024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" event={"ID":"f94cd4fa-f63f-48e8-a04a-77bdbeac19e6","Type":"ContainerStarted","Data":"49698ed8dd934985f4ada1aa8515c5f918fbe41027e454055c86285ac7dda85c"} Jul 13 17:33:05.576758 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:05.576724 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" event={"ID":"e4bc123c-200a-4eda-9788-7b93c48f3b74","Type":"ContainerStarted","Data":"5470a956fe335612538be25ac437c33f776756ff8f2911d0e92459f1f327fa24"} Jul 13 17:33:05.576995 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:05.576974 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:33:05.578391 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:05.578362 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db665c46d-5k7f4" event={"ID":"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a","Type":"ContainerStarted","Data":"9e0a11ec7e393868086df93c56ad8f0cb9b78ed188abfb498a3dfb5a8c6d8bd1"} Jul 13 17:33:05.578850 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:05.578830 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" Jul 13 17:33:05.591905 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:05.591717 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-564859c584-tgmnd" podStartSLOduration=1.7279171899999999 podStartE2EDuration="6.591700878s" totalImagesPullingTime="4.863783688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:05.59144334 +0000 UTC m=+64.734780414" watchObservedRunningTime="2026-07-13 17:33:05.591700878 +0000 UTC m=+64.735037952" Jul 13 17:33:05.609619 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:05.609566 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b6cb56d9-75hjq" podStartSLOduration=1.702930652 podStartE2EDuration="6.609547395s" totalImagesPullingTime="4.906616743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:05.608401293 +0000 UTC m=+64.751738366" watchObservedRunningTime="2026-07-13 17:33:05.609547395 +0000 UTC m=+64.752884470" Jul 13 17:33:06.532621 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:06.532543 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xrnds" Jul 13 17:33:07.108149 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.108113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhqc\" (UniqueName: \"kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc\") pod \"network-check-target-dbxjz\" (UID: \"516b84e6-3a82-4946-ab74-8f1f2190a324\") " pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:33:07.108686 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.108159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:33:07.108686 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.108211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:33:07.110808 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.110734 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 17:33:07.111870 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.111702 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 17:33:07.111870 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.111830 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 17:33:07.120943 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.120918 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 17:33:07.121823 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.121662 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6545be-de38-4af4-bcc5-6495e8280e84-metrics-certs\") pod \"network-metrics-daemon-szztn\" (UID: \"5d6545be-de38-4af4-bcc5-6495e8280e84\") " pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:33:07.122001 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.121984 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1a5f0ed-3a5f-43ac-9443-5e51a5190b41-original-pull-secret\") pod \"global-pull-secret-syncer-5ll5w\" (UID: \"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41\") " pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:33:07.132556 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.132526 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqhqc\" (UniqueName: \"kubernetes.io/projected/516b84e6-3a82-4946-ab74-8f1f2190a324-kube-api-access-gqhqc\") pod \"network-check-target-dbxjz\" (UID: \"516b84e6-3a82-4946-ab74-8f1f2190a324\") " pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:33:07.385041 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.384969 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jvwf\"" Jul 13 17:33:07.390958 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.390926 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vn7td\"" Jul 13 17:33:07.392897 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.392867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szztn" Jul 13 17:33:07.394136 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.394115 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5ll5w" Jul 13 17:33:07.399126 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:07.399107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:33:08.032768 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:08.032553 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5ll5w"] Jul 13 17:33:08.071636 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:08.071607 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-szztn"] Jul 13 17:33:08.074746 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:33:08.074664 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6545be_de38_4af4_bcc5_6495e8280e84.slice/crio-4ca28bc449bc26f7ba1d81859c95460102451596baf7f8e59eabeb798e13dd9b WatchSource:0}: Error finding container 4ca28bc449bc26f7ba1d81859c95460102451596baf7f8e59eabeb798e13dd9b: Status 404 returned error can't find the container with id 4ca28bc449bc26f7ba1d81859c95460102451596baf7f8e59eabeb798e13dd9b Jul 13 17:33:08.089494 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:08.089446 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dbxjz"] Jul 13 17:33:08.093013 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:33:08.092984 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516b84e6_3a82_4946_ab74_8f1f2190a324.slice/crio-299cc7324f80243f06b8a0a234125fed1d441e77e5cb566c5075774a30d16120 WatchSource:0}: Error finding container 299cc7324f80243f06b8a0a234125fed1d441e77e5cb566c5075774a30d16120: Status 404 returned error can't find the container with id 299cc7324f80243f06b8a0a234125fed1d441e77e5cb566c5075774a30d16120 Jul 13 17:33:08.592706 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:08.592659 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db665c46d-5k7f4" event={"ID":"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a","Type":"ContainerStarted","Data":"60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b"} Jul 13 17:33:08.594202 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:08.594170 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dbxjz" event={"ID":"516b84e6-3a82-4946-ab74-8f1f2190a324","Type":"ContainerStarted","Data":"299cc7324f80243f06b8a0a234125fed1d441e77e5cb566c5075774a30d16120"} Jul 13 17:33:08.595729 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:08.595692 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5ll5w" event={"ID":"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41","Type":"ContainerStarted","Data":"cd5992a6d8d2c7529c55cc28f0d5e922795c4b2ad8f3cc7d7d9da6ae99924aac"} Jul 13 17:33:08.597331 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:08.597306 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-szztn" event={"ID":"5d6545be-de38-4af4-bcc5-6495e8280e84","Type":"ContainerStarted","Data":"4ca28bc449bc26f7ba1d81859c95460102451596baf7f8e59eabeb798e13dd9b"} Jul 13 17:33:09.299430 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:09.299385 2581 patch_prober.go:28] interesting pod/image-registry-69fb45f8d5-zf5jw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 13 17:33:09.299639 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:09.299454 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" podUID="7fc843c4-f826-4302-8944-5d7888eb0b72" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 17:33:09.732855 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:09.732811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:33:09.736916 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:09.736886 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34deecc7-c772-4443-acff-dafaa5c2ee14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skflw\" (UID: \"34deecc7-c772-4443-acff-dafaa5c2ee14\") " pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:33:09.928750 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:09.928707 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6jxkx\"" Jul 13 17:33:09.937174 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:09.937135 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-skflw" Jul 13 17:33:10.140574 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:10.139264 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5db665c46d-5k7f4" podStartSLOduration=2.918419661 podStartE2EDuration="6.139242343s" totalImagesPullingTime="3.220822682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:08.608841151 +0000 UTC m=+67.752178258" watchObservedRunningTime="2026-07-13 17:33:10.139242343 +0000 UTC m=+69.282579416" Jul 13 17:33:10.140574 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:10.140338 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-skflw"] Jul 13 17:33:10.144006 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:33:10.143974 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34deecc7_c772_4443_acff_dafaa5c2ee14.slice/crio-a227ba4df2fde06ea4c1bd1add14222b3df782a1700ab9a5093d08704ea2e246 WatchSource:0}: Error finding container a227ba4df2fde06ea4c1bd1add14222b3df782a1700ab9a5093d08704ea2e246: Status 404 returned error can't find the container with id a227ba4df2fde06ea4c1bd1add14222b3df782a1700ab9a5093d08704ea2e246 Jul 13 17:33:10.610380 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:10.610293 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skflw" event={"ID":"34deecc7-c772-4443-acff-dafaa5c2ee14","Type":"ContainerStarted","Data":"a227ba4df2fde06ea4c1bd1add14222b3df782a1700ab9a5093d08704ea2e246"} Jul 13 17:33:10.613232 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:10.613176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-szztn" event={"ID":"5d6545be-de38-4af4-bcc5-6495e8280e84","Type":"ContainerStarted","Data":"c27c0cf0d5136d03c8fb18543b61b6d9f97cc68a5d9c7e772a114a9714735862"} Jul 13 17:33:10.613232 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:10.613232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-szztn" event={"ID":"5d6545be-de38-4af4-bcc5-6495e8280e84","Type":"ContainerStarted","Data":"b2e2f4fb5da770f6bb3358a431d8cc990f9abf9ce0d361c31727ec644118d027"} Jul 13 17:33:10.629183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:10.629131 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-szztn" podStartSLOduration=66.75445887 podStartE2EDuration="1m8.629085988s" totalImagesPullingTime="1.874627118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:10.628450888 +0000 UTC m=+69.771787962" watchObservedRunningTime="2026-07-13 17:33:10.629085988 +0000 UTC m=+69.772423062" Jul 13 17:33:14.348231 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:14.348189 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:14.348733 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:14.348253 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:14.354039 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:14.354011 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:14.632904 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:14.632870 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:19.295387 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:19.295359 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:33:21.562343 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:21.562312 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78fcd886cc-74ncv" Jul 13 17:33:22.659875 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.659842 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z9c5v"] Jul 13 17:33:22.724704 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.724673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.727275 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.727220 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 17:33:22.728166 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.727914 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 17:33:22.728166 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.728002 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 17:33:22.728527 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.728510 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 17:33:22.728820 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.728804 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 17:33:22.729260 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.729113 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 17:33:22.729260 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.729172 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vzcd9\"" Jul 13 17:33:22.737182 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.736820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38087688-f1dc-42fd-a3b0-a704efd46107-root\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.737182 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.736856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtck2\" (UniqueName: \"kubernetes.io/projected/38087688-f1dc-42fd-a3b0-a704efd46107-kube-api-access-vtck2\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.737182 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.736885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-tls\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.737182 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.736913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38087688-f1dc-42fd-a3b0-a704efd46107-sys\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.737182 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.736933 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-wtmp\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.737182 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.736968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.737182 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.736993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-accelerators-collector-config\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.737182 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.737027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-textfile\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.737182 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.737057 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38087688-f1dc-42fd-a3b0-a704efd46107-metrics-client-ca\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.837614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38087688-f1dc-42fd-a3b0-a704efd46107-sys\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.837653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-wtmp\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.837701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.837727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-accelerators-collector-config\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.837768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-textfile\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.837803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38087688-f1dc-42fd-a3b0-a704efd46107-metrics-client-ca\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.837842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38087688-f1dc-42fd-a3b0-a704efd46107-root\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.837863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtck2\" (UniqueName: \"kubernetes.io/projected/38087688-f1dc-42fd-a3b0-a704efd46107-kube-api-access-vtck2\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.837896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-tls\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:33:22.838024 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 17:33:22.838483 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:33:22.838085 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-tls podName:38087688-f1dc-42fd-a3b0-a704efd46107 nodeName:}" failed. No retries permitted until 2026-07-13 17:33:23.338064235 +0000 UTC m=+82.481401300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-tls") pod "node-exporter-z9c5v" (UID: "38087688-f1dc-42fd-a3b0-a704efd46107") : secret "node-exporter-tls" not found Jul 13 17:33:22.839143 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.838569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38087688-f1dc-42fd-a3b0-a704efd46107-sys\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.839143 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.838689 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-wtmp\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.840583 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.839659 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38087688-f1dc-42fd-a3b0-a704efd46107-metrics-client-ca\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.840583 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.840046 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-accelerators-collector-config\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.840583 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.840247 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-textfile\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.840583 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.840534 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38087688-f1dc-42fd-a3b0-a704efd46107-root\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.841315 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.841269 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.852552 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.852512 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtck2\" (UniqueName: \"kubernetes.io/projected/38087688-f1dc-42fd-a3b0-a704efd46107-kube-api-access-vtck2\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:22.977768 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:22.977218 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5db665c46d-5k7f4"] Jul 13 17:33:23.341794 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.341757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-tls\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:23.344541 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.344512 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38087688-f1dc-42fd-a3b0-a704efd46107-node-exporter-tls\") pod \"node-exporter-z9c5v\" (UID: \"38087688-f1dc-42fd-a3b0-a704efd46107\") " pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:23.638355 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.638321 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z9c5v" Jul 13 17:33:23.649581 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:33:23.649551 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38087688_f1dc_42fd_a3b0_a704efd46107.slice/crio-d5fd58a74a207157761433eb66f64f9f787a8f51bbab5add1c9ebab6ef8bc432 WatchSource:0}: Error finding container d5fd58a74a207157761433eb66f64f9f787a8f51bbab5add1c9ebab6ef8bc432: Status 404 returned error can't find the container with id d5fd58a74a207157761433eb66f64f9f787a8f51bbab5add1c9ebab6ef8bc432 Jul 13 17:33:23.683830 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.683794 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-p288b" event={"ID":"71eba6d9-6eb1-4e21-a3a2-cd73a5a5be78","Type":"ContainerStarted","Data":"ec21330237240492f1aaa017baf3aeb16683ce361f11a7adb54cecfa99d48fd8"} Jul 13 17:33:23.684228 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.684085 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-p288b" Jul 13 17:33:23.685515 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.685487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9c5v" event={"ID":"38087688-f1dc-42fd-a3b0-a704efd46107","Type":"ContainerStarted","Data":"d5fd58a74a207157761433eb66f64f9f787a8f51bbab5add1c9ebab6ef8bc432"} Jul 13 17:33:23.685640 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.685598 2581 patch_prober.go:28] interesting pod/downloads-68c9cbb497-p288b container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body= Jul 13 17:33:23.685701 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.685638 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-p288b" podUID="71eba6d9-6eb1-4e21-a3a2-cd73a5a5be78" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" Jul 13 17:33:23.687784 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.687748 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dbxjz" event={"ID":"516b84e6-3a82-4946-ab74-8f1f2190a324","Type":"ContainerStarted","Data":"c4842326034d2cfbf10f99b303fa5498abc1a98088c812c538343513408025d9"} Jul 13 17:33:23.688262 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.688227 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:33:23.689622 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.689561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5ll5w" event={"ID":"d1a5f0ed-3a5f-43ac-9443-5e51a5190b41","Type":"ContainerStarted","Data":"b737f24d97062b586f0f8a9e124299df1a00b22336a474b89d829a3cf4ad91b8"} Jul 13 17:33:23.691592 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.691574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skflw" event={"ID":"34deecc7-c772-4443-acff-dafaa5c2ee14","Type":"ContainerStarted","Data":"9d6533e31a5f5fd4897e3dc9db716e76226acd216a995b655874499fab6c7e73"} Jul 13 17:33:23.703244 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.703193 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-p288b" podStartSLOduration=1.074554177 podStartE2EDuration="24.703177631s" totalImagesPullingTime="23.628623454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:23.702041887 +0000 UTC m=+82.845378956" watchObservedRunningTime="2026-07-13 17:33:23.703177631 +0000 UTC m=+82.846514706" Jul 13 17:33:23.736578 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.736418 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5ll5w" podStartSLOduration=66.301949648 podStartE2EDuration="1m21.736383962s" totalImagesPullingTime="15.434434314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:23.736010045 +0000 UTC m=+82.879347119" watchObservedRunningTime="2026-07-13 17:33:23.736383962 +0000 UTC m=+82.879721035" Jul 13 17:33:23.736578 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:23.736539 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dbxjz" podStartSLOduration=67.359394141 podStartE2EDuration="1m22.736528693s" totalImagesPullingTime="15.377134552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:23.718360323 +0000 UTC m=+82.861697396" watchObservedRunningTime="2026-07-13 17:33:23.736528693 +0000 UTC m=+82.879865767" Jul 13 17:33:24.310444 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.310406 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" podUID="7fc843c4-f826-4302-8944-5d7888eb0b72" containerName="registry" containerID="cri-o://d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462" gracePeriod=30 Jul 13 17:33:24.624840 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.624810 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:33:24.698156 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.698121 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skflw" event={"ID":"34deecc7-c772-4443-acff-dafaa5c2ee14","Type":"ContainerStarted","Data":"6311cff31c9c34042d9a1bfee38d7de798c359b8225703df9cf75f08288e1d8a"} Jul 13 17:33:24.699609 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.699569 2581 generic.go:356] "Generic (PLEG): container finished" podID="7fc843c4-f826-4302-8944-5d7888eb0b72" containerID="d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462" exitCode=0 Jul 13 17:33:24.699738 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.699629 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" Jul 13 17:33:24.699738 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.699668 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" event={"ID":"7fc843c4-f826-4302-8944-5d7888eb0b72","Type":"ContainerDied","Data":"d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462"} Jul 13 17:33:24.699738 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.699707 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69fb45f8d5-zf5jw" event={"ID":"7fc843c4-f826-4302-8944-5d7888eb0b72","Type":"ContainerDied","Data":"819809ca88c9b223054130ad99575334b8d9831870972e5ab87e1bb0225492a2"} Jul 13 17:33:24.699892 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.699751 2581 scope.go:117] "RemoveContainer" containerID="d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462" Jul 13 17:33:24.706568 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.706550 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-p288b" Jul 13 17:33:24.751495 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.751425 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-trusted-ca\") pod \"7fc843c4-f826-4302-8944-5d7888eb0b72\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " Jul 13 17:33:24.751672 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.751508 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qmgh\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-kube-api-access-4qmgh\") pod \"7fc843c4-f826-4302-8944-5d7888eb0b72\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " Jul 13 17:33:24.751844 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.751774 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fc843c4-f826-4302-8944-5d7888eb0b72-ca-trust-extracted\") pod \"7fc843c4-f826-4302-8944-5d7888eb0b72\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " Jul 13 17:33:24.752502 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.752239 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-image-registry-private-configuration\") pod \"7fc843c4-f826-4302-8944-5d7888eb0b72\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " Jul 13 17:33:24.752502 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.752292 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-certificates\") pod \"7fc843c4-f826-4302-8944-5d7888eb0b72\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " Jul 13 17:33:24.752502 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.752321 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-bound-sa-token\") pod \"7fc843c4-f826-4302-8944-5d7888eb0b72\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " Jul 13 17:33:24.752502 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.752348 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls\") pod \"7fc843c4-f826-4302-8944-5d7888eb0b72\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " Jul 13 17:33:24.752502 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.752378 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-installation-pull-secrets\") pod \"7fc843c4-f826-4302-8944-5d7888eb0b72\" (UID: \"7fc843c4-f826-4302-8944-5d7888eb0b72\") " Jul 13 17:33:24.753669 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.753377 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7fc843c4-f826-4302-8944-5d7888eb0b72" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:33:24.754789 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.754754 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7fc843c4-f826-4302-8944-5d7888eb0b72" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:33:24.757585 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.757541 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-kube-api-access-4qmgh" (OuterVolumeSpecName: "kube-api-access-4qmgh") pod "7fc843c4-f826-4302-8944-5d7888eb0b72" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72"). InnerVolumeSpecName "kube-api-access-4qmgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:33:24.757843 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.757817 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7fc843c4-f826-4302-8944-5d7888eb0b72" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:33:24.758289 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.758253 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7fc843c4-f826-4302-8944-5d7888eb0b72" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:33:24.759207 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.759168 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7fc843c4-f826-4302-8944-5d7888eb0b72" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:33:24.759290 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.759205 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7fc843c4-f826-4302-8944-5d7888eb0b72" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:33:24.763699 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.763671 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fc843c4-f826-4302-8944-5d7888eb0b72-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7fc843c4-f826-4302-8944-5d7888eb0b72" (UID: "7fc843c4-f826-4302-8944-5d7888eb0b72"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:33:24.853934 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.853895 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-trusted-ca\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:24.853934 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.853929 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qmgh\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-kube-api-access-4qmgh\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:24.854094 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.853945 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fc843c4-f826-4302-8944-5d7888eb0b72-ca-trust-extracted\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:24.854094 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.853962 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-image-registry-private-configuration\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:24.854094 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.853979 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-certificates\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:24.854094 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.853992 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-bound-sa-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:24.854094 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.854005 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fc843c4-f826-4302-8944-5d7888eb0b72-registry-tls\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:24.854094 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:24.854017 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fc843c4-f826-4302-8944-5d7888eb0b72-installation-pull-secrets\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:25.025163 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:25.025110 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69fb45f8d5-zf5jw"] Jul 13 17:33:25.029488 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:25.029444 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69fb45f8d5-zf5jw"] Jul 13 17:33:25.092102 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:25.091966 2581 scope.go:117] "RemoveContainer" containerID="d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462" Jul 13 17:33:25.092687 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:33:25.092580 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462\": container with ID starting with d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462 not found: ID does not exist" containerID="d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462" Jul 13 17:33:25.092687 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:25.092626 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462"} err="failed to get container status \"d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462\": rpc error: code = NotFound desc = could not find container \"d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462\": container with ID starting with d5841902844d03f935851f99e07cf36e1162253781c13e9ac54ae9874a4a8462 not found: ID does not exist" Jul 13 17:33:25.278878 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:25.278566 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fc843c4-f826-4302-8944-5d7888eb0b72" path="/var/lib/kubelet/pods/7fc843c4-f826-4302-8944-5d7888eb0b72/volumes" Jul 13 17:33:25.707137 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:25.706327 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9c5v" event={"ID":"38087688-f1dc-42fd-a3b0-a704efd46107","Type":"ContainerStarted","Data":"d538ff261b39d51f41bd90af88a2427d0c1be62e48c8c72b7ba1d2c3d1459a22"} Jul 13 17:33:26.715703 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:26.715673 2581 generic.go:356] "Generic (PLEG): container finished" podID="38087688-f1dc-42fd-a3b0-a704efd46107" containerID="d538ff261b39d51f41bd90af88a2427d0c1be62e48c8c72b7ba1d2c3d1459a22" exitCode=0 Jul 13 17:33:26.716169 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:26.715753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9c5v" event={"ID":"38087688-f1dc-42fd-a3b0-a704efd46107","Type":"ContainerDied","Data":"d538ff261b39d51f41bd90af88a2427d0c1be62e48c8c72b7ba1d2c3d1459a22"} Jul 13 17:33:27.723147 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:27.723069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9c5v" event={"ID":"38087688-f1dc-42fd-a3b0-a704efd46107","Type":"ContainerStarted","Data":"9c6bccead98b32cfc8cb83067c725f1e13e6f495a8bee3607618d55db9a5db51"} Jul 13 17:33:27.723587 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:27.723170 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9c5v" event={"ID":"38087688-f1dc-42fd-a3b0-a704efd46107","Type":"ContainerStarted","Data":"ce44ef2599aa12f1bb958422d8cdb643040d35d953dc201d6590210b17ba7b9e"} Jul 13 17:33:27.746443 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:27.746392 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z9c5v" podStartSLOduration=3.778857065 podStartE2EDuration="5.746374265s" totalImagesPullingTime="1.830823004s" totalInitContainerRuntime="136.694196ms" isStatefulPod=true podCreationTimestamp="2026-07-13 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:27.744360545 +0000 UTC m=+86.887697621" watchObservedRunningTime="2026-07-13 17:33:27.746374265 +0000 UTC m=+86.889711336" Jul 13 17:33:28.729226 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:28.729186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skflw" event={"ID":"34deecc7-c772-4443-acff-dafaa5c2ee14","Type":"ContainerStarted","Data":"0b2ae4dd0293dfb2792bfde4b0b2107d5c9b10cc5df6846e5eab7adbe0e8e84f"} Jul 13 17:33:28.749576 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:28.749520 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-skflw" podStartSLOduration=34.229405443 podStartE2EDuration="51.749501663s" totalImagesPullingTime="17.52009622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:28.748918398 +0000 UTC m=+87.892255481" watchObservedRunningTime="2026-07-13 17:33:28.749501663 +0000 UTC m=+87.892838737" Jul 13 17:33:48.001488 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.001429 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5db665c46d-5k7f4" podUID="e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" containerName="console" containerID="cri-o://60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b" gracePeriod=15 Jul 13 17:33:48.262292 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.262231 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:48.329319 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.329287 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-oauth-serving-cert\") pod \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " Jul 13 17:33:48.329319 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.329322 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-service-ca\") pod \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " Jul 13 17:33:48.329537 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.329346 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-oauth-config\") pod \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " Jul 13 17:33:48.329537 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.329378 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-serving-cert\") pod \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " Jul 13 17:33:48.329537 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.329418 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-config\") pod \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " Jul 13 17:33:48.329537 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.329440 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k689b\" (UniqueName: \"kubernetes.io/projected/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-kube-api-access-k689b\") pod \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\" (UID: \"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a\") " Jul 13 17:33:48.329785 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.329750 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" (UID: "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:33:48.329898 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.329871 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-config" (OuterVolumeSpecName: "console-config") pod "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" (UID: "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:33:48.329950 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.329868 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" (UID: "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:33:48.331734 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.331707 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" (UID: "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:33:48.331831 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.331741 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-kube-api-access-k689b" (OuterVolumeSpecName: "kube-api-access-k689b") pod "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" (UID: "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a"). InnerVolumeSpecName "kube-api-access-k689b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:33:48.331831 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.331764 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" (UID: "e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:33:48.430132 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.430098 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-config\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:48.430132 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.430127 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k689b\" (UniqueName: \"kubernetes.io/projected/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-kube-api-access-k689b\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:48.430132 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.430137 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-oauth-serving-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:48.430329 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.430145 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-service-ca\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:48.430329 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.430153 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-oauth-config\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:48.430329 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.430161 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a-console-serving-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:33:48.797050 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.797014 2581 generic.go:356] "Generic (PLEG): container finished" podID="e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" containerID="60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b" exitCode=0 Jul 13 17:33:48.797224 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.797061 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db665c46d-5k7f4" Jul 13 17:33:48.797224 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.797097 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db665c46d-5k7f4" event={"ID":"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a","Type":"ContainerDied","Data":"60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b"} Jul 13 17:33:48.797224 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.797152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db665c46d-5k7f4" event={"ID":"e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a","Type":"ContainerDied","Data":"9e0a11ec7e393868086df93c56ad8f0cb9b78ed188abfb498a3dfb5a8c6d8bd1"} Jul 13 17:33:48.797224 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.797177 2581 scope.go:117] "RemoveContainer" containerID="60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b" Jul 13 17:33:48.805429 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.805413 2581 scope.go:117] "RemoveContainer" containerID="60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b" Jul 13 17:33:48.805686 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:33:48.805668 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b\": container with ID starting with 60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b not found: ID does not exist" containerID="60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b" Jul 13 17:33:48.805751 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.805693 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b"} err="failed to get container status \"60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b\": rpc error: code = NotFound desc = could not find container \"60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b\": container with ID starting with 60a736b7ed721305a83cf8e980aaf8a756927931dbe34771ac1d54fd1006428b not found: ID does not exist" Jul 13 17:33:48.824356 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.824332 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5db665c46d-5k7f4"] Jul 13 17:33:48.826655 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:48.826635 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5db665c46d-5k7f4"] Jul 13 17:33:49.276338 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:49.276308 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" path="/var/lib/kubelet/pods/e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a/volumes" Jul 13 17:33:55.711821 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:33:55.711792 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dbxjz" Jul 13 17:34:45.638613 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.638572 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7478b88b47-5p728"] Jul 13 17:34:45.639131 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.638912 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" containerName="console" Jul 13 17:34:45.639131 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.638929 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" containerName="console" Jul 13 17:34:45.639131 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.638945 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc843c4-f826-4302-8944-5d7888eb0b72" containerName="registry" Jul 13 17:34:45.639131 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.638952 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc843c4-f826-4302-8944-5d7888eb0b72" containerName="registry" Jul 13 17:34:45.639131 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.639020 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fc843c4-f826-4302-8944-5d7888eb0b72" containerName="registry" Jul 13 17:34:45.639131 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.639032 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92263fb-ad92-4bb7-a93f-e24f7e3ffa9a" containerName="console" Jul 13 17:34:45.641028 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.641006 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.643560 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.643504 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-trusted-ca-bundle\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.643685 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.643572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-config\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.643685 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.643646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-oauth-serving-cert\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.643798 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.643693 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-serving-cert\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.643798 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.643698 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 17:34:45.643798 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.643716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-oauth-config\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.643798 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.643722 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 17:34:45.643798 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.643744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldtrd\" (UniqueName: \"kubernetes.io/projected/15417e8a-ff02-4439-bc1d-fd2bc32f339b-kube-api-access-ldtrd\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.643798 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.643781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-service-ca\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.644060 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.644015 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 17:34:45.644097 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.644061 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cjph7\"" Jul 13 17:34:45.644097 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.644086 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 17:34:45.644255 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.644235 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 17:34:45.648859 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.648838 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 17:34:45.653095 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.653075 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7478b88b47-5p728"] Jul 13 17:34:45.744070 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.744039 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-config\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.744070 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.744072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-oauth-serving-cert\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.744392 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.744096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-serving-cert\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.744392 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.744218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-oauth-config\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.744392 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.744254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldtrd\" (UniqueName: \"kubernetes.io/projected/15417e8a-ff02-4439-bc1d-fd2bc32f339b-kube-api-access-ldtrd\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.744392 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.744377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-service-ca\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.744640 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.744429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-trusted-ca-bundle\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.744931 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.744910 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-oauth-serving-cert\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.745026 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.744930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-config\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.745155 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.745135 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-service-ca\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.745617 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.745598 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-trusted-ca-bundle\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.746564 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.746544 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-serving-cert\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.746659 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.746644 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-oauth-config\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.752280 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.752258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldtrd\" (UniqueName: \"kubernetes.io/projected/15417e8a-ff02-4439-bc1d-fd2bc32f339b-kube-api-access-ldtrd\") pod \"console-7478b88b47-5p728\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:45.950908 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:45.950816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:46.073472 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:46.073332 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7478b88b47-5p728"] Jul 13 17:34:46.075886 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:34:46.075851 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15417e8a_ff02_4439_bc1d_fd2bc32f339b.slice/crio-21799aeb94279bb0fa714c1334dcff2f74cd426c280869ef03c9f401170875f6 WatchSource:0}: Error finding container 21799aeb94279bb0fa714c1334dcff2f74cd426c280869ef03c9f401170875f6: Status 404 returned error can't find the container with id 21799aeb94279bb0fa714c1334dcff2f74cd426c280869ef03c9f401170875f6 Jul 13 17:34:46.986801 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:46.986766 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7478b88b47-5p728" event={"ID":"15417e8a-ff02-4439-bc1d-fd2bc32f339b","Type":"ContainerStarted","Data":"e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5"} Jul 13 17:34:46.987185 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:46.986839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7478b88b47-5p728" event={"ID":"15417e8a-ff02-4439-bc1d-fd2bc32f339b","Type":"ContainerStarted","Data":"21799aeb94279bb0fa714c1334dcff2f74cd426c280869ef03c9f401170875f6"} Jul 13 17:34:47.003416 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:47.003360 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7478b88b47-5p728" podStartSLOduration=2.003346373 podStartE2EDuration="2.003346373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:34:47.003187569 +0000 UTC m=+166.146524654" watchObservedRunningTime="2026-07-13 17:34:47.003346373 +0000 UTC m=+166.146683446" Jul 13 17:34:55.951879 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:55.951835 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:55.952351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:55.951903 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:55.956565 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:55.956542 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:34:56.018811 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:34:56.018787 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:35:26.505760 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.505724 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5"] Jul 13 17:35:26.507715 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.507698 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.510288 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.510264 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 17:35:26.510414 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.510264 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 17:35:26.510604 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.510588 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sqxvp\"" Jul 13 17:35:26.517305 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.517276 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5"] Jul 13 17:35:26.627166 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.627134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.627355 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.627193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.627355 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.627265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvqpm\" (UniqueName: \"kubernetes.io/projected/5ee09d92-1845-49fb-9eef-d64cadadb9c1-kube-api-access-dvqpm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.728703 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.728665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.728829 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.728715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvqpm\" (UniqueName: \"kubernetes.io/projected/5ee09d92-1845-49fb-9eef-d64cadadb9c1-kube-api-access-dvqpm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.728829 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.728736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.729052 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.729036 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.729122 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.729090 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.737733 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.737705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvqpm\" (UniqueName: \"kubernetes.io/projected/5ee09d92-1845-49fb-9eef-d64cadadb9c1-kube-api-access-dvqpm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.816960 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.816880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:26.940729 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:26.940574 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5"] Jul 13 17:35:26.943348 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:35:26.943323 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee09d92_1845_49fb_9eef_d64cadadb9c1.slice/crio-8b1d542cfa57b69dae5ca297f8a405e10dd55ec7b9fd3189bd23456e40d33e31 WatchSource:0}: Error finding container 8b1d542cfa57b69dae5ca297f8a405e10dd55ec7b9fd3189bd23456e40d33e31: Status 404 returned error can't find the container with id 8b1d542cfa57b69dae5ca297f8a405e10dd55ec7b9fd3189bd23456e40d33e31 Jul 13 17:35:27.128524 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:27.128491 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" event={"ID":"5ee09d92-1845-49fb-9eef-d64cadadb9c1","Type":"ContainerStarted","Data":"8b1d542cfa57b69dae5ca297f8a405e10dd55ec7b9fd3189bd23456e40d33e31"} Jul 13 17:35:34.154196 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:34.154164 2581 generic.go:356] "Generic (PLEG): container finished" podID="5ee09d92-1845-49fb-9eef-d64cadadb9c1" containerID="55d9c7120df28565a9b6ea93e66b47cbcc72d7a3239c6609a4ae61e8e9141652" exitCode=0 Jul 13 17:35:34.154627 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:34.154252 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" event={"ID":"5ee09d92-1845-49fb-9eef-d64cadadb9c1","Type":"ContainerDied","Data":"55d9c7120df28565a9b6ea93e66b47cbcc72d7a3239c6609a4ae61e8e9141652"} Jul 13 17:35:39.174307 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:39.174271 2581 generic.go:356] "Generic (PLEG): container finished" podID="5ee09d92-1845-49fb-9eef-d64cadadb9c1" containerID="10a1d136c546a824303a7bd7de7710b6d4abaa5e3d54eacda009f56e723f70d1" exitCode=0 Jul 13 17:35:39.174307 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:39.174308 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" event={"ID":"5ee09d92-1845-49fb-9eef-d64cadadb9c1","Type":"ContainerDied","Data":"10a1d136c546a824303a7bd7de7710b6d4abaa5e3d54eacda009f56e723f70d1"} Jul 13 17:35:48.210447 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:48.210412 2581 generic.go:356] "Generic (PLEG): container finished" podID="5ee09d92-1845-49fb-9eef-d64cadadb9c1" containerID="4a1578f9c8dcd15bc1ecb13ff757b48f34f97df3e951a96a11cecf22fd0d2c79" exitCode=0 Jul 13 17:35:48.210865 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:48.210479 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" event={"ID":"5ee09d92-1845-49fb-9eef-d64cadadb9c1","Type":"ContainerDied","Data":"4a1578f9c8dcd15bc1ecb13ff757b48f34f97df3e951a96a11cecf22fd0d2c79"} Jul 13 17:35:49.336220 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:49.336198 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:49.418007 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:49.417966 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-bundle\") pod \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " Jul 13 17:35:49.418173 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:49.418023 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvqpm\" (UniqueName: \"kubernetes.io/projected/5ee09d92-1845-49fb-9eef-d64cadadb9c1-kube-api-access-dvqpm\") pod \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " Jul 13 17:35:49.418173 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:49.418084 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-util\") pod \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\" (UID: \"5ee09d92-1845-49fb-9eef-d64cadadb9c1\") " Jul 13 17:35:49.418855 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:49.418817 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-bundle" (OuterVolumeSpecName: "bundle") pod "5ee09d92-1845-49fb-9eef-d64cadadb9c1" (UID: "5ee09d92-1845-49fb-9eef-d64cadadb9c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:35:49.420205 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:49.420172 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee09d92-1845-49fb-9eef-d64cadadb9c1-kube-api-access-dvqpm" (OuterVolumeSpecName: "kube-api-access-dvqpm") pod "5ee09d92-1845-49fb-9eef-d64cadadb9c1" (UID: "5ee09d92-1845-49fb-9eef-d64cadadb9c1"). InnerVolumeSpecName "kube-api-access-dvqpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:35:49.422800 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:49.422780 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-util" (OuterVolumeSpecName: "util") pod "5ee09d92-1845-49fb-9eef-d64cadadb9c1" (UID: "5ee09d92-1845-49fb-9eef-d64cadadb9c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:35:49.519349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:49.519255 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-util\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:35:49.519349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:49.519289 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ee09d92-1845-49fb-9eef-d64cadadb9c1-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:35:49.519349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:49.519302 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvqpm\" (UniqueName: \"kubernetes.io/projected/5ee09d92-1845-49fb-9eef-d64cadadb9c1-kube-api-access-dvqpm\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:35:50.219171 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:50.219139 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" event={"ID":"5ee09d92-1845-49fb-9eef-d64cadadb9c1","Type":"ContainerDied","Data":"8b1d542cfa57b69dae5ca297f8a405e10dd55ec7b9fd3189bd23456e40d33e31"} Jul 13 17:35:50.219329 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:50.219184 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9tz5" Jul 13 17:35:50.219329 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:50.219186 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b1d542cfa57b69dae5ca297f8a405e10dd55ec7b9fd3189bd23456e40d33e31" Jul 13 17:35:54.254326 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.254291 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6"] Jul 13 17:35:54.254812 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.254667 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee09d92-1845-49fb-9eef-d64cadadb9c1" containerName="util" Jul 13 17:35:54.254812 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.254686 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee09d92-1845-49fb-9eef-d64cadadb9c1" containerName="util" Jul 13 17:35:54.254812 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.254708 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee09d92-1845-49fb-9eef-d64cadadb9c1" containerName="extract" Jul 13 17:35:54.254812 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.254716 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee09d92-1845-49fb-9eef-d64cadadb9c1" containerName="extract" Jul 13 17:35:54.254812 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.254736 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee09d92-1845-49fb-9eef-d64cadadb9c1" containerName="pull" Jul 13 17:35:54.254812 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.254744 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee09d92-1845-49fb-9eef-d64cadadb9c1" containerName="pull" Jul 13 17:35:54.254812 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.254804 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee09d92-1845-49fb-9eef-d64cadadb9c1" containerName="extract" Jul 13 17:35:54.257676 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.257655 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" Jul 13 17:35:54.260052 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.260033 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-h82gb\"" Jul 13 17:35:54.260171 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.260091 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 13 17:35:54.260171 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.260129 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 13 17:35:54.271019 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.270995 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6"] Jul 13 17:35:54.355765 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.355728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/851cb3d9-69c7-4c0c-8559-02098ab1e70c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvcv6\" (UID: \"851cb3d9-69c7-4c0c-8559-02098ab1e70c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" Jul 13 17:35:54.355909 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.355776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dwsb\" (UniqueName: \"kubernetes.io/projected/851cb3d9-69c7-4c0c-8559-02098ab1e70c-kube-api-access-2dwsb\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvcv6\" (UID: \"851cb3d9-69c7-4c0c-8559-02098ab1e70c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" Jul 13 17:35:54.456601 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.456565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dwsb\" (UniqueName: \"kubernetes.io/projected/851cb3d9-69c7-4c0c-8559-02098ab1e70c-kube-api-access-2dwsb\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvcv6\" (UID: \"851cb3d9-69c7-4c0c-8559-02098ab1e70c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" Jul 13 17:35:54.456734 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.456662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/851cb3d9-69c7-4c0c-8559-02098ab1e70c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvcv6\" (UID: \"851cb3d9-69c7-4c0c-8559-02098ab1e70c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" Jul 13 17:35:54.457051 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.457033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/851cb3d9-69c7-4c0c-8559-02098ab1e70c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvcv6\" (UID: \"851cb3d9-69c7-4c0c-8559-02098ab1e70c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" Jul 13 17:35:54.465056 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.465038 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dwsb\" (UniqueName: \"kubernetes.io/projected/851cb3d9-69c7-4c0c-8559-02098ab1e70c-kube-api-access-2dwsb\") pod \"cert-manager-operator-controller-manager-55c444bf86-xvcv6\" (UID: \"851cb3d9-69c7-4c0c-8559-02098ab1e70c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" Jul 13 17:35:54.566976 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.566888 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" Jul 13 17:35:54.693740 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:54.693633 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6"] Jul 13 17:35:54.695978 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:35:54.695947 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851cb3d9_69c7_4c0c_8559_02098ab1e70c.slice/crio-3dcb4e995c7d4b40d916ef5bca825c4139cdae59a040a46130df89f15a514212 WatchSource:0}: Error finding container 3dcb4e995c7d4b40d916ef5bca825c4139cdae59a040a46130df89f15a514212: Status 404 returned error can't find the container with id 3dcb4e995c7d4b40d916ef5bca825c4139cdae59a040a46130df89f15a514212 Jul 13 17:35:55.242368 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:55.242333 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" event={"ID":"851cb3d9-69c7-4c0c-8559-02098ab1e70c","Type":"ContainerStarted","Data":"3dcb4e995c7d4b40d916ef5bca825c4139cdae59a040a46130df89f15a514212"} Jul 13 17:35:56.248438 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:56.248405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" event={"ID":"851cb3d9-69c7-4c0c-8559-02098ab1e70c","Type":"ContainerStarted","Data":"b6f7ab0126aaa59ccc198c9ba77d7e1d342ea8654b2d28dfa46929cab1c7c10a"} Jul 13 17:35:56.267387 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:56.267305 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xvcv6" podStartSLOduration=0.96276389 podStartE2EDuration="2.267290546s" totalImagesPullingTime="1.304526656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:35:56.26614674 +0000 UTC m=+235.409483812" watchObservedRunningTime="2026-07-13 17:35:56.267290546 +0000 UTC m=+235.410627619" Jul 13 17:35:57.562730 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.562682 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55"] Jul 13 17:35:57.567039 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.567015 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:57.569363 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.569343 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sqxvp\"" Jul 13 17:35:57.569363 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.569359 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 17:35:57.570225 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.570207 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 17:35:57.571970 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.571948 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55"] Jul 13 17:35:57.684348 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.684316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:57.684532 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.684360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4r24\" (UniqueName: \"kubernetes.io/projected/9540b9f9-acdf-4481-889c-13689bad2e8a-kube-api-access-k4r24\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:57.684532 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.684381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:57.785676 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.785640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:57.785676 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.785684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4r24\" (UniqueName: \"kubernetes.io/projected/9540b9f9-acdf-4481-889c-13689bad2e8a-kube-api-access-k4r24\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:57.785882 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.785702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:57.786052 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.786034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:57.786109 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.786091 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:57.795022 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.794994 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4r24\" (UniqueName: \"kubernetes.io/projected/9540b9f9-acdf-4481-889c-13689bad2e8a-kube-api-access-k4r24\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:57.876392 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:57.876365 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:35:58.003772 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:58.003739 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55"] Jul 13 17:35:58.006254 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:35:58.006227 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9540b9f9_acdf_4481_889c_13689bad2e8a.slice/crio-30a247102dced415c92c3f32d1e7206c814dda89308bce94752a9701fad4d71e WatchSource:0}: Error finding container 30a247102dced415c92c3f32d1e7206c814dda89308bce94752a9701fad4d71e: Status 404 returned error can't find the container with id 30a247102dced415c92c3f32d1e7206c814dda89308bce94752a9701fad4d71e Jul 13 17:35:58.256687 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:58.256593 2581 generic.go:356] "Generic (PLEG): container finished" podID="9540b9f9-acdf-4481-889c-13689bad2e8a" containerID="de61f92838cbad26334f13122eaf6a34ac9ac2b809a1f4500bb9f49b85749787" exitCode=0 Jul 13 17:35:58.256687 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:58.256665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" event={"ID":"9540b9f9-acdf-4481-889c-13689bad2e8a","Type":"ContainerDied","Data":"de61f92838cbad26334f13122eaf6a34ac9ac2b809a1f4500bb9f49b85749787"} Jul 13 17:35:58.256867 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:35:58.256702 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" event={"ID":"9540b9f9-acdf-4481-889c-13689bad2e8a","Type":"ContainerStarted","Data":"30a247102dced415c92c3f32d1e7206c814dda89308bce94752a9701fad4d71e"} Jul 13 17:36:00.267438 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:00.267410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" event={"ID":"9540b9f9-acdf-4481-889c-13689bad2e8a","Type":"ContainerStarted","Data":"34b596244e9e79c81e91427fd8609adf88c995398aade6d568aed52794824161"} Jul 13 17:36:01.272731 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:01.272693 2581 generic.go:356] "Generic (PLEG): container finished" podID="9540b9f9-acdf-4481-889c-13689bad2e8a" containerID="34b596244e9e79c81e91427fd8609adf88c995398aade6d568aed52794824161" exitCode=0 Jul 13 17:36:01.279108 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:01.279074 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" event={"ID":"9540b9f9-acdf-4481-889c-13689bad2e8a","Type":"ContainerDied","Data":"34b596244e9e79c81e91427fd8609adf88c995398aade6d568aed52794824161"} Jul 13 17:36:02.278924 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:02.278889 2581 generic.go:356] "Generic (PLEG): container finished" podID="9540b9f9-acdf-4481-889c-13689bad2e8a" containerID="4363dade93b3ece80fa8791106766fcc5d18a2d9f01c01f018ff983affc5282d" exitCode=0 Jul 13 17:36:02.279379 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:02.278961 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" event={"ID":"9540b9f9-acdf-4481-889c-13689bad2e8a","Type":"ContainerDied","Data":"4363dade93b3ece80fa8791106766fcc5d18a2d9f01c01f018ff983affc5282d"} Jul 13 17:36:03.400370 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:03.400345 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:36:03.430610 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:03.430573 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-util\") pod \"9540b9f9-acdf-4481-889c-13689bad2e8a\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " Jul 13 17:36:03.430778 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:03.430626 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-bundle\") pod \"9540b9f9-acdf-4481-889c-13689bad2e8a\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " Jul 13 17:36:03.430778 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:03.430728 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4r24\" (UniqueName: \"kubernetes.io/projected/9540b9f9-acdf-4481-889c-13689bad2e8a-kube-api-access-k4r24\") pod \"9540b9f9-acdf-4481-889c-13689bad2e8a\" (UID: \"9540b9f9-acdf-4481-889c-13689bad2e8a\") " Jul 13 17:36:03.431103 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:03.431065 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-bundle" (OuterVolumeSpecName: "bundle") pod "9540b9f9-acdf-4481-889c-13689bad2e8a" (UID: "9540b9f9-acdf-4481-889c-13689bad2e8a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:36:03.432926 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:03.432896 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9540b9f9-acdf-4481-889c-13689bad2e8a-kube-api-access-k4r24" (OuterVolumeSpecName: "kube-api-access-k4r24") pod "9540b9f9-acdf-4481-889c-13689bad2e8a" (UID: "9540b9f9-acdf-4481-889c-13689bad2e8a"). InnerVolumeSpecName "kube-api-access-k4r24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:36:03.436039 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:03.436019 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-util" (OuterVolumeSpecName: "util") pod "9540b9f9-acdf-4481-889c-13689bad2e8a" (UID: "9540b9f9-acdf-4481-889c-13689bad2e8a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:36:03.531205 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:03.531169 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4r24\" (UniqueName: \"kubernetes.io/projected/9540b9f9-acdf-4481-889c-13689bad2e8a-kube-api-access-k4r24\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:36:03.531205 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:03.531199 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-util\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:36:03.531205 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:03.531208 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9540b9f9-acdf-4481-889c-13689bad2e8a-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:36:04.288495 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:04.288435 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" event={"ID":"9540b9f9-acdf-4481-889c-13689bad2e8a","Type":"ContainerDied","Data":"30a247102dced415c92c3f32d1e7206c814dda89308bce94752a9701fad4d71e"} Jul 13 17:36:04.288495 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:04.288482 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7wc55" Jul 13 17:36:04.288689 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:04.288514 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30a247102dced415c92c3f32d1e7206c814dda89308bce94752a9701fad4d71e" Jul 13 17:36:06.331439 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.331401 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2j4h5"] Jul 13 17:36:06.331897 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.331675 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9540b9f9-acdf-4481-889c-13689bad2e8a" containerName="pull" Jul 13 17:36:06.331897 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.331686 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9540b9f9-acdf-4481-889c-13689bad2e8a" containerName="pull" Jul 13 17:36:06.331897 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.331693 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9540b9f9-acdf-4481-889c-13689bad2e8a" containerName="extract" Jul 13 17:36:06.331897 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.331700 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9540b9f9-acdf-4481-889c-13689bad2e8a" containerName="extract" Jul 13 17:36:06.331897 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.331711 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9540b9f9-acdf-4481-889c-13689bad2e8a" containerName="util" Jul 13 17:36:06.331897 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.331716 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9540b9f9-acdf-4481-889c-13689bad2e8a" containerName="util" Jul 13 17:36:06.331897 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.331767 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9540b9f9-acdf-4481-889c-13689bad2e8a" containerName="extract" Jul 13 17:36:06.333361 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.333346 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" Jul 13 17:36:06.335933 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.335909 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 17:36:06.336871 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.336858 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 17:36:06.336953 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.336893 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bg2bb\"" Jul 13 17:36:06.343566 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.343544 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2j4h5"] Jul 13 17:36:06.346546 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.346526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/083123ef-7475-481d-bff2-99e290658095-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2j4h5\" (UID: \"083123ef-7475-481d-bff2-99e290658095\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" Jul 13 17:36:06.346635 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.346561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85792\" (UniqueName: \"kubernetes.io/projected/083123ef-7475-481d-bff2-99e290658095-kube-api-access-85792\") pod \"cert-manager-webhook-6486ffd997-2j4h5\" (UID: \"083123ef-7475-481d-bff2-99e290658095\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" Jul 13 17:36:06.447424 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.447374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/083123ef-7475-481d-bff2-99e290658095-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2j4h5\" (UID: \"083123ef-7475-481d-bff2-99e290658095\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" Jul 13 17:36:06.447624 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.447448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85792\" (UniqueName: \"kubernetes.io/projected/083123ef-7475-481d-bff2-99e290658095-kube-api-access-85792\") pod \"cert-manager-webhook-6486ffd997-2j4h5\" (UID: \"083123ef-7475-481d-bff2-99e290658095\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" Jul 13 17:36:06.458390 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.458356 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/083123ef-7475-481d-bff2-99e290658095-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2j4h5\" (UID: \"083123ef-7475-481d-bff2-99e290658095\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" Jul 13 17:36:06.458390 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.458378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85792\" (UniqueName: \"kubernetes.io/projected/083123ef-7475-481d-bff2-99e290658095-kube-api-access-85792\") pod \"cert-manager-webhook-6486ffd997-2j4h5\" (UID: \"083123ef-7475-481d-bff2-99e290658095\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" Jul 13 17:36:06.641741 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.641707 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" Jul 13 17:36:06.764943 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:06.764907 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2j4h5"] Jul 13 17:36:06.767688 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:36:06.767654 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod083123ef_7475_481d_bff2_99e290658095.slice/crio-50d8e064a4003d7b5f4c5af09d8066857363a7b3e0de7a944b402cb231d22768 WatchSource:0}: Error finding container 50d8e064a4003d7b5f4c5af09d8066857363a7b3e0de7a944b402cb231d22768: Status 404 returned error can't find the container with id 50d8e064a4003d7b5f4c5af09d8066857363a7b3e0de7a944b402cb231d22768 Jul 13 17:36:07.300765 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:07.300728 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" event={"ID":"083123ef-7475-481d-bff2-99e290658095","Type":"ContainerStarted","Data":"50d8e064a4003d7b5f4c5af09d8066857363a7b3e0de7a944b402cb231d22768"} Jul 13 17:36:09.311053 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:09.311020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" event={"ID":"083123ef-7475-481d-bff2-99e290658095","Type":"ContainerStarted","Data":"27f31b1d4ba0e450402353398bd0d908a06a1f07804e6b4211dccf7782bc9fc3"} Jul 13 17:36:09.311396 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:09.311143 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" Jul 13 17:36:09.326725 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:09.326680 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" podStartSLOduration=0.851496852 podStartE2EDuration="3.326665522s" totalImagesPullingTime="2.47516867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:36:09.325436015 +0000 UTC m=+248.468773090" watchObservedRunningTime="2026-07-13 17:36:09.326665522 +0000 UTC m=+248.470002594" Jul 13 17:36:10.811032 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.810996 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv"] Jul 13 17:36:10.813160 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.813143 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" Jul 13 17:36:10.815389 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.815366 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-sn594\"" Jul 13 17:36:10.815389 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.815366 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 17:36:10.816470 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.816437 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 17:36:10.822243 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.822216 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv"] Jul 13 17:36:10.875288 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.875256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b83f94-d1f9-41d4-ae86-37b41aeadcbc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kzrhv\" (UID: \"b7b83f94-d1f9-41d4-ae86-37b41aeadcbc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" Jul 13 17:36:10.875499 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.875307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv4ng\" (UniqueName: \"kubernetes.io/projected/b7b83f94-d1f9-41d4-ae86-37b41aeadcbc-kube-api-access-jv4ng\") pod \"openshift-lws-operator-fd8ccff4c-kzrhv\" (UID: \"b7b83f94-d1f9-41d4-ae86-37b41aeadcbc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" Jul 13 17:36:10.976082 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.976044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b83f94-d1f9-41d4-ae86-37b41aeadcbc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kzrhv\" (UID: \"b7b83f94-d1f9-41d4-ae86-37b41aeadcbc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" Jul 13 17:36:10.976262 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.976093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv4ng\" (UniqueName: \"kubernetes.io/projected/b7b83f94-d1f9-41d4-ae86-37b41aeadcbc-kube-api-access-jv4ng\") pod \"openshift-lws-operator-fd8ccff4c-kzrhv\" (UID: \"b7b83f94-d1f9-41d4-ae86-37b41aeadcbc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" Jul 13 17:36:10.976443 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.976425 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7b83f94-d1f9-41d4-ae86-37b41aeadcbc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kzrhv\" (UID: \"b7b83f94-d1f9-41d4-ae86-37b41aeadcbc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" Jul 13 17:36:10.985349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:10.985315 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv4ng\" (UniqueName: \"kubernetes.io/projected/b7b83f94-d1f9-41d4-ae86-37b41aeadcbc-kube-api-access-jv4ng\") pod \"openshift-lws-operator-fd8ccff4c-kzrhv\" (UID: \"b7b83f94-d1f9-41d4-ae86-37b41aeadcbc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" Jul 13 17:36:11.122328 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:11.122300 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" Jul 13 17:36:11.247476 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:11.247297 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv"] Jul 13 17:36:11.250011 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:36:11.249978 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7b83f94_d1f9_41d4_ae86_37b41aeadcbc.slice/crio-a197793dc498b56857db161589a525c83f0aa81fdb99031d99020a257953ef6f WatchSource:0}: Error finding container a197793dc498b56857db161589a525c83f0aa81fdb99031d99020a257953ef6f: Status 404 returned error can't find the container with id a197793dc498b56857db161589a525c83f0aa81fdb99031d99020a257953ef6f Jul 13 17:36:11.320214 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:11.320174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" event={"ID":"b7b83f94-d1f9-41d4-ae86-37b41aeadcbc","Type":"ContainerStarted","Data":"a197793dc498b56857db161589a525c83f0aa81fdb99031d99020a257953ef6f"} Jul 13 17:36:14.333039 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:14.333003 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" event={"ID":"b7b83f94-d1f9-41d4-ae86-37b41aeadcbc","Type":"ContainerStarted","Data":"fe76f7d4f7df5e24c5212668d576c980c0ea158994b0d61c29d0626fa061cc93"} Jul 13 17:36:14.349016 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:14.348957 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kzrhv" podStartSLOduration=2.052756754 podStartE2EDuration="4.34894202s" totalImagesPullingTime="2.296185266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:36:14.348141725 +0000 UTC m=+253.491478797" watchObservedRunningTime="2026-07-13 17:36:14.34894202 +0000 UTC m=+253.492279097" Jul 13 17:36:15.317572 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:15.317544 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2j4h5" Jul 13 17:36:17.789793 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.789760 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp"] Jul 13 17:36:17.811080 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.811056 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp"] Jul 13 17:36:17.811217 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.811149 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:17.814066 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.814046 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 17:36:17.814184 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.814081 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 17:36:17.814184 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.814082 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sqxvp\"" Jul 13 17:36:17.821713 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.821693 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:17.821795 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.821726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:17.821795 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.821752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cnff\" (UniqueName: \"kubernetes.io/projected/fe9fb41c-7add-473d-a1bf-14efb5919950-kube-api-access-8cnff\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:17.922299 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.922263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnff\" (UniqueName: \"kubernetes.io/projected/fe9fb41c-7add-473d-a1bf-14efb5919950-kube-api-access-8cnff\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:17.922486 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.922353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:17.922486 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.922384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:17.922817 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.922796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:17.922851 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.922816 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:17.930651 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:17.930621 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cnff\" (UniqueName: \"kubernetes.io/projected/fe9fb41c-7add-473d-a1bf-14efb5919950-kube-api-access-8cnff\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:18.119983 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:18.119942 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:18.260511 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:18.260374 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp"] Jul 13 17:36:18.263028 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:36:18.262996 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9fb41c_7add_473d_a1bf_14efb5919950.slice/crio-a9f05f72259fd4579bae8be49a5971b322a9eff60d44d7a002a1c2ba7a2cf06c WatchSource:0}: Error finding container a9f05f72259fd4579bae8be49a5971b322a9eff60d44d7a002a1c2ba7a2cf06c: Status 404 returned error can't find the container with id a9f05f72259fd4579bae8be49a5971b322a9eff60d44d7a002a1c2ba7a2cf06c Jul 13 17:36:18.358446 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:18.358412 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" event={"ID":"fe9fb41c-7add-473d-a1bf-14efb5919950","Type":"ContainerStarted","Data":"a9f05f72259fd4579bae8be49a5971b322a9eff60d44d7a002a1c2ba7a2cf06c"} Jul 13 17:36:19.364224 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:19.364193 2581 generic.go:356] "Generic (PLEG): container finished" podID="fe9fb41c-7add-473d-a1bf-14efb5919950" containerID="f56f00f4c875f1d5425f18bd2fc1b84839b706c97b2e6000fe3577d7001dcf40" exitCode=0 Jul 13 17:36:19.364619 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:19.364244 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" event={"ID":"fe9fb41c-7add-473d-a1bf-14efb5919950","Type":"ContainerDied","Data":"f56f00f4c875f1d5425f18bd2fc1b84839b706c97b2e6000fe3577d7001dcf40"} Jul 13 17:36:21.374682 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:21.374642 2581 generic.go:356] "Generic (PLEG): container finished" podID="fe9fb41c-7add-473d-a1bf-14efb5919950" containerID="db4eaff599ced2fd0060055123b6fd8c9e8add35c53956b44a9597cb86102b22" exitCode=0 Jul 13 17:36:21.375044 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:21.374708 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" event={"ID":"fe9fb41c-7add-473d-a1bf-14efb5919950","Type":"ContainerDied","Data":"db4eaff599ced2fd0060055123b6fd8c9e8add35c53956b44a9597cb86102b22"} Jul 13 17:36:22.380874 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:22.380836 2581 generic.go:356] "Generic (PLEG): container finished" podID="fe9fb41c-7add-473d-a1bf-14efb5919950" containerID="e284b848ce39fb30165b8925a85ab8d5702c74ae0979e87750c2e98b050b05a5" exitCode=0 Jul 13 17:36:22.381308 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:22.380921 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" event={"ID":"fe9fb41c-7add-473d-a1bf-14efb5919950","Type":"ContainerDied","Data":"e284b848ce39fb30165b8925a85ab8d5702c74ae0979e87750c2e98b050b05a5"} Jul 13 17:36:23.507270 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:23.507241 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:23.559189 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:23.559158 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-bundle\") pod \"fe9fb41c-7add-473d-a1bf-14efb5919950\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " Jul 13 17:36:23.559338 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:23.559206 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-util\") pod \"fe9fb41c-7add-473d-a1bf-14efb5919950\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " Jul 13 17:36:23.559338 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:23.559237 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cnff\" (UniqueName: \"kubernetes.io/projected/fe9fb41c-7add-473d-a1bf-14efb5919950-kube-api-access-8cnff\") pod \"fe9fb41c-7add-473d-a1bf-14efb5919950\" (UID: \"fe9fb41c-7add-473d-a1bf-14efb5919950\") " Jul 13 17:36:23.559892 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:23.559871 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-bundle" (OuterVolumeSpecName: "bundle") pod "fe9fb41c-7add-473d-a1bf-14efb5919950" (UID: "fe9fb41c-7add-473d-a1bf-14efb5919950"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:36:23.561352 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:23.561321 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe9fb41c-7add-473d-a1bf-14efb5919950-kube-api-access-8cnff" (OuterVolumeSpecName: "kube-api-access-8cnff") pod "fe9fb41c-7add-473d-a1bf-14efb5919950" (UID: "fe9fb41c-7add-473d-a1bf-14efb5919950"). InnerVolumeSpecName "kube-api-access-8cnff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:36:23.565679 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:23.565654 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-util" (OuterVolumeSpecName: "util") pod "fe9fb41c-7add-473d-a1bf-14efb5919950" (UID: "fe9fb41c-7add-473d-a1bf-14efb5919950"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:36:23.660353 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:23.660269 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:36:23.660353 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:23.660297 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe9fb41c-7add-473d-a1bf-14efb5919950-util\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:36:23.660353 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:23.660306 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cnff\" (UniqueName: \"kubernetes.io/projected/fe9fb41c-7add-473d-a1bf-14efb5919950-kube-api-access-8cnff\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:36:24.390782 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:24.390755 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" Jul 13 17:36:24.390943 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:24.390743 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwrdjp" event={"ID":"fe9fb41c-7add-473d-a1bf-14efb5919950","Type":"ContainerDied","Data":"a9f05f72259fd4579bae8be49a5971b322a9eff60d44d7a002a1c2ba7a2cf06c"} Jul 13 17:36:24.390943 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:24.390875 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9f05f72259fd4579bae8be49a5971b322a9eff60d44d7a002a1c2ba7a2cf06c" Jul 13 17:36:30.217087 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.217052 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w"] Jul 13 17:36:30.217486 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.217324 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe9fb41c-7add-473d-a1bf-14efb5919950" containerName="extract" Jul 13 17:36:30.217486 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.217334 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe9fb41c-7add-473d-a1bf-14efb5919950" containerName="extract" Jul 13 17:36:30.217486 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.217347 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe9fb41c-7add-473d-a1bf-14efb5919950" containerName="util" Jul 13 17:36:30.217486 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.217352 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe9fb41c-7add-473d-a1bf-14efb5919950" containerName="util" Jul 13 17:36:30.217486 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.217358 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe9fb41c-7add-473d-a1bf-14efb5919950" containerName="pull" Jul 13 17:36:30.217486 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.217363 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe9fb41c-7add-473d-a1bf-14efb5919950" containerName="pull" Jul 13 17:36:30.217486 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.217411 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe9fb41c-7add-473d-a1bf-14efb5919950" containerName="extract" Jul 13 17:36:30.219959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.219942 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.222760 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.222740 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 17:36:30.222959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.222946 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 17:36:30.223149 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.223133 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 17:36:30.223208 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.223168 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s8bgx\"" Jul 13 17:36:30.225709 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.225689 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 17:36:30.238789 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.238768 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w"] Jul 13 17:36:30.313663 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.313633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.313829 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.313673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgp4b\" (UniqueName: \"kubernetes.io/projected/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-kube-api-access-cgp4b\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.313829 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.313707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-manifests\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.313829 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.313754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-tmp\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.313829 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.313770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-webhook-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.414868 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.414835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.415028 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.414881 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgp4b\" (UniqueName: \"kubernetes.io/projected/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-kube-api-access-cgp4b\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.415028 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.414919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-manifests\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.415028 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.414970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-tmp\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.415028 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.414994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-webhook-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.415347 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.415321 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-manifests\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.417297 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.417261 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-tmp\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.417297 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.417285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.417419 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.417360 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-webhook-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.428383 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.428365 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgp4b\" (UniqueName: \"kubernetes.io/projected/e062ab13-f3ca-4b66-b0b3-8ab1463cadf9-kube-api-access-cgp4b\") pod \"opendatahub-operator-controller-manager-59fbf78564-j5v6w\" (UID: \"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.530781 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.530690 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:30.659293 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:30.659263 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w"] Jul 13 17:36:30.662496 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:36:30.662442 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode062ab13_f3ca_4b66_b0b3_8ab1463cadf9.slice/crio-6cbddd3b944f8b33000a5def111e24f9a5efbdb8f7ef6a3bb037249fd802a1c9 WatchSource:0}: Error finding container 6cbddd3b944f8b33000a5def111e24f9a5efbdb8f7ef6a3bb037249fd802a1c9: Status 404 returned error can't find the container with id 6cbddd3b944f8b33000a5def111e24f9a5efbdb8f7ef6a3bb037249fd802a1c9 Jul 13 17:36:31.418689 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:31.418649 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" event={"ID":"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9","Type":"ContainerStarted","Data":"6cbddd3b944f8b33000a5def111e24f9a5efbdb8f7ef6a3bb037249fd802a1c9"} Jul 13 17:36:34.433815 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:34.433772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" event={"ID":"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9","Type":"ContainerStarted","Data":"0039bc91596d9cb82a859181f42811e0b63c5efa758f3de9f8a7b63fcaec1e26"} Jul 13 17:36:35.439256 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:35.439222 2581 generic.go:356] "Generic (PLEG): container finished" podID="e062ab13-f3ca-4b66-b0b3-8ab1463cadf9" containerID="0039bc91596d9cb82a859181f42811e0b63c5efa758f3de9f8a7b63fcaec1e26" exitCode=0 Jul 13 17:36:35.439684 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:35.439277 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" event={"ID":"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9","Type":"ContainerDied","Data":"0039bc91596d9cb82a859181f42811e0b63c5efa758f3de9f8a7b63fcaec1e26"} Jul 13 17:36:36.445806 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:36.445771 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" event={"ID":"e062ab13-f3ca-4b66-b0b3-8ab1463cadf9","Type":"ContainerStarted","Data":"ce80a872ba0993155fc5a8703b10e5a254e932981650da13dfd1b0655c89f179"} Jul 13 17:36:36.446179 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:36.445852 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:36.467364 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:36.467314 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" podStartSLOduration=1.8389735649999999 podStartE2EDuration="6.467300443s" totalImagesPullingTime="3.533463314s" totalInitContainerRuntime="1.094863564s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:36:36.466706212 +0000 UTC m=+275.610043285" watchObservedRunningTime="2026-07-13 17:36:36.467300443 +0000 UTC m=+275.610637515" Jul 13 17:36:47.452843 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:47.452816 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-j5v6w" Jul 13 17:36:50.235611 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.235579 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx"] Jul 13 17:36:50.245082 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.245061 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.248833 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.248682 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 17:36:50.248833 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.248689 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xvp8d\"" Jul 13 17:36:50.248833 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.248745 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 17:36:50.248833 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.248750 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 17:36:50.248833 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.248776 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 17:36:50.260739 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.260720 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx"] Jul 13 17:36:50.369007 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.368981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf59cf94-f50b-4b63-9501-9d816fb91673-tmp\") pod \"kube-auth-proxy-545dc9d9cd-7xptx\" (UID: \"bf59cf94-f50b-4b63-9501-9d816fb91673\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.369195 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.369026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf59cf94-f50b-4b63-9501-9d816fb91673-tls-certs\") pod \"kube-auth-proxy-545dc9d9cd-7xptx\" (UID: \"bf59cf94-f50b-4b63-9501-9d816fb91673\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.369195 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.369066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnz25\" (UniqueName: \"kubernetes.io/projected/bf59cf94-f50b-4b63-9501-9d816fb91673-kube-api-access-fnz25\") pod \"kube-auth-proxy-545dc9d9cd-7xptx\" (UID: \"bf59cf94-f50b-4b63-9501-9d816fb91673\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.470056 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.470027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnz25\" (UniqueName: \"kubernetes.io/projected/bf59cf94-f50b-4b63-9501-9d816fb91673-kube-api-access-fnz25\") pod \"kube-auth-proxy-545dc9d9cd-7xptx\" (UID: \"bf59cf94-f50b-4b63-9501-9d816fb91673\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.470244 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.470076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf59cf94-f50b-4b63-9501-9d816fb91673-tmp\") pod \"kube-auth-proxy-545dc9d9cd-7xptx\" (UID: \"bf59cf94-f50b-4b63-9501-9d816fb91673\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.470244 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.470132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf59cf94-f50b-4b63-9501-9d816fb91673-tls-certs\") pod \"kube-auth-proxy-545dc9d9cd-7xptx\" (UID: \"bf59cf94-f50b-4b63-9501-9d816fb91673\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.472320 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.472292 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf59cf94-f50b-4b63-9501-9d816fb91673-tmp\") pod \"kube-auth-proxy-545dc9d9cd-7xptx\" (UID: \"bf59cf94-f50b-4b63-9501-9d816fb91673\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.472437 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.472321 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf59cf94-f50b-4b63-9501-9d816fb91673-tls-certs\") pod \"kube-auth-proxy-545dc9d9cd-7xptx\" (UID: \"bf59cf94-f50b-4b63-9501-9d816fb91673\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.481137 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.481115 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnz25\" (UniqueName: \"kubernetes.io/projected/bf59cf94-f50b-4b63-9501-9d816fb91673-kube-api-access-fnz25\") pod \"kube-auth-proxy-545dc9d9cd-7xptx\" (UID: \"bf59cf94-f50b-4b63-9501-9d816fb91673\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.553691 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.553611 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" Jul 13 17:36:50.683867 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:50.683842 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx"] Jul 13 17:36:50.685191 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:36:50.685167 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf59cf94_f50b_4b63_9501_9d816fb91673.slice/crio-24e53854a2011b8d0414ce1f6965753a5681f86e9b78a48beb7ba8c038090e89 WatchSource:0}: Error finding container 24e53854a2011b8d0414ce1f6965753a5681f86e9b78a48beb7ba8c038090e89: Status 404 returned error can't find the container with id 24e53854a2011b8d0414ce1f6965753a5681f86e9b78a48beb7ba8c038090e89 Jul 13 17:36:51.506480 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:51.506429 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" event={"ID":"bf59cf94-f50b-4b63-9501-9d816fb91673","Type":"ContainerStarted","Data":"24e53854a2011b8d0414ce1f6965753a5681f86e9b78a48beb7ba8c038090e89"} Jul 13 17:36:54.520417 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:54.520369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" event={"ID":"bf59cf94-f50b-4b63-9501-9d816fb91673","Type":"ContainerStarted","Data":"a2e9945ce879b1da0b2c45ee6b9edfacf3e8fdae890c9a1a9a10136ffe5bdb4b"} Jul 13 17:36:54.537014 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:54.536886 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-7xptx" podStartSLOduration=1.321441136 podStartE2EDuration="4.536869805s" totalImagesPullingTime="3.215428669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:36:54.536071844 +0000 UTC m=+293.679408917" watchObservedRunningTime="2026-07-13 17:36:54.536869805 +0000 UTC m=+293.680206880" Jul 13 17:36:58.688832 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.688797 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd"] Jul 13 17:36:58.691912 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.691895 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.694568 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.694541 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 17:36:58.694801 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.694784 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xkxn6\"" Jul 13 17:36:58.716218 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.716189 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd"] Jul 13 17:36:58.735739 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.735711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dd379a4-3a11-4090-b76b-452534b99780-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.735862 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.735746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.735862 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.735774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr966\" (UniqueName: \"kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-kube-api-access-tr966\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.735862 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.735853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.735980 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.735905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.735980 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.735932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.736080 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.735985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.736080 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.736031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.736080 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.736055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dd379a4-3a11-4090-b76b-452534b99780-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837104 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837104 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837350 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837134 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837350 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837160 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837350 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dd379a4-3a11-4090-b76b-452534b99780-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837350 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dd379a4-3a11-4090-b76b-452534b99780-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837350 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837350 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr966\" (UniqueName: \"kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-kube-api-access-tr966\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837350 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837303 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837670 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837761 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837740 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837826 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.837874 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.837853 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.838309 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.838287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dd379a4-3a11-4090-b76b-452534b99780-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.839756 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.839734 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.839882 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.839813 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dd379a4-3a11-4090-b76b-452534b99780-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.854994 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.854965 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr966\" (UniqueName: \"kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-kube-api-access-tr966\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:58.859276 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:58.859242 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:59.003343 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.003237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:36:59.131147 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.131062 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd"] Jul 13 17:36:59.133206 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:36:59.133179 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd379a4_3a11_4090_b76b_452534b99780.slice/crio-9ee19d8eadf00afd8989d56578a94cd10428b4fbcf4d9c3856d727485067a035 WatchSource:0}: Error finding container 9ee19d8eadf00afd8989d56578a94cd10428b4fbcf4d9c3856d727485067a035: Status 404 returned error can't find the container with id 9ee19d8eadf00afd8989d56578a94cd10428b4fbcf4d9c3856d727485067a035 Jul 13 17:36:59.250654 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.250623 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h"] Jul 13 17:36:59.254878 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.254834 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.257385 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.257353 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 17:36:59.257385 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.257379 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 17:36:59.257582 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.257353 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 17:36:59.257582 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.257395 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5qfzb\"" Jul 13 17:36:59.270075 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.270053 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h"] Jul 13 17:36:59.340596 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.340567 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c64d3bb9-12ba-4923-9268-f6b992045549-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.340762 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.340600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c64d3bb9-12ba-4923-9268-f6b992045549-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.340762 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.340699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8knm5\" (UniqueName: \"kubernetes.io/projected/c64d3bb9-12ba-4923-9268-f6b992045549-kube-api-access-8knm5\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.340762 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.340736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c64d3bb9-12ba-4923-9268-f6b992045549-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.340762 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.340759 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c64d3bb9-12ba-4923-9268-f6b992045549-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.340900 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.340786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c64d3bb9-12ba-4923-9268-f6b992045549-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.340900 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.340814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c64d3bb9-12ba-4923-9268-f6b992045549-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.441951 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.441921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c64d3bb9-12ba-4923-9268-f6b992045549-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.441951 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.441955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c64d3bb9-12ba-4923-9268-f6b992045549-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.442183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.441992 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8knm5\" (UniqueName: \"kubernetes.io/projected/c64d3bb9-12ba-4923-9268-f6b992045549-kube-api-access-8knm5\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.442183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.442025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c64d3bb9-12ba-4923-9268-f6b992045549-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.442183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.442049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c64d3bb9-12ba-4923-9268-f6b992045549-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.442183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.442085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c64d3bb9-12ba-4923-9268-f6b992045549-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.442183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.442108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c64d3bb9-12ba-4923-9268-f6b992045549-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.443246 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.443167 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c64d3bb9-12ba-4923-9268-f6b992045549-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.444440 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.444415 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c64d3bb9-12ba-4923-9268-f6b992045549-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.444792 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.444765 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c64d3bb9-12ba-4923-9268-f6b992045549-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.444886 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.444845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c64d3bb9-12ba-4923-9268-f6b992045549-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.444948 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.444930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c64d3bb9-12ba-4923-9268-f6b992045549-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.450673 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.450653 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8knm5\" (UniqueName: \"kubernetes.io/projected/c64d3bb9-12ba-4923-9268-f6b992045549-kube-api-access-8knm5\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.450845 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.450829 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c64d3bb9-12ba-4923-9268-f6b992045549-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-clf9h\" (UID: \"c64d3bb9-12ba-4923-9268-f6b992045549\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.541854 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.541773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" event={"ID":"2dd379a4-3a11-4090-b76b-452534b99780","Type":"ContainerStarted","Data":"9ee19d8eadf00afd8989d56578a94cd10428b4fbcf4d9c3856d727485067a035"} Jul 13 17:36:59.564026 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.564002 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:36:59.699124 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:36:59.699099 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h"] Jul 13 17:36:59.700957 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:36:59.700931 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64d3bb9_12ba_4923_9268_f6b992045549.slice/crio-44f25c7e47ff952ec8d8079274964cb35a5314ef0df8dbc4877de1b7e5881a5c WatchSource:0}: Error finding container 44f25c7e47ff952ec8d8079274964cb35a5314ef0df8dbc4877de1b7e5881a5c: Status 404 returned error can't find the container with id 44f25c7e47ff952ec8d8079274964cb35a5314ef0df8dbc4877de1b7e5881a5c Jul 13 17:37:00.549285 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:00.549243 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" event={"ID":"c64d3bb9-12ba-4923-9268-f6b992045549","Type":"ContainerStarted","Data":"44f25c7e47ff952ec8d8079274964cb35a5314ef0df8dbc4877de1b7e5881a5c"} Jul 13 17:37:02.707557 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:02.706615 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:37:02.707557 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:02.706692 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:37:02.707557 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:02.706724 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:37:02.707557 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:02.707430 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:37:02.707557 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:02.707516 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:37:02.725481 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:02.725435 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 17:37:03.568041 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:03.568005 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" event={"ID":"2dd379a4-3a11-4090-b76b-452534b99780","Type":"ContainerStarted","Data":"c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e"} Jul 13 17:37:03.569518 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:03.569492 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" event={"ID":"c64d3bb9-12ba-4923-9268-f6b992045549","Type":"ContainerStarted","Data":"9ce4f36c803c863df98414973a266c2d83b41b664345cfb4680428781797f446"} Jul 13 17:37:03.569659 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:03.569645 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:37:03.571140 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:03.571118 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-clf9h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 17:37:03.571224 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:03.571158 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" podUID="c64d3bb9-12ba-4923-9268-f6b992045549" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 17:37:03.589352 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:03.589307 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" podStartSLOduration=2.018059334 podStartE2EDuration="5.589293931s" totalImagesPullingTime="3.571234597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:37:03.587634199 +0000 UTC m=+302.730971273" watchObservedRunningTime="2026-07-13 17:37:03.589293931 +0000 UTC m=+302.732631000" Jul 13 17:37:03.609011 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:03.608971 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" podStartSLOduration=1.604763391 podStartE2EDuration="4.608958942s" totalImagesPullingTime="3.004195551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:37:03.606934052 +0000 UTC m=+302.750271125" watchObservedRunningTime="2026-07-13 17:37:03.608958942 +0000 UTC m=+302.752296015" Jul 13 17:37:04.004159 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:04.004120 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:37:04.005566 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:04.005541 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 13 17:37:04.005681 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:04.005597 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" podUID="2dd379a4-3a11-4090-b76b-452534b99780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 13 17:37:04.575571 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:04.575543 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-clf9h" Jul 13 17:37:05.004425 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:05.004374 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 13 17:37:05.004811 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:05.004483 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" podUID="2dd379a4-3a11-4090-b76b-452534b99780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 13 17:37:05.081085 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:05.081050 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd"] Jul 13 17:37:06.004083 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:06.004045 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body= Jul 13 17:37:06.004278 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:06.004151 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" podUID="2dd379a4-3a11-4090-b76b-452534b99780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" Jul 13 17:37:06.583394 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:06.583348 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" podUID="2dd379a4-3a11-4090-b76b-452534b99780" containerName="istio-proxy" containerID="cri-o://c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e" gracePeriod=30 Jul 13 17:37:11.835227 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.835203 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:37:11.954957 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.954914 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-socket\") pod \"2dd379a4-3a11-4090-b76b-452534b99780\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " Jul 13 17:37:11.955127 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.954966 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr966\" (UniqueName: \"kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-kube-api-access-tr966\") pod \"2dd379a4-3a11-4090-b76b-452534b99780\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " Jul 13 17:37:11.955127 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955001 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-envoy\") pod \"2dd379a4-3a11-4090-b76b-452534b99780\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " Jul 13 17:37:11.955127 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955029 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-istio-token\") pod \"2dd379a4-3a11-4090-b76b-452534b99780\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " Jul 13 17:37:11.955127 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955070 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dd379a4-3a11-4090-b76b-452534b99780-istio-podinfo\") pod \"2dd379a4-3a11-4090-b76b-452534b99780\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " Jul 13 17:37:11.955293 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955138 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-data\") pod \"2dd379a4-3a11-4090-b76b-452534b99780\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " Jul 13 17:37:11.955293 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955183 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-certs\") pod \"2dd379a4-3a11-4090-b76b-452534b99780\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " Jul 13 17:37:11.955293 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955204 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dd379a4-3a11-4090-b76b-452534b99780-istiod-ca-cert\") pod \"2dd379a4-3a11-4090-b76b-452534b99780\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " Jul 13 17:37:11.955293 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955228 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-credential-socket\") pod \"2dd379a4-3a11-4090-b76b-452534b99780\" (UID: \"2dd379a4-3a11-4090-b76b-452534b99780\") " Jul 13 17:37:11.955293 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955268 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2dd379a4-3a11-4090-b76b-452534b99780" (UID: "2dd379a4-3a11-4090-b76b-452534b99780"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:37:11.955556 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955510 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2dd379a4-3a11-4090-b76b-452534b99780" (UID: "2dd379a4-3a11-4090-b76b-452534b99780"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:37:11.955556 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955521 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:37:11.955556 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955536 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-data" (OuterVolumeSpecName: "istio-data") pod "2dd379a4-3a11-4090-b76b-452534b99780" (UID: "2dd379a4-3a11-4090-b76b-452534b99780"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:37:11.955725 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955704 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2dd379a4-3a11-4090-b76b-452534b99780" (UID: "2dd379a4-3a11-4090-b76b-452534b99780"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:37:11.955805 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.955784 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd379a4-3a11-4090-b76b-452534b99780-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2dd379a4-3a11-4090-b76b-452534b99780" (UID: "2dd379a4-3a11-4090-b76b-452534b99780"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:37:11.957560 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.957535 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-kube-api-access-tr966" (OuterVolumeSpecName: "kube-api-access-tr966") pod "2dd379a4-3a11-4090-b76b-452534b99780" (UID: "2dd379a4-3a11-4090-b76b-452534b99780"). InnerVolumeSpecName "kube-api-access-tr966". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:37:11.957661 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.957583 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-istio-token" (OuterVolumeSpecName: "istio-token") pod "2dd379a4-3a11-4090-b76b-452534b99780" (UID: "2dd379a4-3a11-4090-b76b-452534b99780"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:37:11.957661 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.957636 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2dd379a4-3a11-4090-b76b-452534b99780" (UID: "2dd379a4-3a11-4090-b76b-452534b99780"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:37:11.957740 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:11.957654 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2dd379a4-3a11-4090-b76b-452534b99780-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2dd379a4-3a11-4090-b76b-452534b99780" (UID: "2dd379a4-3a11-4090-b76b-452534b99780"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 17:37:12.056287 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.056247 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:37:12.056287 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.056279 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dd379a4-3a11-4090-b76b-452534b99780-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:37:12.056287 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.056287 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:37:12.056287 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.056297 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr966\" (UniqueName: \"kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-kube-api-access-tr966\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:37:12.056591 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.056306 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:37:12.056591 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.056314 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dd379a4-3a11-4090-b76b-452534b99780-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:37:12.056591 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.056321 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dd379a4-3a11-4090-b76b-452534b99780-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:37:12.056591 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.056328 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dd379a4-3a11-4090-b76b-452534b99780-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:37:12.609313 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.609276 2581 generic.go:356] "Generic (PLEG): container finished" podID="2dd379a4-3a11-4090-b76b-452534b99780" containerID="c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e" exitCode=0 Jul 13 17:37:12.609501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.609344 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" Jul 13 17:37:12.609501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.609349 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" event={"ID":"2dd379a4-3a11-4090-b76b-452534b99780","Type":"ContainerDied","Data":"c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e"} Jul 13 17:37:12.609501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.609401 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd" event={"ID":"2dd379a4-3a11-4090-b76b-452534b99780","Type":"ContainerDied","Data":"9ee19d8eadf00afd8989d56578a94cd10428b4fbcf4d9c3856d727485067a035"} Jul 13 17:37:12.609501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.609433 2581 scope.go:117] "RemoveContainer" containerID="c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e" Jul 13 17:37:12.618157 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.618138 2581 scope.go:117] "RemoveContainer" containerID="c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e" Jul 13 17:37:12.618396 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:37:12.618377 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e\": container with ID starting with c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e not found: ID does not exist" containerID="c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e" Jul 13 17:37:12.618439 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.618404 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e"} err="failed to get container status \"c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e\": rpc error: code = NotFound desc = could not find container \"c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e\": container with ID starting with c8a7574f38acb2c582bed5093ba6bcd158e8212f1408ff943f3e17b2d288a48e not found: ID does not exist" Jul 13 17:37:12.630401 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.630376 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd"] Jul 13 17:37:12.633566 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:12.633546 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-j8rdd"] Jul 13 17:37:13.276803 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:13.276768 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dd379a4-3a11-4090-b76b-452534b99780" path="/var/lib/kubelet/pods/2dd379a4-3a11-4090-b76b-452534b99780/volumes" Jul 13 17:37:51.251310 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.251272 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bjx84"] Jul 13 17:37:51.251752 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.251579 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd379a4-3a11-4090-b76b-452534b99780" containerName="istio-proxy" Jul 13 17:37:51.251752 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.251592 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd379a4-3a11-4090-b76b-452534b99780" containerName="istio-proxy" Jul 13 17:37:51.251752 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.251640 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd379a4-3a11-4090-b76b-452534b99780" containerName="istio-proxy" Jul 13 17:37:51.258118 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.258098 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bjx84" Jul 13 17:37:51.261502 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.261480 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 17:37:51.262660 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.262632 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 17:37:51.262780 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.262647 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vmh4t\"" Jul 13 17:37:51.271041 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.271018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bjx84"] Jul 13 17:37:51.360547 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.360518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vmc5\" (UniqueName: \"kubernetes.io/projected/4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89-kube-api-access-4vmc5\") pod \"kuadrant-operator-catalog-bjx84\" (UID: \"4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89\") " pod="kuadrant-system/kuadrant-operator-catalog-bjx84" Jul 13 17:37:51.461112 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.461063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vmc5\" (UniqueName: \"kubernetes.io/projected/4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89-kube-api-access-4vmc5\") pod \"kuadrant-operator-catalog-bjx84\" (UID: \"4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89\") " pod="kuadrant-system/kuadrant-operator-catalog-bjx84" Jul 13 17:37:51.470997 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.470972 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vmc5\" (UniqueName: \"kubernetes.io/projected/4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89-kube-api-access-4vmc5\") pod \"kuadrant-operator-catalog-bjx84\" (UID: \"4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89\") " pod="kuadrant-system/kuadrant-operator-catalog-bjx84" Jul 13 17:37:51.568600 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.568519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bjx84" Jul 13 17:37:51.620085 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.620050 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bjx84"] Jul 13 17:37:51.692471 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.692379 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bjx84"] Jul 13 17:37:51.694775 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:37:51.694745 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ceaeb6f_c10a_4536_bbc9_e8d71b7f0c89.slice/crio-f1cd49d4a663ef108ff16f89739f3423e85cd2c65822c8cf62285e5c3435a66f WatchSource:0}: Error finding container f1cd49d4a663ef108ff16f89739f3423e85cd2c65822c8cf62285e5c3435a66f: Status 404 returned error can't find the container with id f1cd49d4a663ef108ff16f89739f3423e85cd2c65822c8cf62285e5c3435a66f Jul 13 17:37:51.696009 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.695989 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 17:37:51.773147 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.773112 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bjx84" event={"ID":"4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89","Type":"ContainerStarted","Data":"f1cd49d4a663ef108ff16f89739f3423e85cd2c65822c8cf62285e5c3435a66f"} Jul 13 17:37:51.830868 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.830785 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncft8"] Jul 13 17:37:51.833346 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.833330 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ncft8" Jul 13 17:37:51.841014 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.840990 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncft8"] Jul 13 17:37:51.965079 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:51.965045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b88bj\" (UniqueName: \"kubernetes.io/projected/bd425c14-cd10-49c1-b44e-0769ef30c9be-kube-api-access-b88bj\") pod \"kuadrant-operator-catalog-ncft8\" (UID: \"bd425c14-cd10-49c1-b44e-0769ef30c9be\") " pod="kuadrant-system/kuadrant-operator-catalog-ncft8" Jul 13 17:37:52.066426 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:52.066389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b88bj\" (UniqueName: \"kubernetes.io/projected/bd425c14-cd10-49c1-b44e-0769ef30c9be-kube-api-access-b88bj\") pod \"kuadrant-operator-catalog-ncft8\" (UID: \"bd425c14-cd10-49c1-b44e-0769ef30c9be\") " pod="kuadrant-system/kuadrant-operator-catalog-ncft8" Jul 13 17:37:52.074423 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:52.074395 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b88bj\" (UniqueName: \"kubernetes.io/projected/bd425c14-cd10-49c1-b44e-0769ef30c9be-kube-api-access-b88bj\") pod \"kuadrant-operator-catalog-ncft8\" (UID: \"bd425c14-cd10-49c1-b44e-0769ef30c9be\") " pod="kuadrant-system/kuadrant-operator-catalog-ncft8" Jul 13 17:37:52.143380 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:52.143340 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ncft8" Jul 13 17:37:52.287470 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:52.287435 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ncft8"] Jul 13 17:37:52.289421 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:37:52.289396 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd425c14_cd10_49c1_b44e_0769ef30c9be.slice/crio-ad463bffccdbdadb68aba6d70174bdd68cf7c909ca3093e4e615e7a21991c553 WatchSource:0}: Error finding container ad463bffccdbdadb68aba6d70174bdd68cf7c909ca3093e4e615e7a21991c553: Status 404 returned error can't find the container with id ad463bffccdbdadb68aba6d70174bdd68cf7c909ca3093e4e615e7a21991c553 Jul 13 17:37:52.779342 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:52.779306 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ncft8" event={"ID":"bd425c14-cd10-49c1-b44e-0769ef30c9be","Type":"ContainerStarted","Data":"ad463bffccdbdadb68aba6d70174bdd68cf7c909ca3093e4e615e7a21991c553"} Jul 13 17:37:54.789189 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:54.789150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ncft8" event={"ID":"bd425c14-cd10-49c1-b44e-0769ef30c9be","Type":"ContainerStarted","Data":"b514f8c1c64307c1ddee2b5b11d5e92a6331371f34fa068a25b1f84d0cb18da5"} Jul 13 17:37:54.790563 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:54.790538 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bjx84" event={"ID":"4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89","Type":"ContainerStarted","Data":"9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266"} Jul 13 17:37:54.790685 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:54.790645 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-bjx84" podUID="4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89" containerName="registry-server" containerID="cri-o://9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266" gracePeriod=2 Jul 13 17:37:54.806257 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:54.806209 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ncft8" podStartSLOduration=2.245699386 podStartE2EDuration="3.806191099s" totalImagesPullingTime="1.560491713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:37:54.805841705 +0000 UTC m=+353.949178780" watchObservedRunningTime="2026-07-13 17:37:54.806191099 +0000 UTC m=+353.949528173" Jul 13 17:37:54.820853 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:54.820810 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bjx84" podStartSLOduration=1.668800176 podStartE2EDuration="3.820794671s" totalImagesPullingTime="2.151994495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:37:54.819978587 +0000 UTC m=+353.963315661" watchObservedRunningTime="2026-07-13 17:37:54.820794671 +0000 UTC m=+353.964131743" Jul 13 17:37:55.033340 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.033312 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bjx84" Jul 13 17:37:55.091899 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.091813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vmc5\" (UniqueName: \"kubernetes.io/projected/4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89-kube-api-access-4vmc5\") pod \"4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89\" (UID: \"4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89\") " Jul 13 17:37:55.093983 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.093956 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89-kube-api-access-4vmc5" (OuterVolumeSpecName: "kube-api-access-4vmc5") pod "4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89" (UID: "4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89"). InnerVolumeSpecName "kube-api-access-4vmc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:37:55.192318 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.192266 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vmc5\" (UniqueName: \"kubernetes.io/projected/4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89-kube-api-access-4vmc5\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:37:55.796392 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.796352 2581 generic.go:356] "Generic (PLEG): container finished" podID="4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89" containerID="9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266" exitCode=0 Jul 13 17:37:55.796801 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.796395 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bjx84" Jul 13 17:37:55.796801 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.796435 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bjx84" event={"ID":"4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89","Type":"ContainerDied","Data":"9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266"} Jul 13 17:37:55.796801 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.796497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bjx84" event={"ID":"4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89","Type":"ContainerDied","Data":"f1cd49d4a663ef108ff16f89739f3423e85cd2c65822c8cf62285e5c3435a66f"} Jul 13 17:37:55.796801 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.796517 2581 scope.go:117] "RemoveContainer" containerID="9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266" Jul 13 17:37:55.805041 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.805024 2581 scope.go:117] "RemoveContainer" containerID="9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266" Jul 13 17:37:55.805291 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:37:55.805274 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266\": container with ID starting with 9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266 not found: ID does not exist" containerID="9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266" Jul 13 17:37:55.805348 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.805300 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266"} err="failed to get container status \"9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266\": rpc error: code = NotFound desc = could not find container \"9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266\": container with ID starting with 9cf0c435286284fee7217aa34b4880e093b569863a80ed7f9f3534e852fa8266 not found: ID does not exist" Jul 13 17:37:55.812595 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.812576 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bjx84"] Jul 13 17:37:55.817709 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:55.817689 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bjx84"] Jul 13 17:37:57.276941 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:37:57.276904 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89" path="/var/lib/kubelet/pods/4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89/volumes" Jul 13 17:38:02.143860 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:02.143813 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ncft8" Jul 13 17:38:02.144242 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:02.143882 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ncft8" Jul 13 17:38:02.165501 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:02.165452 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ncft8" Jul 13 17:38:02.848402 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:02.848374 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ncft8" Jul 13 17:38:06.865518 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:06.865479 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74"] Jul 13 17:38:06.865893 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:06.865753 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89" containerName="registry-server" Jul 13 17:38:06.865893 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:06.865763 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89" containerName="registry-server" Jul 13 17:38:06.865893 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:06.865814 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ceaeb6f-c10a-4536-bbc9-e8d71b7f0c89" containerName="registry-server" Jul 13 17:38:06.870322 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:06.870302 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:06.872704 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:06.872680 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l446t\"" Jul 13 17:38:06.876515 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:06.876491 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74"] Jul 13 17:38:06.994205 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:06.994166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:06.994384 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:06.994226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:06.994384 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:06.994285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6629f\" (UniqueName: \"kubernetes.io/projected/09d0a432-d612-4133-a87c-d1bf7211327b-kube-api-access-6629f\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:07.095415 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.095373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:07.095415 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.095418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6629f\" (UniqueName: \"kubernetes.io/projected/09d0a432-d612-4133-a87c-d1bf7211327b-kube-api-access-6629f\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:07.095638 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.095486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:07.095782 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.095762 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:07.095856 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.095822 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:07.104140 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.104105 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6629f\" (UniqueName: \"kubernetes.io/projected/09d0a432-d612-4133-a87c-d1bf7211327b-kube-api-access-6629f\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:07.181147 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.181045 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:07.263667 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.263623 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl"] Jul 13 17:38:07.268145 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.268121 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.278681 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.278651 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl"] Jul 13 17:38:07.312756 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.312724 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74"] Jul 13 17:38:07.316214 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:38:07.316188 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d0a432_d612_4133_a87c_d1bf7211327b.slice/crio-63668afe6aefae4c19bf7edf9fb0fa5a5bb74bb8b2c50f8c6000cba5f7ae4ee0 WatchSource:0}: Error finding container 63668afe6aefae4c19bf7edf9fb0fa5a5bb74bb8b2c50f8c6000cba5f7ae4ee0: Status 404 returned error can't find the container with id 63668afe6aefae4c19bf7edf9fb0fa5a5bb74bb8b2c50f8c6000cba5f7ae4ee0 Jul 13 17:38:07.398325 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.398287 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.398537 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.398338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lplbh\" (UniqueName: \"kubernetes.io/projected/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-kube-api-access-lplbh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.398537 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.398403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.499854 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.499758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.499854 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.499806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplbh\" (UniqueName: \"kubernetes.io/projected/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-kube-api-access-lplbh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.499854 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.499844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.500130 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.500087 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.500242 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.500222 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.510265 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.510234 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lplbh\" (UniqueName: \"kubernetes.io/projected/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-kube-api-access-lplbh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.582480 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.582439 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:07.665256 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.665222 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c"] Jul 13 17:38:07.671914 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.671888 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:07.675697 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.675670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c"] Jul 13 17:38:07.715152 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.715128 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl"] Jul 13 17:38:07.717056 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:38:07.717024 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6ada0c_5cc7_4ad6_9a33_0dc39727f753.slice/crio-263119404dc7a0ed9057c37c70b3a55ff0117a7f48a729be5f3321465681eb18 WatchSource:0}: Error finding container 263119404dc7a0ed9057c37c70b3a55ff0117a7f48a729be5f3321465681eb18: Status 404 returned error can't find the container with id 263119404dc7a0ed9057c37c70b3a55ff0117a7f48a729be5f3321465681eb18 Jul 13 17:38:07.802904 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.802866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45mm2\" (UniqueName: \"kubernetes.io/projected/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-kube-api-access-45mm2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:07.803076 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.802919 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:07.803076 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.802956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:07.850173 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.850144 2581 generic.go:356] "Generic (PLEG): container finished" podID="dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" containerID="8c4a4b2b79b40bd84f564380a35fd91de1d2d32a8d31ac4da55cd1bd24739f81" exitCode=0 Jul 13 17:38:07.850578 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.850232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" event={"ID":"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753","Type":"ContainerDied","Data":"8c4a4b2b79b40bd84f564380a35fd91de1d2d32a8d31ac4da55cd1bd24739f81"} Jul 13 17:38:07.850578 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.850289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" event={"ID":"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753","Type":"ContainerStarted","Data":"263119404dc7a0ed9057c37c70b3a55ff0117a7f48a729be5f3321465681eb18"} Jul 13 17:38:07.851752 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.851727 2581 generic.go:356] "Generic (PLEG): container finished" podID="09d0a432-d612-4133-a87c-d1bf7211327b" containerID="068aff9a7300b845c0388a29a6148a314980cafcecea1c09afc7a34a68b1f68f" exitCode=0 Jul 13 17:38:07.851843 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.851784 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" event={"ID":"09d0a432-d612-4133-a87c-d1bf7211327b","Type":"ContainerDied","Data":"068aff9a7300b845c0388a29a6148a314980cafcecea1c09afc7a34a68b1f68f"} Jul 13 17:38:07.851843 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.851833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" event={"ID":"09d0a432-d612-4133-a87c-d1bf7211327b","Type":"ContainerStarted","Data":"63668afe6aefae4c19bf7edf9fb0fa5a5bb74bb8b2c50f8c6000cba5f7ae4ee0"} Jul 13 17:38:07.903679 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.903648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45mm2\" (UniqueName: \"kubernetes.io/projected/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-kube-api-access-45mm2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:07.904045 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.903695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:07.904045 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.903814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:07.904045 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.904014 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:07.904174 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.904100 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:07.912291 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.912264 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45mm2\" (UniqueName: \"kubernetes.io/projected/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-kube-api-access-45mm2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:07.983439 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:07.983407 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:08.066538 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.066505 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7"] Jul 13 17:38:08.070925 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.070903 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.079665 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.079629 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7"] Jul 13 17:38:08.116735 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.116710 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c"] Jul 13 17:38:08.118453 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:38:08.118426 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4df473_1ca4_44e2_90f5_d85a1dd0f07f.slice/crio-5fbf195695aa54b152b297538a311f3d4b9be96f40e1147aceb11d97c955b134 WatchSource:0}: Error finding container 5fbf195695aa54b152b297538a311f3d4b9be96f40e1147aceb11d97c955b134: Status 404 returned error can't find the container with id 5fbf195695aa54b152b297538a311f3d4b9be96f40e1147aceb11d97c955b134 Jul 13 17:38:08.206288 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.206243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.206288 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.206285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.206518 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.206328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxmc2\" (UniqueName: \"kubernetes.io/projected/4e120035-5b97-4586-b18f-95254b1feda7-kube-api-access-lxmc2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.306952 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.306868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.306952 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.306905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.306952 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.306950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxmc2\" (UniqueName: \"kubernetes.io/projected/4e120035-5b97-4586-b18f-95254b1feda7-kube-api-access-lxmc2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.307255 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.307232 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.307297 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.307250 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.315771 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.315748 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxmc2\" (UniqueName: \"kubernetes.io/projected/4e120035-5b97-4586-b18f-95254b1feda7-kube-api-access-lxmc2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.381437 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.381407 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:08.513037 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.513010 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7"] Jul 13 17:38:08.514586 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:38:08.514560 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e120035_5b97_4586_b18f_95254b1feda7.slice/crio-9e645e31e0f9baf6cddc8527d4a42bb1ddd34fff1ddc840c822f0c16f614e833 WatchSource:0}: Error finding container 9e645e31e0f9baf6cddc8527d4a42bb1ddd34fff1ddc840c822f0c16f614e833: Status 404 returned error can't find the container with id 9e645e31e0f9baf6cddc8527d4a42bb1ddd34fff1ddc840c822f0c16f614e833 Jul 13 17:38:08.859011 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.858980 2581 generic.go:356] "Generic (PLEG): container finished" podID="dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" containerID="d4c2a846ce41976ff50b8375c5ecae24bdbb705a5b3eb0f9da583e33aa9790b9" exitCode=0 Jul 13 17:38:08.859164 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.859048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" event={"ID":"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753","Type":"ContainerDied","Data":"d4c2a846ce41976ff50b8375c5ecae24bdbb705a5b3eb0f9da583e33aa9790b9"} Jul 13 17:38:08.860539 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.860516 2581 generic.go:356] "Generic (PLEG): container finished" podID="aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" containerID="5d894c599a88f6ac9e5044aa594850ca283539bf750510dbf610334d98b33b1c" exitCode=0 Jul 13 17:38:08.860618 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.860592 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" event={"ID":"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f","Type":"ContainerDied","Data":"5d894c599a88f6ac9e5044aa594850ca283539bf750510dbf610334d98b33b1c"} Jul 13 17:38:08.860861 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.860641 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" event={"ID":"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f","Type":"ContainerStarted","Data":"5fbf195695aa54b152b297538a311f3d4b9be96f40e1147aceb11d97c955b134"} Jul 13 17:38:08.862412 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.862392 2581 generic.go:356] "Generic (PLEG): container finished" podID="09d0a432-d612-4133-a87c-d1bf7211327b" containerID="2b1c748acc6fdd5733f12530fa5044a79b9d8787df616bf7de0355e7295211de" exitCode=0 Jul 13 17:38:08.862510 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.862478 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" event={"ID":"09d0a432-d612-4133-a87c-d1bf7211327b","Type":"ContainerDied","Data":"2b1c748acc6fdd5733f12530fa5044a79b9d8787df616bf7de0355e7295211de"} Jul 13 17:38:08.864024 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.864004 2581 generic.go:356] "Generic (PLEG): container finished" podID="4e120035-5b97-4586-b18f-95254b1feda7" containerID="764d157e1cb53fbff32bdd225ae5b952d69a849c0b05b4643636da6685e6c080" exitCode=0 Jul 13 17:38:08.864092 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.864062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" event={"ID":"4e120035-5b97-4586-b18f-95254b1feda7","Type":"ContainerDied","Data":"764d157e1cb53fbff32bdd225ae5b952d69a849c0b05b4643636da6685e6c080"} Jul 13 17:38:08.864127 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:08.864096 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" event={"ID":"4e120035-5b97-4586-b18f-95254b1feda7","Type":"ContainerStarted","Data":"9e645e31e0f9baf6cddc8527d4a42bb1ddd34fff1ddc840c822f0c16f614e833"} Jul 13 17:38:09.871349 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:09.871315 2581 generic.go:356] "Generic (PLEG): container finished" podID="dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" containerID="3caaa5ed4e9a06cff3dafb327e7e046033ca42cd054e56c1d9d161b8539fce3d" exitCode=0 Jul 13 17:38:09.871770 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:09.871398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" event={"ID":"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753","Type":"ContainerDied","Data":"3caaa5ed4e9a06cff3dafb327e7e046033ca42cd054e56c1d9d161b8539fce3d"} Jul 13 17:38:09.873237 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:09.873212 2581 generic.go:356] "Generic (PLEG): container finished" podID="09d0a432-d612-4133-a87c-d1bf7211327b" containerID="b5ab203f4438e319d4badcf006e6fdf46722c7e9c2db81f63917ac2b1ce41c8e" exitCode=0 Jul 13 17:38:09.873358 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:09.873297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" event={"ID":"09d0a432-d612-4133-a87c-d1bf7211327b","Type":"ContainerDied","Data":"b5ab203f4438e319d4badcf006e6fdf46722c7e9c2db81f63917ac2b1ce41c8e"} Jul 13 17:38:10.882600 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:10.882567 2581 generic.go:356] "Generic (PLEG): container finished" podID="aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" containerID="a9afeb719c3574d38ef26f16ada23504d2dd263d12ff63780b4d3e82ae5be0dd" exitCode=0 Jul 13 17:38:10.883029 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:10.882664 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" event={"ID":"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f","Type":"ContainerDied","Data":"a9afeb719c3574d38ef26f16ada23504d2dd263d12ff63780b4d3e82ae5be0dd"} Jul 13 17:38:10.884386 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:10.884363 2581 generic.go:356] "Generic (PLEG): container finished" podID="4e120035-5b97-4586-b18f-95254b1feda7" containerID="7b71931ebecc8c0d0fabd6e13ccc8cecd014f496f159a067ded206143a00966d" exitCode=0 Jul 13 17:38:10.884500 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:10.884426 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" event={"ID":"4e120035-5b97-4586-b18f-95254b1feda7","Type":"ContainerDied","Data":"7b71931ebecc8c0d0fabd6e13ccc8cecd014f496f159a067ded206143a00966d"} Jul 13 17:38:11.031679 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.031658 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:11.130959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.130935 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-bundle\") pod \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " Jul 13 17:38:11.131159 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.130981 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-util\") pod \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " Jul 13 17:38:11.131159 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.131024 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lplbh\" (UniqueName: \"kubernetes.io/projected/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-kube-api-access-lplbh\") pod \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\" (UID: \"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753\") " Jul 13 17:38:11.131483 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.131439 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-bundle" (OuterVolumeSpecName: "bundle") pod "dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" (UID: "dd6ada0c-5cc7-4ad6-9a33-0dc39727f753"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:38:11.133416 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.133351 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-kube-api-access-lplbh" (OuterVolumeSpecName: "kube-api-access-lplbh") pod "dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" (UID: "dd6ada0c-5cc7-4ad6-9a33-0dc39727f753"). InnerVolumeSpecName "kube-api-access-lplbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:38:11.136875 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.136852 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-util" (OuterVolumeSpecName: "util") pod "dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" (UID: "dd6ada0c-5cc7-4ad6-9a33-0dc39727f753"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:38:11.138207 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.138189 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:11.231840 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.231806 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6629f\" (UniqueName: \"kubernetes.io/projected/09d0a432-d612-4133-a87c-d1bf7211327b-kube-api-access-6629f\") pod \"09d0a432-d612-4133-a87c-d1bf7211327b\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " Jul 13 17:38:11.231993 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.231850 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-bundle\") pod \"09d0a432-d612-4133-a87c-d1bf7211327b\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " Jul 13 17:38:11.231993 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.231886 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-util\") pod \"09d0a432-d612-4133-a87c-d1bf7211327b\" (UID: \"09d0a432-d612-4133-a87c-d1bf7211327b\") " Jul 13 17:38:11.232111 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.232095 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:11.232147 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.232116 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-util\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:11.232147 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.232129 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lplbh\" (UniqueName: \"kubernetes.io/projected/dd6ada0c-5cc7-4ad6-9a33-0dc39727f753-kube-api-access-lplbh\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:11.232494 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.232451 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-bundle" (OuterVolumeSpecName: "bundle") pod "09d0a432-d612-4133-a87c-d1bf7211327b" (UID: "09d0a432-d612-4133-a87c-d1bf7211327b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:38:11.233854 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.233828 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09d0a432-d612-4133-a87c-d1bf7211327b-kube-api-access-6629f" (OuterVolumeSpecName: "kube-api-access-6629f") pod "09d0a432-d612-4133-a87c-d1bf7211327b" (UID: "09d0a432-d612-4133-a87c-d1bf7211327b"). InnerVolumeSpecName "kube-api-access-6629f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:38:11.236758 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.236739 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-util" (OuterVolumeSpecName: "util") pod "09d0a432-d612-4133-a87c-d1bf7211327b" (UID: "09d0a432-d612-4133-a87c-d1bf7211327b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:38:11.333299 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.333266 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6629f\" (UniqueName: \"kubernetes.io/projected/09d0a432-d612-4133-a87c-d1bf7211327b-kube-api-access-6629f\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:11.333299 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.333292 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:11.333299 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.333301 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d0a432-d612-4133-a87c-d1bf7211327b-util\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:11.891049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.891013 2581 generic.go:356] "Generic (PLEG): container finished" podID="aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" containerID="79c3ec05c43c67670cf23f437dd421e079a269df7b3d6eb7fa1a42d7df491361" exitCode=0 Jul 13 17:38:11.891445 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.891102 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" event={"ID":"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f","Type":"ContainerDied","Data":"79c3ec05c43c67670cf23f437dd421e079a269df7b3d6eb7fa1a42d7df491361"} Jul 13 17:38:11.892763 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.892738 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" event={"ID":"09d0a432-d612-4133-a87c-d1bf7211327b","Type":"ContainerDied","Data":"63668afe6aefae4c19bf7edf9fb0fa5a5bb74bb8b2c50f8c6000cba5f7ae4ee0"} Jul 13 17:38:11.892855 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.892780 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63668afe6aefae4c19bf7edf9fb0fa5a5bb74bb8b2c50f8c6000cba5f7ae4ee0" Jul 13 17:38:11.892855 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.892746 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74" Jul 13 17:38:11.894712 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.894688 2581 generic.go:356] "Generic (PLEG): container finished" podID="4e120035-5b97-4586-b18f-95254b1feda7" containerID="295894a17685c7128ef4e4ae3d940984777ed699679c1bd53ddfa9ee723fc579" exitCode=0 Jul 13 17:38:11.894807 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.894725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" event={"ID":"4e120035-5b97-4586-b18f-95254b1feda7","Type":"ContainerDied","Data":"295894a17685c7128ef4e4ae3d940984777ed699679c1bd53ddfa9ee723fc579"} Jul 13 17:38:11.896507 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.896489 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" event={"ID":"dd6ada0c-5cc7-4ad6-9a33-0dc39727f753","Type":"ContainerDied","Data":"263119404dc7a0ed9057c37c70b3a55ff0117a7f48a729be5f3321465681eb18"} Jul 13 17:38:11.896586 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.896520 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="263119404dc7a0ed9057c37c70b3a55ff0117a7f48a729be5f3321465681eb18" Jul 13 17:38:11.896586 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:11.896526 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl" Jul 13 17:38:13.029542 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.029518 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:13.053658 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.053636 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:13.147124 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.147098 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-bundle\") pod \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " Jul 13 17:38:13.147295 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.147156 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45mm2\" (UniqueName: \"kubernetes.io/projected/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-kube-api-access-45mm2\") pod \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " Jul 13 17:38:13.147295 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.147173 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-util\") pod \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\" (UID: \"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f\") " Jul 13 17:38:13.147295 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.147198 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxmc2\" (UniqueName: \"kubernetes.io/projected/4e120035-5b97-4586-b18f-95254b1feda7-kube-api-access-lxmc2\") pod \"4e120035-5b97-4586-b18f-95254b1feda7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " Jul 13 17:38:13.147295 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.147225 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-util\") pod \"4e120035-5b97-4586-b18f-95254b1feda7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " Jul 13 17:38:13.147295 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.147271 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-bundle\") pod \"4e120035-5b97-4586-b18f-95254b1feda7\" (UID: \"4e120035-5b97-4586-b18f-95254b1feda7\") " Jul 13 17:38:13.147834 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.147804 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-bundle" (OuterVolumeSpecName: "bundle") pod "aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" (UID: "aa4df473-1ca4-44e2-90f5-d85a1dd0f07f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:38:13.147959 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.147803 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-bundle" (OuterVolumeSpecName: "bundle") pod "4e120035-5b97-4586-b18f-95254b1feda7" (UID: "4e120035-5b97-4586-b18f-95254b1feda7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:38:13.149395 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.149357 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e120035-5b97-4586-b18f-95254b1feda7-kube-api-access-lxmc2" (OuterVolumeSpecName: "kube-api-access-lxmc2") pod "4e120035-5b97-4586-b18f-95254b1feda7" (UID: "4e120035-5b97-4586-b18f-95254b1feda7"). InnerVolumeSpecName "kube-api-access-lxmc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:38:13.149611 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.149592 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-kube-api-access-45mm2" (OuterVolumeSpecName: "kube-api-access-45mm2") pod "aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" (UID: "aa4df473-1ca4-44e2-90f5-d85a1dd0f07f"). InnerVolumeSpecName "kube-api-access-45mm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:38:13.153169 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.153126 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-util" (OuterVolumeSpecName: "util") pod "4e120035-5b97-4586-b18f-95254b1feda7" (UID: "4e120035-5b97-4586-b18f-95254b1feda7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:38:13.153479 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.153447 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-util" (OuterVolumeSpecName: "util") pod "aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" (UID: "aa4df473-1ca4-44e2-90f5-d85a1dd0f07f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:38:13.248534 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.248507 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:13.248534 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.248532 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:13.248675 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.248546 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45mm2\" (UniqueName: \"kubernetes.io/projected/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-kube-api-access-45mm2\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:13.248675 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.248559 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4df473-1ca4-44e2-90f5-d85a1dd0f07f-util\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:13.248675 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.248570 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxmc2\" (UniqueName: \"kubernetes.io/projected/4e120035-5b97-4586-b18f-95254b1feda7-kube-api-access-lxmc2\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:13.248675 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.248582 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e120035-5b97-4586-b18f-95254b1feda7-util\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:13.907555 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.907529 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" Jul 13 17:38:13.907744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.907528 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c" event={"ID":"aa4df473-1ca4-44e2-90f5-d85a1dd0f07f","Type":"ContainerDied","Data":"5fbf195695aa54b152b297538a311f3d4b9be96f40e1147aceb11d97c955b134"} Jul 13 17:38:13.907744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.907669 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fbf195695aa54b152b297538a311f3d4b9be96f40e1147aceb11d97c955b134" Jul 13 17:38:13.909267 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.909241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" event={"ID":"4e120035-5b97-4586-b18f-95254b1feda7","Type":"ContainerDied","Data":"9e645e31e0f9baf6cddc8527d4a42bb1ddd34fff1ddc840c822f0c16f614e833"} Jul 13 17:38:13.909403 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.909276 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7" Jul 13 17:38:13.909403 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:13.909282 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e645e31e0f9baf6cddc8527d4a42bb1ddd34fff1ddc840c822f0c16f614e833" Jul 13 17:38:22.668605 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668568 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62"] Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668836 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" containerName="extract" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668846 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" containerName="extract" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668856 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e120035-5b97-4586-b18f-95254b1feda7" containerName="pull" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668861 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e120035-5b97-4586-b18f-95254b1feda7" containerName="pull" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668871 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d0a432-d612-4133-a87c-d1bf7211327b" containerName="util" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668876 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d0a432-d612-4133-a87c-d1bf7211327b" containerName="util" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668885 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" containerName="util" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668891 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" containerName="util" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668897 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e120035-5b97-4586-b18f-95254b1feda7" containerName="extract" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668902 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e120035-5b97-4586-b18f-95254b1feda7" containerName="extract" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668909 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" containerName="pull" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668914 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" containerName="pull" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668921 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d0a432-d612-4133-a87c-d1bf7211327b" containerName="extract" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668926 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d0a432-d612-4133-a87c-d1bf7211327b" containerName="extract" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668932 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" containerName="extract" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668937 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" containerName="extract" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668944 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d0a432-d612-4133-a87c-d1bf7211327b" containerName="pull" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668948 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d0a432-d612-4133-a87c-d1bf7211327b" containerName="pull" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668955 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" containerName="util" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668960 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" containerName="util" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668968 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e120035-5b97-4586-b18f-95254b1feda7" containerName="util" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668972 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e120035-5b97-4586-b18f-95254b1feda7" containerName="util" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668978 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" containerName="pull" Jul 13 17:38:22.668977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.668982 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" containerName="pull" Jul 13 17:38:22.669658 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.669026 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd6ada0c-5cc7-4ad6-9a33-0dc39727f753" containerName="extract" Jul 13 17:38:22.669658 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.669034 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="09d0a432-d612-4133-a87c-d1bf7211327b" containerName="extract" Jul 13 17:38:22.669658 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.669039 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e120035-5b97-4586-b18f-95254b1feda7" containerName="extract" Jul 13 17:38:22.669658 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.669044 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa4df473-1ca4-44e2-90f5-d85a1dd0f07f" containerName="extract" Jul 13 17:38:22.672823 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.672807 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62" Jul 13 17:38:22.675671 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.675644 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qgpwv\"" Jul 13 17:38:22.676010 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.675645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 13 17:38:22.683287 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.683263 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62"] Jul 13 17:38:22.827438 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.827401 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcqc7\" (UniqueName: \"kubernetes.io/projected/fda05b06-14a2-4c43-b91c-0fe0e2b9a007-kube-api-access-pcqc7\") pod \"dns-operator-controller-manager-864dd78c4c-hnk62\" (UID: \"fda05b06-14a2-4c43-b91c-0fe0e2b9a007\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62" Jul 13 17:38:22.928580 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.928454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcqc7\" (UniqueName: \"kubernetes.io/projected/fda05b06-14a2-4c43-b91c-0fe0e2b9a007-kube-api-access-pcqc7\") pod \"dns-operator-controller-manager-864dd78c4c-hnk62\" (UID: \"fda05b06-14a2-4c43-b91c-0fe0e2b9a007\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62" Jul 13 17:38:22.938516 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.938488 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcqc7\" (UniqueName: \"kubernetes.io/projected/fda05b06-14a2-4c43-b91c-0fe0e2b9a007-kube-api-access-pcqc7\") pod \"dns-operator-controller-manager-864dd78c4c-hnk62\" (UID: \"fda05b06-14a2-4c43-b91c-0fe0e2b9a007\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62" Jul 13 17:38:22.989270 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:22.989217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62" Jul 13 17:38:23.116995 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:23.116971 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62"] Jul 13 17:38:23.118906 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:38:23.118886 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda05b06_14a2_4c43_b91c_0fe0e2b9a007.slice/crio-a4e7a09278742c2809266b31352f2d973adddaecd408ebeddcb25e155fe6df3d WatchSource:0}: Error finding container a4e7a09278742c2809266b31352f2d973adddaecd408ebeddcb25e155fe6df3d: Status 404 returned error can't find the container with id a4e7a09278742c2809266b31352f2d973adddaecd408ebeddcb25e155fe6df3d Jul 13 17:38:23.953522 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:23.953456 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62" event={"ID":"fda05b06-14a2-4c43-b91c-0fe0e2b9a007","Type":"ContainerStarted","Data":"a4e7a09278742c2809266b31352f2d973adddaecd408ebeddcb25e155fe6df3d"} Jul 13 17:38:26.970667 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:26.970625 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62" event={"ID":"fda05b06-14a2-4c43-b91c-0fe0e2b9a007","Type":"ContainerStarted","Data":"8f3f67158e319206a9ca72e66e076655c29ceca11ac6a32e95f8988134322d18"} Jul 13 17:38:26.971141 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:26.970770 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62" Jul 13 17:38:26.988527 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:26.988476 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62" podStartSLOduration=1.9890185759999999 podStartE2EDuration="4.988447624s" totalImagesPullingTime="2.999429048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:38:26.986363475 +0000 UTC m=+386.129700549" watchObservedRunningTime="2026-07-13 17:38:26.988447624 +0000 UTC m=+386.131784696" Jul 13 17:38:27.555941 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.555906 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg"] Jul 13 17:38:27.561962 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.561940 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:27.564644 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.564624 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5wrtc\"" Jul 13 17:38:27.570638 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.570614 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg"] Jul 13 17:38:27.661507 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.661450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t7w9\" (UniqueName: \"kubernetes.io/projected/913d22ed-9561-4679-a26f-8a81e7d450ba-kube-api-access-8t7w9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" (UID: \"913d22ed-9561-4679-a26f-8a81e7d450ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:27.661690 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.661558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/913d22ed-9561-4679-a26f-8a81e7d450ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" (UID: \"913d22ed-9561-4679-a26f-8a81e7d450ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:27.762185 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.762151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/913d22ed-9561-4679-a26f-8a81e7d450ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" (UID: \"913d22ed-9561-4679-a26f-8a81e7d450ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:27.762353 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.762197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t7w9\" (UniqueName: \"kubernetes.io/projected/913d22ed-9561-4679-a26f-8a81e7d450ba-kube-api-access-8t7w9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" (UID: \"913d22ed-9561-4679-a26f-8a81e7d450ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:27.762597 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.762573 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/913d22ed-9561-4679-a26f-8a81e7d450ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" (UID: \"913d22ed-9561-4679-a26f-8a81e7d450ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:27.775017 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.774998 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t7w9\" (UniqueName: \"kubernetes.io/projected/913d22ed-9561-4679-a26f-8a81e7d450ba-kube-api-access-8t7w9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" (UID: \"913d22ed-9561-4679-a26f-8a81e7d450ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:27.872726 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:27.872688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:28.030824 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:28.030680 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg"] Jul 13 17:38:28.033232 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:38:28.033205 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913d22ed_9561_4679_a26f_8a81e7d450ba.slice/crio-4a6f4573a30857c3011c70f081fc68d886ea683c272e2373589a7a955a0d75ff WatchSource:0}: Error finding container 4a6f4573a30857c3011c70f081fc68d886ea683c272e2373589a7a955a0d75ff: Status 404 returned error can't find the container with id 4a6f4573a30857c3011c70f081fc68d886ea683c272e2373589a7a955a0d75ff Jul 13 17:38:28.982417 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:28.982382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" event={"ID":"913d22ed-9561-4679-a26f-8a81e7d450ba","Type":"ContainerStarted","Data":"4a6f4573a30857c3011c70f081fc68d886ea683c272e2373589a7a955a0d75ff"} Jul 13 17:38:31.344248 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:31.344215 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs"] Jul 13 17:38:31.347935 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:31.347916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs" Jul 13 17:38:31.350305 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:31.350284 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-q6zvz\"" Jul 13 17:38:31.358767 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:31.358741 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs"] Jul 13 17:38:31.386661 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:31.386619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6bqc\" (UniqueName: \"kubernetes.io/projected/850bd3b3-e4ad-42a9-ba75-58f4e88c4b42-kube-api-access-h6bqc\") pod \"authorino-operator-75cc8d5cb7-cn7rs\" (UID: \"850bd3b3-e4ad-42a9-ba75-58f4e88c4b42\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs" Jul 13 17:38:31.487776 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:31.487737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6bqc\" (UniqueName: \"kubernetes.io/projected/850bd3b3-e4ad-42a9-ba75-58f4e88c4b42-kube-api-access-h6bqc\") pod \"authorino-operator-75cc8d5cb7-cn7rs\" (UID: \"850bd3b3-e4ad-42a9-ba75-58f4e88c4b42\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs" Jul 13 17:38:31.503489 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:31.503437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6bqc\" (UniqueName: \"kubernetes.io/projected/850bd3b3-e4ad-42a9-ba75-58f4e88c4b42-kube-api-access-h6bqc\") pod \"authorino-operator-75cc8d5cb7-cn7rs\" (UID: \"850bd3b3-e4ad-42a9-ba75-58f4e88c4b42\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs" Jul 13 17:38:31.658897 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:31.658860 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs" Jul 13 17:38:31.805306 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:31.805272 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs"] Jul 13 17:38:31.807152 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:38:31.807122 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850bd3b3_e4ad_42a9_ba75_58f4e88c4b42.slice/crio-72617e6a7b0ad5cedcec4b9f6b1adba6568bf17aae33d374628170aba7fa7f61 WatchSource:0}: Error finding container 72617e6a7b0ad5cedcec4b9f6b1adba6568bf17aae33d374628170aba7fa7f61: Status 404 returned error can't find the container with id 72617e6a7b0ad5cedcec4b9f6b1adba6568bf17aae33d374628170aba7fa7f61 Jul 13 17:38:31.999303 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:31.999206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs" event={"ID":"850bd3b3-e4ad-42a9-ba75-58f4e88c4b42","Type":"ContainerStarted","Data":"72617e6a7b0ad5cedcec4b9f6b1adba6568bf17aae33d374628170aba7fa7f61"} Jul 13 17:38:36.021909 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:36.021872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" event={"ID":"913d22ed-9561-4679-a26f-8a81e7d450ba","Type":"ContainerStarted","Data":"29bda2ce96013e43f06dac0333def774d9515cedc5f696e80dfa6e575e50de54"} Jul 13 17:38:36.022369 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:36.022031 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:36.023514 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:36.023487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs" event={"ID":"850bd3b3-e4ad-42a9-ba75-58f4e88c4b42","Type":"ContainerStarted","Data":"ba43ef2aabcc7ce474242dbc991f1b93b636f18e496bb145a87e5f02df1c9e3a"} Jul 13 17:38:36.023650 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:36.023538 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs" Jul 13 17:38:36.053548 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:36.053454 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" podStartSLOduration=1.824167399 podStartE2EDuration="9.053439519s" totalImagesPullingTime="7.22927212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:38:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:38:36.051044144 +0000 UTC m=+395.194381216" watchObservedRunningTime="2026-07-13 17:38:36.053439519 +0000 UTC m=+395.196776592" Jul 13 17:38:36.082831 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:36.082779 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs" podStartSLOduration=1.5915840220000002 podStartE2EDuration="5.082766087s" totalImagesPullingTime="3.491182065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:38:36.081387641 +0000 UTC m=+395.224724714" watchObservedRunningTime="2026-07-13 17:38:36.082766087 +0000 UTC m=+395.226103226" Jul 13 17:38:37.978937 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:37.978909 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hnk62" Jul 13 17:38:38.730376 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.730341 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6598c4f4c8-dxss5"] Jul 13 17:38:38.733945 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.733922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.750889 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.750860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/525b843f-eaea-4a5e-9725-08be0b8f962c-console-serving-cert\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.751002 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.750892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/525b843f-eaea-4a5e-9725-08be0b8f962c-console-oauth-config\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.751002 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.750907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-service-ca\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.751073 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.751005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-console-config\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.751073 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.751031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-trusted-ca-bundle\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.751073 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.751050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r5jp\" (UniqueName: \"kubernetes.io/projected/525b843f-eaea-4a5e-9725-08be0b8f962c-kube-api-access-9r5jp\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.751163 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.751119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-oauth-serving-cert\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.757138 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.757113 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6598c4f4c8-dxss5"] Jul 13 17:38:38.852221 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.852188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-console-config\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.852221 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.852222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-trusted-ca-bundle\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.852491 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.852240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r5jp\" (UniqueName: \"kubernetes.io/projected/525b843f-eaea-4a5e-9725-08be0b8f962c-kube-api-access-9r5jp\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.852491 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.852277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-oauth-serving-cert\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.852491 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.852302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/525b843f-eaea-4a5e-9725-08be0b8f962c-console-serving-cert\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.852491 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.852315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/525b843f-eaea-4a5e-9725-08be0b8f962c-console-oauth-config\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.852491 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.852328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-service-ca\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.853126 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.853095 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-console-config\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.853251 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.853156 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-service-ca\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.853251 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.853168 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-trusted-ca-bundle\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.853251 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.853216 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/525b843f-eaea-4a5e-9725-08be0b8f962c-oauth-serving-cert\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.854848 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.854819 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/525b843f-eaea-4a5e-9725-08be0b8f962c-console-serving-cert\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.854848 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.854840 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/525b843f-eaea-4a5e-9725-08be0b8f962c-console-oauth-config\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:38.867543 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:38.867521 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r5jp\" (UniqueName: \"kubernetes.io/projected/525b843f-eaea-4a5e-9725-08be0b8f962c-kube-api-access-9r5jp\") pod \"console-6598c4f4c8-dxss5\" (UID: \"525b843f-eaea-4a5e-9725-08be0b8f962c\") " pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:39.043557 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:39.043454 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:39.171999 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:39.171975 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6598c4f4c8-dxss5"] Jul 13 17:38:39.173505 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:38:39.173478 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525b843f_eaea_4a5e_9725_08be0b8f962c.slice/crio-5aa1ae8815af469876e83be8b009a67f29b378f38398f7bf446fd6bc87c90331 WatchSource:0}: Error finding container 5aa1ae8815af469876e83be8b009a67f29b378f38398f7bf446fd6bc87c90331: Status 404 returned error can't find the container with id 5aa1ae8815af469876e83be8b009a67f29b378f38398f7bf446fd6bc87c90331 Jul 13 17:38:40.045423 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:40.045380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6598c4f4c8-dxss5" event={"ID":"525b843f-eaea-4a5e-9725-08be0b8f962c","Type":"ContainerStarted","Data":"1de9c3ffbfc955ab03fd61cc80958d14c2a2fc0fb5f429b15bdd5eced5e9128d"} Jul 13 17:38:40.045797 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:40.045437 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6598c4f4c8-dxss5" event={"ID":"525b843f-eaea-4a5e-9725-08be0b8f962c","Type":"ContainerStarted","Data":"5aa1ae8815af469876e83be8b009a67f29b378f38398f7bf446fd6bc87c90331"} Jul 13 17:38:40.063532 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:40.063484 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6598c4f4c8-dxss5" podStartSLOduration=2.063453853 podStartE2EDuration="2.063453853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:38:40.061652881 +0000 UTC m=+399.204989955" watchObservedRunningTime="2026-07-13 17:38:40.063453853 +0000 UTC m=+399.206790925" Jul 13 17:38:47.031101 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:47.031071 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cn7rs" Jul 13 17:38:47.031565 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:47.031138 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:48.559744 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.559709 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l"] Jul 13 17:38:48.564540 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.564522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:48.575634 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.575609 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l"] Jul 13 17:38:48.622543 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.622518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b314ae6-bfde-4fea-9aa6-8dea7703d066-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-c979l\" (UID: \"9b314ae6-bfde-4fea-9aa6-8dea7703d066\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:48.622683 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.622580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk6gw\" (UniqueName: \"kubernetes.io/projected/9b314ae6-bfde-4fea-9aa6-8dea7703d066-kube-api-access-rk6gw\") pod \"kuadrant-operator-controller-manager-55467d9f7-c979l\" (UID: \"9b314ae6-bfde-4fea-9aa6-8dea7703d066\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:48.723417 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.723388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b314ae6-bfde-4fea-9aa6-8dea7703d066-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-c979l\" (UID: \"9b314ae6-bfde-4fea-9aa6-8dea7703d066\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:48.723621 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.723485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk6gw\" (UniqueName: \"kubernetes.io/projected/9b314ae6-bfde-4fea-9aa6-8dea7703d066-kube-api-access-rk6gw\") pod \"kuadrant-operator-controller-manager-55467d9f7-c979l\" (UID: \"9b314ae6-bfde-4fea-9aa6-8dea7703d066\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:48.723788 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.723766 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b314ae6-bfde-4fea-9aa6-8dea7703d066-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-c979l\" (UID: \"9b314ae6-bfde-4fea-9aa6-8dea7703d066\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:48.740192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.740168 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk6gw\" (UniqueName: \"kubernetes.io/projected/9b314ae6-bfde-4fea-9aa6-8dea7703d066-kube-api-access-rk6gw\") pod \"kuadrant-operator-controller-manager-55467d9f7-c979l\" (UID: \"9b314ae6-bfde-4fea-9aa6-8dea7703d066\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:48.874441 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.874412 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:48.890105 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.890080 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l"] Jul 13 17:38:48.905642 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.905611 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l"] Jul 13 17:38:48.918998 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.918969 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg"] Jul 13 17:38:48.919406 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.919183 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" containerName="manager" containerID="cri-o://29bda2ce96013e43f06dac0333def774d9515cedc5f696e80dfa6e575e50de54" gracePeriod=2 Jul 13 17:38:48.922016 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:48.921972 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:48.924168 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.924144 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg"] Jul 13 17:38:48.947747 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.947724 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp"] Jul 13 17:38:48.948029 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.948019 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" containerName="manager" Jul 13 17:38:48.948072 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.948031 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" containerName="manager" Jul 13 17:38:48.948104 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.948083 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" containerName="manager" Jul 13 17:38:48.950875 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.950858 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:38:48.953200 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:48.953174 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:48.970486 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.970444 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp"] Jul 13 17:38:48.976617 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.976595 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt"] Jul 13 17:38:48.979794 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.979774 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt" Jul 13 17:38:48.982351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.982333 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-88sms\"" Jul 13 17:38:48.994491 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:48.994308 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt"] Jul 13 17:38:48.996331 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:48.996302 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:49.026561 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.026431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc8hp\" (UniqueName: \"kubernetes.io/projected/86b549f9-ed19-4cbb-a517-2f00650720bd-kube-api-access-jc8hp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rpzrp\" (UID: \"86b549f9-ed19-4cbb-a517-2f00650720bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:38:49.026662 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.026620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdbk5\" (UniqueName: \"kubernetes.io/projected/7e3b21cf-50e4-488f-9714-becc149970db-kube-api-access-mdbk5\") pod \"limitador-operator-controller-manager-859d7b78bd-69mbt\" (UID: \"7e3b21cf-50e4-488f-9714-becc149970db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt" Jul 13 17:38:49.026726 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.026682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86b549f9-ed19-4cbb-a517-2f00650720bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rpzrp\" (UID: \"86b549f9-ed19-4cbb-a517-2f00650720bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:38:49.044085 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.044063 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:49.044158 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.044134 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:49.049806 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.049788 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:49.052575 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:49.052548 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:49.089518 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.089491 2581 generic.go:356] "Generic (PLEG): container finished" podID="913d22ed-9561-4679-a26f-8a81e7d450ba" containerID="29bda2ce96013e43f06dac0333def774d9515cedc5f696e80dfa6e575e50de54" exitCode=0 Jul 13 17:38:49.093316 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.093288 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6598c4f4c8-dxss5" Jul 13 17:38:49.096096 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:49.096072 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:49.127516 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.127439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86b549f9-ed19-4cbb-a517-2f00650720bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rpzrp\" (UID: \"86b549f9-ed19-4cbb-a517-2f00650720bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:38:49.127635 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.127595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc8hp\" (UniqueName: \"kubernetes.io/projected/86b549f9-ed19-4cbb-a517-2f00650720bd-kube-api-access-jc8hp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rpzrp\" (UID: \"86b549f9-ed19-4cbb-a517-2f00650720bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:38:49.127709 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.127690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdbk5\" (UniqueName: \"kubernetes.io/projected/7e3b21cf-50e4-488f-9714-becc149970db-kube-api-access-mdbk5\") pod \"limitador-operator-controller-manager-859d7b78bd-69mbt\" (UID: \"7e3b21cf-50e4-488f-9714-becc149970db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt" Jul 13 17:38:49.127882 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.127855 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86b549f9-ed19-4cbb-a517-2f00650720bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rpzrp\" (UID: \"86b549f9-ed19-4cbb-a517-2f00650720bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:38:49.141992 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.141968 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc8hp\" (UniqueName: \"kubernetes.io/projected/86b549f9-ed19-4cbb-a517-2f00650720bd-kube-api-access-jc8hp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rpzrp\" (UID: \"86b549f9-ed19-4cbb-a517-2f00650720bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:38:49.154425 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.154404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdbk5\" (UniqueName: \"kubernetes.io/projected/7e3b21cf-50e4-488f-9714-becc149970db-kube-api-access-mdbk5\") pod \"limitador-operator-controller-manager-859d7b78bd-69mbt\" (UID: \"7e3b21cf-50e4-488f-9714-becc149970db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt" Jul 13 17:38:49.165498 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.165449 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:49.168251 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:49.168219 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:49.181509 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.181481 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7478b88b47-5p728"] Jul 13 17:38:49.185305 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:49.185273 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lv7kg\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:49.228047 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.228013 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t7w9\" (UniqueName: \"kubernetes.io/projected/913d22ed-9561-4679-a26f-8a81e7d450ba-kube-api-access-8t7w9\") pod \"913d22ed-9561-4679-a26f-8a81e7d450ba\" (UID: \"913d22ed-9561-4679-a26f-8a81e7d450ba\") " Jul 13 17:38:49.228190 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.228057 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/913d22ed-9561-4679-a26f-8a81e7d450ba-extensions-socket-volume\") pod \"913d22ed-9561-4679-a26f-8a81e7d450ba\" (UID: \"913d22ed-9561-4679-a26f-8a81e7d450ba\") " Jul 13 17:38:49.228600 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.228575 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/913d22ed-9561-4679-a26f-8a81e7d450ba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "913d22ed-9561-4679-a26f-8a81e7d450ba" (UID: "913d22ed-9561-4679-a26f-8a81e7d450ba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:38:49.230089 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.230064 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/913d22ed-9561-4679-a26f-8a81e7d450ba-kube-api-access-8t7w9" (OuterVolumeSpecName: "kube-api-access-8t7w9") pod "913d22ed-9561-4679-a26f-8a81e7d450ba" (UID: "913d22ed-9561-4679-a26f-8a81e7d450ba"). InnerVolumeSpecName "kube-api-access-8t7w9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:38:49.277424 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.277391 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="913d22ed-9561-4679-a26f-8a81e7d450ba" path="/var/lib/kubelet/pods/913d22ed-9561-4679-a26f-8a81e7d450ba/volumes" Jul 13 17:38:49.288599 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.288579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:38:49.296385 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.296365 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt" Jul 13 17:38:49.329760 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.329723 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t7w9\" (UniqueName: \"kubernetes.io/projected/913d22ed-9561-4679-a26f-8a81e7d450ba-kube-api-access-8t7w9\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:49.329760 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.329756 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/913d22ed-9561-4679-a26f-8a81e7d450ba-extensions-socket-volume\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:49.425368 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.425322 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp"] Jul 13 17:38:49.427880 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:38:49.427854 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b549f9_ed19_4cbb_a517_2f00650720bd.slice/crio-65769999b3ab23d37c8ec849a07be1a0dc70be485422256e06edd1b8c499f79d WatchSource:0}: Error finding container 65769999b3ab23d37c8ec849a07be1a0dc70be485422256e06edd1b8c499f79d: Status 404 returned error can't find the container with id 65769999b3ab23d37c8ec849a07be1a0dc70be485422256e06edd1b8c499f79d Jul 13 17:38:49.450532 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:49.450443 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt"] Jul 13 17:38:49.452058 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:38:49.452032 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3b21cf_50e4_488f_9714_becc149970db.slice/crio-b64bcbb886ad6d8372f42ed23026886706f9edbad16b17e996ffa0550061c2c6 WatchSource:0}: Error finding container b64bcbb886ad6d8372f42ed23026886706f9edbad16b17e996ffa0550061c2c6: Status 404 returned error can't find the container with id b64bcbb886ad6d8372f42ed23026886706f9edbad16b17e996ffa0550061c2c6 Jul 13 17:38:49.946887 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:49.946761 2581 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 13 17:38:49.946887 ip-10-0-142-186 kubenswrapper[2581]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-c979l_kuadrant-system_9b314ae6-bfde-4fea-9aa6-8dea7703d066_0(162dd80f0139395e4b68b76e2afdd04bc30a7a37a9b31ff3ebe7ad85063a941f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-c979l to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"162dd80f0139395e4b68b76e2afdd04bc30a7a37a9b31ff3ebe7ad85063a941f" Netns:"/var/run/netns/fb12736b-257f-4aac-8dfd-9bf28812df22" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-c979l;K8S_POD_INFRA_CONTAINER_ID=162dd80f0139395e4b68b76e2afdd04bc30a7a37a9b31ff3ebe7ad85063a941f;K8S_POD_UID=9b314ae6-bfde-4fea-9aa6-8dea7703d066" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l/9b314ae6-bfde-4fea-9aa6-8dea7703d066:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l 162dd80f0139395e4b68b76e2afdd04bc30a7a37a9b31ff3ebe7ad85063a941f network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l 162dd80f0139395e4b68b76e2afdd04bc30a7a37a9b31ff3ebe7ad85063a941f network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-c979l" not found Jul 13 17:38:49.946887 ip-10-0-142-186 kubenswrapper[2581]: ' Jul 13 17:38:49.946887 ip-10-0-142-186 kubenswrapper[2581]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 13 17:38:49.946887 ip-10-0-142-186 kubenswrapper[2581]: > Jul 13 17:38:49.946887 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:49.946835 2581 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 13 17:38:49.946887 ip-10-0-142-186 kubenswrapper[2581]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-c979l_kuadrant-system_9b314ae6-bfde-4fea-9aa6-8dea7703d066_0(162dd80f0139395e4b68b76e2afdd04bc30a7a37a9b31ff3ebe7ad85063a941f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-c979l to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"162dd80f0139395e4b68b76e2afdd04bc30a7a37a9b31ff3ebe7ad85063a941f" Netns:"/var/run/netns/fb12736b-257f-4aac-8dfd-9bf28812df22" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-c979l;K8S_POD_INFRA_CONTAINER_ID=162dd80f0139395e4b68b76e2afdd04bc30a7a37a9b31ff3ebe7ad85063a941f;K8S_POD_UID=9b314ae6-bfde-4fea-9aa6-8dea7703d066" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l/9b314ae6-bfde-4fea-9aa6-8dea7703d066:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l 162dd80f0139395e4b68b76e2afdd04bc30a7a37a9b31ff3ebe7ad85063a941f network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l 162dd80f0139395e4b68b76e2afdd04bc30a7a37a9b31ff3ebe7ad85063a941f network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-c979l" not found Jul 13 17:38:49.946887 ip-10-0-142-186 kubenswrapper[2581]: ' Jul 13 17:38:49.946887 ip-10-0-142-186 kubenswrapper[2581]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 13 17:38:49.946887 ip-10-0-142-186 kubenswrapper[2581]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:50.098071 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.097997 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" event={"ID":"86b549f9-ed19-4cbb-a517-2f00650720bd","Type":"ContainerStarted","Data":"31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d"} Jul 13 17:38:50.098071 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.098061 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:38:50.098233 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.098087 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" event={"ID":"86b549f9-ed19-4cbb-a517-2f00650720bd","Type":"ContainerStarted","Data":"65769999b3ab23d37c8ec849a07be1a0dc70be485422256e06edd1b8c499f79d"} Jul 13 17:38:50.099866 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.099807 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt" event={"ID":"7e3b21cf-50e4-488f-9714-becc149970db","Type":"ContainerStarted","Data":"b64bcbb886ad6d8372f42ed23026886706f9edbad16b17e996ffa0550061c2c6"} Jul 13 17:38:50.101974 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.101642 2581 scope.go:117] "RemoveContainer" containerID="29bda2ce96013e43f06dac0333def774d9515cedc5f696e80dfa6e575e50de54" Jul 13 17:38:50.101974 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.101659 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lv7kg" Jul 13 17:38:50.101974 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.101642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:50.111957 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.111936 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:50.118088 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:50.118057 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-c979l\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="9b314ae6-bfde-4fea-9aa6-8dea7703d066" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:50.119176 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.118939 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" podStartSLOduration=2.118924565 podStartE2EDuration="2.118924565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:38:50.1160896 +0000 UTC m=+409.259426674" watchObservedRunningTime="2026-07-13 17:38:50.118924565 +0000 UTC m=+409.262261638" Jul 13 17:38:50.135604 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.135583 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b314ae6-bfde-4fea-9aa6-8dea7703d066-extensions-socket-volume\") pod \"9b314ae6-bfde-4fea-9aa6-8dea7703d066\" (UID: \"9b314ae6-bfde-4fea-9aa6-8dea7703d066\") " Jul 13 17:38:50.135719 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.135629 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk6gw\" (UniqueName: \"kubernetes.io/projected/9b314ae6-bfde-4fea-9aa6-8dea7703d066-kube-api-access-rk6gw\") pod \"9b314ae6-bfde-4fea-9aa6-8dea7703d066\" (UID: \"9b314ae6-bfde-4fea-9aa6-8dea7703d066\") " Jul 13 17:38:50.135892 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.135856 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b314ae6-bfde-4fea-9aa6-8dea7703d066-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b314ae6-bfde-4fea-9aa6-8dea7703d066" (UID: "9b314ae6-bfde-4fea-9aa6-8dea7703d066"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:38:50.136033 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.136014 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b314ae6-bfde-4fea-9aa6-8dea7703d066-extensions-socket-volume\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:50.138269 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.138245 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b314ae6-bfde-4fea-9aa6-8dea7703d066-kube-api-access-rk6gw" (OuterVolumeSpecName: "kube-api-access-rk6gw") pod "9b314ae6-bfde-4fea-9aa6-8dea7703d066" (UID: "9b314ae6-bfde-4fea-9aa6-8dea7703d066"). InnerVolumeSpecName "kube-api-access-rk6gw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:38:50.236665 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:50.236633 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk6gw\" (UniqueName: \"kubernetes.io/projected/9b314ae6-bfde-4fea-9aa6-8dea7703d066-kube-api-access-rk6gw\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:38:51.108156 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:51.108117 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt" event={"ID":"7e3b21cf-50e4-488f-9714-becc149970db","Type":"ContainerStarted","Data":"e6d8bd2419a06f5881a768bf449271fd8ebddadbe3b2e8419457f66ebec9404b"} Jul 13 17:38:51.108587 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:51.108210 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt" Jul 13 17:38:51.109338 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:51.109319 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:51.110254 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:51.110230 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-c979l\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="9b314ae6-bfde-4fea-9aa6-8dea7703d066" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:51.126612 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:51.126570 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt" podStartSLOduration=1.9103723609999999 podStartE2EDuration="3.126557664s" totalImagesPullingTime="1.216185303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:38:51.124882599 +0000 UTC m=+410.268219672" watchObservedRunningTime="2026-07-13 17:38:51.126557664 +0000 UTC m=+410.269894807" Jul 13 17:38:51.126976 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:51.126954 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-c979l\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="9b314ae6-bfde-4fea-9aa6-8dea7703d066" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:51.276439 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:38:51.276384 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-c979l\" is forbidden: User \"system:node:ip-10-0-142-186.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-186.ec2.internal' and this object" podUID="9b314ae6-bfde-4fea-9aa6-8dea7703d066" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-c979l" Jul 13 17:38:51.277832 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:38:51.277811 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b314ae6-bfde-4fea-9aa6-8dea7703d066" path="/var/lib/kubelet/pods/9b314ae6-bfde-4fea-9aa6-8dea7703d066/volumes" Jul 13 17:39:01.112020 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:01.111985 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:39:02.117385 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:02.117357 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69mbt" Jul 13 17:39:14.201247 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.201185 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7478b88b47-5p728" podUID="15417e8a-ff02-4439-bc1d-fd2bc32f339b" containerName="console" containerID="cri-o://e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5" gracePeriod=15 Jul 13 17:39:14.435812 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.435787 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:39:14.560266 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560183 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-service-ca\") pod \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " Jul 13 17:39:14.560266 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560235 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-oauth-config\") pod \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " Jul 13 17:39:14.560495 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560269 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldtrd\" (UniqueName: \"kubernetes.io/projected/15417e8a-ff02-4439-bc1d-fd2bc32f339b-kube-api-access-ldtrd\") pod \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " Jul 13 17:39:14.560495 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560291 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-oauth-serving-cert\") pod \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " Jul 13 17:39:14.560495 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560327 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-config\") pod \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " Jul 13 17:39:14.560495 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560387 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-trusted-ca-bundle\") pod \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " Jul 13 17:39:14.560495 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560430 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-serving-cert\") pod \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\" (UID: \"15417e8a-ff02-4439-bc1d-fd2bc32f339b\") " Jul 13 17:39:14.560833 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560799 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-service-ca" (OuterVolumeSpecName: "service-ca") pod "15417e8a-ff02-4439-bc1d-fd2bc32f339b" (UID: "15417e8a-ff02-4439-bc1d-fd2bc32f339b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:39:14.560833 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560810 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "15417e8a-ff02-4439-bc1d-fd2bc32f339b" (UID: "15417e8a-ff02-4439-bc1d-fd2bc32f339b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:39:14.560921 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560840 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-config" (OuterVolumeSpecName: "console-config") pod "15417e8a-ff02-4439-bc1d-fd2bc32f339b" (UID: "15417e8a-ff02-4439-bc1d-fd2bc32f339b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:39:14.560921 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.560866 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "15417e8a-ff02-4439-bc1d-fd2bc32f339b" (UID: "15417e8a-ff02-4439-bc1d-fd2bc32f339b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:39:14.562403 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.562383 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "15417e8a-ff02-4439-bc1d-fd2bc32f339b" (UID: "15417e8a-ff02-4439-bc1d-fd2bc32f339b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:39:14.562477 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.562421 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15417e8a-ff02-4439-bc1d-fd2bc32f339b-kube-api-access-ldtrd" (OuterVolumeSpecName: "kube-api-access-ldtrd") pod "15417e8a-ff02-4439-bc1d-fd2bc32f339b" (UID: "15417e8a-ff02-4439-bc1d-fd2bc32f339b"). InnerVolumeSpecName "kube-api-access-ldtrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:39:14.562517 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.562484 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "15417e8a-ff02-4439-bc1d-fd2bc32f339b" (UID: "15417e8a-ff02-4439-bc1d-fd2bc32f339b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 17:39:14.661533 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.661499 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-service-ca\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:39:14.661533 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.661526 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-oauth-config\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:39:14.661533 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.661536 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldtrd\" (UniqueName: \"kubernetes.io/projected/15417e8a-ff02-4439-bc1d-fd2bc32f339b-kube-api-access-ldtrd\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:39:14.661533 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.661545 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-oauth-serving-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:39:14.661791 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.661553 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-config\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:39:14.661791 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.661561 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15417e8a-ff02-4439-bc1d-fd2bc32f339b-trusted-ca-bundle\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:39:14.661791 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:14.661570 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15417e8a-ff02-4439-bc1d-fd2bc32f339b-console-serving-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:39:15.225939 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:15.225906 2581 generic.go:356] "Generic (PLEG): container finished" podID="15417e8a-ff02-4439-bc1d-fd2bc32f339b" containerID="e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5" exitCode=0 Jul 13 17:39:15.226409 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:15.225967 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7478b88b47-5p728" Jul 13 17:39:15.226409 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:15.225991 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7478b88b47-5p728" event={"ID":"15417e8a-ff02-4439-bc1d-fd2bc32f339b","Type":"ContainerDied","Data":"e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5"} Jul 13 17:39:15.226409 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:15.226038 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7478b88b47-5p728" event={"ID":"15417e8a-ff02-4439-bc1d-fd2bc32f339b","Type":"ContainerDied","Data":"21799aeb94279bb0fa714c1334dcff2f74cd426c280869ef03c9f401170875f6"} Jul 13 17:39:15.226409 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:15.226057 2581 scope.go:117] "RemoveContainer" containerID="e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5" Jul 13 17:39:15.235075 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:15.235058 2581 scope.go:117] "RemoveContainer" containerID="e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5" Jul 13 17:39:15.235319 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:39:15.235299 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5\": container with ID starting with e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5 not found: ID does not exist" containerID="e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5" Jul 13 17:39:15.235408 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:15.235324 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5"} err="failed to get container status \"e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5\": rpc error: code = NotFound desc = could not find container \"e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5\": container with ID starting with e6b54df964e5bf032e4e4e23dc8ca0b57b660a5a06c50b54436826769f6e9ed5 not found: ID does not exist" Jul 13 17:39:15.247558 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:15.247533 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7478b88b47-5p728"] Jul 13 17:39:15.254029 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:15.254005 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7478b88b47-5p728"] Jul 13 17:39:15.276947 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:15.276917 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15417e8a-ff02-4439-bc1d-fd2bc32f339b" path="/var/lib/kubelet/pods/15417e8a-ff02-4439-bc1d-fd2bc32f339b/volumes" Jul 13 17:39:21.705785 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.705753 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp"] Jul 13 17:39:21.706192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.705969 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" podUID="86b549f9-ed19-4cbb-a517-2f00650720bd" containerName="manager" containerID="cri-o://31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d" gracePeriod=10 Jul 13 17:39:21.965813 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.965727 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:39:21.978024 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.978000 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t"] Jul 13 17:39:21.978301 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.978290 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b549f9-ed19-4cbb-a517-2f00650720bd" containerName="manager" Jul 13 17:39:21.978351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.978303 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b549f9-ed19-4cbb-a517-2f00650720bd" containerName="manager" Jul 13 17:39:21.978351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.978317 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15417e8a-ff02-4439-bc1d-fd2bc32f339b" containerName="console" Jul 13 17:39:21.978351 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.978322 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="15417e8a-ff02-4439-bc1d-fd2bc32f339b" containerName="console" Jul 13 17:39:21.978449 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.978367 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="86b549f9-ed19-4cbb-a517-2f00650720bd" containerName="manager" Jul 13 17:39:21.978449 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.978376 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="15417e8a-ff02-4439-bc1d-fd2bc32f339b" containerName="console" Jul 13 17:39:21.981090 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.981075 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:39:21.994821 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:21.994788 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t"] Jul 13 17:39:22.018050 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.018019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r8ww\" (UniqueName: \"kubernetes.io/projected/feb75c14-78c2-4d27-82d8-1209569bd311-kube-api-access-2r8ww\") pod \"kuadrant-operator-controller-manager-86878c769f-zwd4t\" (UID: \"feb75c14-78c2-4d27-82d8-1209569bd311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:39:22.018181 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.018065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feb75c14-78c2-4d27-82d8-1209569bd311-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zwd4t\" (UID: \"feb75c14-78c2-4d27-82d8-1209569bd311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:39:22.118882 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.118856 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86b549f9-ed19-4cbb-a517-2f00650720bd-extensions-socket-volume\") pod \"86b549f9-ed19-4cbb-a517-2f00650720bd\" (UID: \"86b549f9-ed19-4cbb-a517-2f00650720bd\") " Jul 13 17:39:22.119024 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.118891 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc8hp\" (UniqueName: \"kubernetes.io/projected/86b549f9-ed19-4cbb-a517-2f00650720bd-kube-api-access-jc8hp\") pod \"86b549f9-ed19-4cbb-a517-2f00650720bd\" (UID: \"86b549f9-ed19-4cbb-a517-2f00650720bd\") " Jul 13 17:39:22.119064 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.119044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r8ww\" (UniqueName: \"kubernetes.io/projected/feb75c14-78c2-4d27-82d8-1209569bd311-kube-api-access-2r8ww\") pod \"kuadrant-operator-controller-manager-86878c769f-zwd4t\" (UID: \"feb75c14-78c2-4d27-82d8-1209569bd311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:39:22.119095 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.119066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feb75c14-78c2-4d27-82d8-1209569bd311-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zwd4t\" (UID: \"feb75c14-78c2-4d27-82d8-1209569bd311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:39:22.119266 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.119238 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b549f9-ed19-4cbb-a517-2f00650720bd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "86b549f9-ed19-4cbb-a517-2f00650720bd" (UID: "86b549f9-ed19-4cbb-a517-2f00650720bd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:39:22.119362 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.119347 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feb75c14-78c2-4d27-82d8-1209569bd311-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zwd4t\" (UID: \"feb75c14-78c2-4d27-82d8-1209569bd311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:39:22.120906 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.120885 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b549f9-ed19-4cbb-a517-2f00650720bd-kube-api-access-jc8hp" (OuterVolumeSpecName: "kube-api-access-jc8hp") pod "86b549f9-ed19-4cbb-a517-2f00650720bd" (UID: "86b549f9-ed19-4cbb-a517-2f00650720bd"). InnerVolumeSpecName "kube-api-access-jc8hp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:39:22.128229 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.128208 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r8ww\" (UniqueName: \"kubernetes.io/projected/feb75c14-78c2-4d27-82d8-1209569bd311-kube-api-access-2r8ww\") pod \"kuadrant-operator-controller-manager-86878c769f-zwd4t\" (UID: \"feb75c14-78c2-4d27-82d8-1209569bd311\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:39:22.219511 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.219410 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86b549f9-ed19-4cbb-a517-2f00650720bd-extensions-socket-volume\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:39:22.219511 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.219439 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc8hp\" (UniqueName: \"kubernetes.io/projected/86b549f9-ed19-4cbb-a517-2f00650720bd-kube-api-access-jc8hp\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:39:22.262699 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.262666 2581 generic.go:356] "Generic (PLEG): container finished" podID="86b549f9-ed19-4cbb-a517-2f00650720bd" containerID="31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d" exitCode=0 Jul 13 17:39:22.262861 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.262710 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" Jul 13 17:39:22.262861 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.262750 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" event={"ID":"86b549f9-ed19-4cbb-a517-2f00650720bd","Type":"ContainerDied","Data":"31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d"} Jul 13 17:39:22.262861 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.262800 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp" event={"ID":"86b549f9-ed19-4cbb-a517-2f00650720bd","Type":"ContainerDied","Data":"65769999b3ab23d37c8ec849a07be1a0dc70be485422256e06edd1b8c499f79d"} Jul 13 17:39:22.262861 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.262822 2581 scope.go:117] "RemoveContainer" containerID="31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d" Jul 13 17:39:22.271548 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.271529 2581 scope.go:117] "RemoveContainer" containerID="31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d" Jul 13 17:39:22.271795 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:39:22.271777 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d\": container with ID starting with 31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d not found: ID does not exist" containerID="31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d" Jul 13 17:39:22.271857 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.271807 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d"} err="failed to get container status \"31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d\": rpc error: code = NotFound desc = could not find container \"31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d\": container with ID starting with 31b7a7f804b8c2a0184f84f42fffdbed59643e2485f651cdb787cf4efadef04d not found: ID does not exist" Jul 13 17:39:22.285978 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.285952 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp"] Jul 13 17:39:22.291189 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.291163 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rpzrp"] Jul 13 17:39:22.291312 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.291217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:39:22.426264 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:22.426236 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t"] Jul 13 17:39:22.428190 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:39:22.428160 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb75c14_78c2_4d27_82d8_1209569bd311.slice/crio-bd67e2421e9ce2c2606a2400e533bcf4cb7de78a680a48cabba960d805bbe98f WatchSource:0}: Error finding container bd67e2421e9ce2c2606a2400e533bcf4cb7de78a680a48cabba960d805bbe98f: Status 404 returned error can't find the container with id bd67e2421e9ce2c2606a2400e533bcf4cb7de78a680a48cabba960d805bbe98f Jul 13 17:39:23.269750 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:23.269669 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" event={"ID":"feb75c14-78c2-4d27-82d8-1209569bd311","Type":"ContainerStarted","Data":"0b205b06f62650b2dfb7bd35db4a6923653f655fc40793f2b1baecabcba356b7"} Jul 13 17:39:23.269750 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:23.269721 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" event={"ID":"feb75c14-78c2-4d27-82d8-1209569bd311","Type":"ContainerStarted","Data":"bd67e2421e9ce2c2606a2400e533bcf4cb7de78a680a48cabba960d805bbe98f"} Jul 13 17:39:23.270210 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:23.269798 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:39:23.278173 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:23.278144 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86b549f9-ed19-4cbb-a517-2f00650720bd" path="/var/lib/kubelet/pods/86b549f9-ed19-4cbb-a517-2f00650720bd/volumes" Jul 13 17:39:23.291084 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:23.291042 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" podStartSLOduration=2.291027667 podStartE2EDuration="2.291027667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:39:23.288775018 +0000 UTC m=+442.432112092" watchObservedRunningTime="2026-07-13 17:39:23.291027667 +0000 UTC m=+442.434364739" Jul 13 17:39:34.276685 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:39:34.276651 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:41:30.115633 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.115597 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8"] Jul 13 17:41:30.119080 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.119062 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.122429 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.122405 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-87j4q\"" Jul 13 17:41:30.122641 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.122623 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 17:41:30.122759 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.122677 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 17:41:30.122759 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.122694 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 13 17:41:30.128597 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.128575 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8"] Jul 13 17:41:30.152790 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.152768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.152908 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.152804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.152908 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.152851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67kdc\" (UniqueName: \"kubernetes.io/projected/96da07f3-96e2-413f-9b17-68fcc71034a0-kube-api-access-67kdc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.152908 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.152882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.153027 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.152961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96da07f3-96e2-413f-9b17-68fcc71034a0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.153027 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.152996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.254521 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.254481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.254712 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.254542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.254712 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.254585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67kdc\" (UniqueName: \"kubernetes.io/projected/96da07f3-96e2-413f-9b17-68fcc71034a0-kube-api-access-67kdc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.254712 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.254607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.254712 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.254655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96da07f3-96e2-413f-9b17-68fcc71034a0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.254712 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.254672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.254993 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.254963 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.255046 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.255014 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.255046 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.255033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.256620 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.256595 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96da07f3-96e2-413f-9b17-68fcc71034a0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.256942 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.256924 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96da07f3-96e2-413f-9b17-68fcc71034a0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.263300 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.263276 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67kdc\" (UniqueName: \"kubernetes.io/projected/96da07f3-96e2-413f-9b17-68fcc71034a0-kube-api-access-67kdc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ts7q8\" (UID: \"96da07f3-96e2-413f-9b17-68fcc71034a0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.429490 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.429388 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:30.559790 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.559770 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8"] Jul 13 17:41:30.561315 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:41:30.561291 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96da07f3_96e2_413f_9b17_68fcc71034a0.slice/crio-37d36099120f92a9b5b0481f9114231ad5603f54b930dd300a1a626d86d5aa5f WatchSource:0}: Error finding container 37d36099120f92a9b5b0481f9114231ad5603f54b930dd300a1a626d86d5aa5f: Status 404 returned error can't find the container with id 37d36099120f92a9b5b0481f9114231ad5603f54b930dd300a1a626d86d5aa5f Jul 13 17:41:30.887551 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:30.887471 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" event={"ID":"96da07f3-96e2-413f-9b17-68fcc71034a0","Type":"ContainerStarted","Data":"37d36099120f92a9b5b0481f9114231ad5603f54b930dd300a1a626d86d5aa5f"} Jul 13 17:41:31.893827 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:31.893731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" event={"ID":"96da07f3-96e2-413f-9b17-68fcc71034a0","Type":"ContainerStarted","Data":"7e7db88ea0b44a22eb127d0206b067c29b3e29a550dc339319506482270be55e"} Jul 13 17:41:31.909452 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:31.909381 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" podStartSLOduration=0.847975125 podStartE2EDuration="1.909362712s" totalImagesPullingTime="1.061387587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:41:31.90913689 +0000 UTC m=+571.052473975" watchObservedRunningTime="2026-07-13 17:41:31.909362712 +0000 UTC m=+571.052699798" Jul 13 17:41:40.430218 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:40.430136 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:40.430218 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:40.430193 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:40.442278 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:40.442258 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:40.949240 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:40.949214 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ts7q8" Jul 13 17:41:48.818392 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:48.818360 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5"] Jul 13 17:41:48.825003 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:48.824985 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:48.827181 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:48.827165 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 13 17:41:48.832173 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:48.832149 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5"] Jul 13 17:41:48.908825 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:48.908786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:48.909014 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:48.908857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:48.909014 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:48.908896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa297464-e533-4eca-bcf8-339c429bfeb1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:48.909014 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:48.908928 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:48.909014 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:48.908949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjsrp\" (UniqueName: \"kubernetes.io/projected/aa297464-e533-4eca-bcf8-339c429bfeb1-kube-api-access-cjsrp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:48.909014 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:48.908968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.009372 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.009339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.009372 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.009378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjsrp\" (UniqueName: \"kubernetes.io/projected/aa297464-e533-4eca-bcf8-339c429bfeb1-kube-api-access-cjsrp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.009651 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.009398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.009651 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.009427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.009651 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.009510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.009651 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.009550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa297464-e533-4eca-bcf8-339c429bfeb1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.009824 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.009800 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.009877 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.009860 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.009920 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.009889 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.011722 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.011701 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa297464-e533-4eca-bcf8-339c429bfeb1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.011913 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.011896 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa297464-e533-4eca-bcf8-339c429bfeb1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.019128 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.019104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjsrp\" (UniqueName: \"kubernetes.io/projected/aa297464-e533-4eca-bcf8-339c429bfeb1-kube-api-access-cjsrp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-c4qw5\" (UID: \"aa297464-e533-4eca-bcf8-339c429bfeb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.136498 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.136439 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:49.267762 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.267715 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5"] Jul 13 17:41:49.270241 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:41:49.270213 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa297464_e533_4eca_bcf8_339c429bfeb1.slice/crio-dba601b740082228a4dbb039483d04ab50f8e8c46648ddaaa2f03cb36bb7fa43 WatchSource:0}: Error finding container dba601b740082228a4dbb039483d04ab50f8e8c46648ddaaa2f03cb36bb7fa43: Status 404 returned error can't find the container with id dba601b740082228a4dbb039483d04ab50f8e8c46648ddaaa2f03cb36bb7fa43 Jul 13 17:41:49.982049 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.982017 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" event={"ID":"aa297464-e533-4eca-bcf8-339c429bfeb1","Type":"ContainerStarted","Data":"1d7f7d56ac1613396cb24ea40be3896e73180eb81899a416cacfd522e2be9c61"} Jul 13 17:41:49.982389 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.982073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" event={"ID":"aa297464-e533-4eca-bcf8-339c429bfeb1","Type":"ContainerStarted","Data":"dba601b740082228a4dbb039483d04ab50f8e8c46648ddaaa2f03cb36bb7fa43"} Jul 13 17:41:49.998720 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:49.998675 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" podStartSLOduration=1.808149692 podStartE2EDuration="1.998658597s" totalImagesPullingTime="190.508905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:41:49.998147004 +0000 UTC m=+589.141484079" watchObservedRunningTime="2026-07-13 17:41:49.998658597 +0000 UTC m=+589.141995717" Jul 13 17:41:59.137559 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:59.137517 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:59.137999 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:59.137613 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:41:59.149857 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:41:59.149826 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:42:00.047637 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:42:00.047605 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-c4qw5" Jul 13 17:49:22.012583 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:22.012541 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t"] Jul 13 17:49:22.015109 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:22.012746 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" podUID="feb75c14-78c2-4d27-82d8-1209569bd311" containerName="manager" containerID="cri-o://0b205b06f62650b2dfb7bd35db4a6923653f655fc40793f2b1baecabcba356b7" gracePeriod=10 Jul 13 17:49:25.243803 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:25.243768 2581 generic.go:356] "Generic (PLEG): container finished" podID="feb75c14-78c2-4d27-82d8-1209569bd311" containerID="0b205b06f62650b2dfb7bd35db4a6923653f655fc40793f2b1baecabcba356b7" exitCode=0 Jul 13 17:49:25.244183 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:25.243816 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" event={"ID":"feb75c14-78c2-4d27-82d8-1209569bd311","Type":"ContainerDied","Data":"0b205b06f62650b2dfb7bd35db4a6923653f655fc40793f2b1baecabcba356b7"} Jul 13 17:49:25.358880 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:25.358853 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:49:25.493305 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:25.493218 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r8ww\" (UniqueName: \"kubernetes.io/projected/feb75c14-78c2-4d27-82d8-1209569bd311-kube-api-access-2r8ww\") pod \"feb75c14-78c2-4d27-82d8-1209569bd311\" (UID: \"feb75c14-78c2-4d27-82d8-1209569bd311\") " Jul 13 17:49:25.493449 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:25.493350 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feb75c14-78c2-4d27-82d8-1209569bd311-extensions-socket-volume\") pod \"feb75c14-78c2-4d27-82d8-1209569bd311\" (UID: \"feb75c14-78c2-4d27-82d8-1209569bd311\") " Jul 13 17:49:25.493756 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:25.493730 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb75c14-78c2-4d27-82d8-1209569bd311-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "feb75c14-78c2-4d27-82d8-1209569bd311" (UID: "feb75c14-78c2-4d27-82d8-1209569bd311"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:49:25.495334 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:25.495303 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb75c14-78c2-4d27-82d8-1209569bd311-kube-api-access-2r8ww" (OuterVolumeSpecName: "kube-api-access-2r8ww") pod "feb75c14-78c2-4d27-82d8-1209569bd311" (UID: "feb75c14-78c2-4d27-82d8-1209569bd311"). InnerVolumeSpecName "kube-api-access-2r8ww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:49:25.594886 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:25.594854 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feb75c14-78c2-4d27-82d8-1209569bd311-extensions-socket-volume\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:49:25.594886 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:25.594881 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r8ww\" (UniqueName: \"kubernetes.io/projected/feb75c14-78c2-4d27-82d8-1209569bd311-kube-api-access-2r8ww\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:49:26.252060 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:26.252036 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" Jul 13 17:49:26.252481 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:26.252034 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t" event={"ID":"feb75c14-78c2-4d27-82d8-1209569bd311","Type":"ContainerDied","Data":"bd67e2421e9ce2c2606a2400e533bcf4cb7de78a680a48cabba960d805bbe98f"} Jul 13 17:49:26.252481 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:26.252172 2581 scope.go:117] "RemoveContainer" containerID="0b205b06f62650b2dfb7bd35db4a6923653f655fc40793f2b1baecabcba356b7" Jul 13 17:49:26.273887 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:26.273857 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t"] Jul 13 17:49:26.277189 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:26.277165 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwd4t"] Jul 13 17:49:27.277359 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:49:27.277324 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb75c14-78c2-4d27-82d8-1209569bd311" path="/var/lib/kubelet/pods/feb75c14-78c2-4d27-82d8-1209569bd311/volumes" Jul 13 17:50:23.183754 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.183721 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48"] Jul 13 17:50:23.184196 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.184032 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb75c14-78c2-4d27-82d8-1209569bd311" containerName="manager" Jul 13 17:50:23.184196 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.184042 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb75c14-78c2-4d27-82d8-1209569bd311" containerName="manager" Jul 13 17:50:23.184196 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.184102 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb75c14-78c2-4d27-82d8-1209569bd311" containerName="manager" Jul 13 17:50:23.188188 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.188169 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" Jul 13 17:50:23.190736 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.190715 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5wrtc\"" Jul 13 17:50:23.199671 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.199645 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48"] Jul 13 17:50:23.274258 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.274226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjscf\" (UniqueName: \"kubernetes.io/projected/d20f0275-d128-4fa9-b8d3-97d35bd496f5-kube-api-access-xjscf\") pod \"kuadrant-operator-controller-manager-86878c769f-cmp48\" (UID: \"d20f0275-d128-4fa9-b8d3-97d35bd496f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" Jul 13 17:50:23.274491 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.274280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d20f0275-d128-4fa9-b8d3-97d35bd496f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cmp48\" (UID: \"d20f0275-d128-4fa9-b8d3-97d35bd496f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" Jul 13 17:50:23.374891 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.374832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d20f0275-d128-4fa9-b8d3-97d35bd496f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cmp48\" (UID: \"d20f0275-d128-4fa9-b8d3-97d35bd496f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" Jul 13 17:50:23.375119 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.374960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjscf\" (UniqueName: \"kubernetes.io/projected/d20f0275-d128-4fa9-b8d3-97d35bd496f5-kube-api-access-xjscf\") pod \"kuadrant-operator-controller-manager-86878c769f-cmp48\" (UID: \"d20f0275-d128-4fa9-b8d3-97d35bd496f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" Jul 13 17:50:23.375300 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.375276 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d20f0275-d128-4fa9-b8d3-97d35bd496f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cmp48\" (UID: \"d20f0275-d128-4fa9-b8d3-97d35bd496f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" Jul 13 17:50:23.387799 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.387765 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjscf\" (UniqueName: \"kubernetes.io/projected/d20f0275-d128-4fa9-b8d3-97d35bd496f5-kube-api-access-xjscf\") pod \"kuadrant-operator-controller-manager-86878c769f-cmp48\" (UID: \"d20f0275-d128-4fa9-b8d3-97d35bd496f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" Jul 13 17:50:23.497323 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.497232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" Jul 13 17:50:23.635442 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:23.635414 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48"] Jul 13 17:50:23.637749 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:50:23.637723 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20f0275_d128_4fa9_b8d3_97d35bd496f5.slice/crio-6092203aeb8503e7f6a89a28eb1e5e50870880c1c270a4591d26547bd9dc91a5 WatchSource:0}: Error finding container 6092203aeb8503e7f6a89a28eb1e5e50870880c1c270a4591d26547bd9dc91a5: Status 404 returned error can't find the container with id 6092203aeb8503e7f6a89a28eb1e5e50870880c1c270a4591d26547bd9dc91a5 Jul 13 17:50:24.536884 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:24.536842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" event={"ID":"d20f0275-d128-4fa9-b8d3-97d35bd496f5","Type":"ContainerStarted","Data":"3d82f06a858516e8a93d4f03dc02e406317176883d6c4bc567b4c675feeaab5a"} Jul 13 17:50:24.537318 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:24.536927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" event={"ID":"d20f0275-d128-4fa9-b8d3-97d35bd496f5","Type":"ContainerStarted","Data":"6092203aeb8503e7f6a89a28eb1e5e50870880c1c270a4591d26547bd9dc91a5"} Jul 13 17:50:24.537318 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:24.536990 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" Jul 13 17:50:24.558425 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:24.558374 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" podStartSLOduration=1.558359556 podStartE2EDuration="1.558359556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:50:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:50:24.555263861 +0000 UTC m=+1103.698600935" watchObservedRunningTime="2026-07-13 17:50:24.558359556 +0000 UTC m=+1103.701696629" Jul 13 17:50:35.544108 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:50:35.544079 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cmp48" Jul 13 17:56:58.542966 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.542930 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t"] Jul 13 17:56:58.546967 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.546948 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.549657 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.549634 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a4635dfb-openshift-default-dockercfg-pm9pb\"" Jul 13 17:56:58.565658 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.565626 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t"] Jul 13 17:56:58.600384 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.600339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlzl7\" (UniqueName: \"kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-kube-api-access-mlzl7\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.600384 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.600385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-data\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.600635 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.600498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-credential-socket\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.600635 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.600563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-podinfo\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.600635 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.600593 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-socket\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.600635 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.600608 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/620d4121-817e-43aa-8a84-1d6776d8e56f-istiod-ca-cert\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.600635 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.600632 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-envoy\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.600795 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.600668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-token\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.600795 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.600694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-certs\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.704453 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.704233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-credential-socket\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.704453 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.704327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-podinfo\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.704731 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.704510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-socket\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.704731 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.704675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/620d4121-817e-43aa-8a84-1d6776d8e56f-istiod-ca-cert\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.704854 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.704733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-envoy\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.704854 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.704779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-token\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.704854 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.704821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-certs\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.704985 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.704851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlzl7\" (UniqueName: \"kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-kube-api-access-mlzl7\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.704985 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.704885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-data\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.706490 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.706176 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-data\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.706490 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.706441 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-credential-socket\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.707795 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.706974 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-socket\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.707795 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.707497 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-certs\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.708052 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.707981 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/620d4121-817e-43aa-8a84-1d6776d8e56f-istiod-ca-cert\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.709263 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.709241 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-envoy\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.710582 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.710561 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-podinfo\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.723638 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.723602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-token\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.723758 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.723692 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlzl7\" (UniqueName: \"kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-kube-api-access-mlzl7\") pod \"e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.857667 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.857635 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:56:58.999934 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:58.999905 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t"] Jul 13 17:56:59.001117 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:56:59.001089 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620d4121_817e_43aa_8a84_1d6776d8e56f.slice/crio-7b6aa3b83a99e358d69096daf3616e32c13b02955b561707fcf44f30158f1545 WatchSource:0}: Error finding container 7b6aa3b83a99e358d69096daf3616e32c13b02955b561707fcf44f30158f1545: Status 404 returned error can't find the container with id 7b6aa3b83a99e358d69096daf3616e32c13b02955b561707fcf44f30158f1545 Jul 13 17:56:59.003224 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:59.003194 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:56:59.003311 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:59.003258 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:56:59.003311 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:59.003285 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:56:59.534361 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:59.534321 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" event={"ID":"620d4121-817e-43aa-8a84-1d6776d8e56f","Type":"ContainerStarted","Data":"82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2"} Jul 13 17:56:59.534598 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:59.534389 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" event={"ID":"620d4121-817e-43aa-8a84-1d6776d8e56f","Type":"ContainerStarted","Data":"7b6aa3b83a99e358d69096daf3616e32c13b02955b561707fcf44f30158f1545"} Jul 13 17:56:59.555681 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:59.555627 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" podStartSLOduration=1.555612159 podStartE2EDuration="1.555612159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:56:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:56:59.552974212 +0000 UTC m=+1498.696311285" watchObservedRunningTime="2026-07-13 17:56:59.555612159 +0000 UTC m=+1498.698949232" Jul 13 17:56:59.857983 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:56:59.857951 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:57:00.863708 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:00.863674 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:57:01.544348 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:01.544312 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:57:01.545438 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:01.545417 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:57:11.600088 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:11.600036 2581 generic.go:356] "Generic (PLEG): container finished" podID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerID="82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2" exitCode=0 Jul 13 17:57:11.600611 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:11.600110 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" event={"ID":"620d4121-817e-43aa-8a84-1d6776d8e56f","Type":"ContainerDied","Data":"82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2"} Jul 13 17:57:11.600611 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:11.600520 2581 scope.go:117] "RemoveContainer" containerID="82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2" Jul 13 17:57:11.601493 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:11.601449 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:57:11.601599 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:11.601533 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:57:11.601599 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:11.601564 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:57:12.607779 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:12.607742 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" event={"ID":"620d4121-817e-43aa-8a84-1d6776d8e56f","Type":"ContainerStarted","Data":"5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa"} Jul 13 17:57:12.858873 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:12.858773 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:57:12.860045 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:12.860018 2581 patch_prober.go:28] interesting pod/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 13 17:57:12.860178 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:12.860070 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 13 17:57:13.858726 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:13.858683 2581 patch_prober.go:28] interesting pod/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 13 17:57:13.859116 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:13.858746 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 13 17:57:14.858072 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:14.858032 2581 patch_prober.go:28] interesting pod/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 13 17:57:14.858453 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:14.858091 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 13 17:57:15.859007 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:15.858966 2581 patch_prober.go:28] interesting pod/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 13 17:57:15.859397 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:15.859028 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 13 17:57:16.544920 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:16.544884 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:57:16.861903 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:16.861874 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:57:16.862738 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:57:16.862718 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:58:30.166212 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.166170 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t"] Jul 13 17:58:30.166679 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.166398 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" containerID="cri-o://5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa" gracePeriod=30 Jul 13 17:58:30.811191 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.811149 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl"] Jul 13 17:58:30.814694 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.814667 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:30.817308 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.817276 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-bcf3d6aa-gw-openshift-default-dockercfg-9tnqd\"" Jul 13 17:58:30.826905 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.826876 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl"] Jul 13 17:58:30.912539 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.912497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-certs\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:30.912539 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.912546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-envoy\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:30.912865 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.912574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-666d8\" (UniqueName: \"kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-kube-api-access-666d8\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:30.912865 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.912656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-istio-token\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:30.912865 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.912685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-credential-socket\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:30.912865 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.912768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-socket\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:30.912865 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.912843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-data\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:30.913144 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.912894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16b32909-28f1-4574-a996-bdbfe26dccee-istiod-ca-cert\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:30.913144 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:30.912995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16b32909-28f1-4574-a996-bdbfe26dccee-istio-podinfo\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.013968 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.013932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-socket\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.014164 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.013977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-data\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.014164 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.014002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16b32909-28f1-4574-a996-bdbfe26dccee-istiod-ca-cert\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.014164 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.014028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16b32909-28f1-4574-a996-bdbfe26dccee-istio-podinfo\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.014442 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.014420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-certs\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.014546 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.014485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-envoy\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.014546 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.014513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-666d8\" (UniqueName: \"kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-kube-api-access-666d8\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.014753 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.014726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-istio-token\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.014933 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.014917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-credential-socket\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.015061 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.014923 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-socket\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.015157 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.015131 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16b32909-28f1-4574-a996-bdbfe26dccee-istiod-ca-cert\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.015310 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.015111 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-certs\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.015424 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.014868 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-data\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.015521 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.015358 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-credential-socket\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.017186 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.017160 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16b32909-28f1-4574-a996-bdbfe26dccee-istio-podinfo\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.017401 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.017382 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-envoy\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.023400 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.023378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-istio-token\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.023516 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.023482 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-666d8\" (UniqueName: \"kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-kube-api-access-666d8\") pod \"e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.127573 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.127528 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:31.270513 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.270479 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl"] Jul 13 17:58:31.273261 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:58:31.273221 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b32909_28f1_4574_a996_bdbfe26dccee.slice/crio-157ef05ad5630cbd97500868753717e24c4aab84ad950324dda8e5253264656b WatchSource:0}: Error finding container 157ef05ad5630cbd97500868753717e24c4aab84ad950324dda8e5253264656b: Status 404 returned error can't find the container with id 157ef05ad5630cbd97500868753717e24c4aab84ad950324dda8e5253264656b Jul 13 17:58:31.275550 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.275512 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:58:31.275636 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.275598 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:58:31.275677 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.275637 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:58:31.864189 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.864152 2581 patch_prober.go:28] interesting pod/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 17:58:31.864396 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:31.864210 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 17:58:32.022947 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:32.022912 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" event={"ID":"16b32909-28f1-4574-a996-bdbfe26dccee","Type":"ContainerStarted","Data":"4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c"} Jul 13 17:58:32.023149 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:32.022967 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" event={"ID":"16b32909-28f1-4574-a996-bdbfe26dccee","Type":"ContainerStarted","Data":"157ef05ad5630cbd97500868753717e24c4aab84ad950324dda8e5253264656b"} Jul 13 17:58:32.046927 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:32.046861 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" podStartSLOduration=2.046840947 podStartE2EDuration="2.046840947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:58:32.045439117 +0000 UTC m=+1591.188776188" watchObservedRunningTime="2026-07-13 17:58:32.046840947 +0000 UTC m=+1591.190178024" Jul 13 17:58:32.128444 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:32.128317 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:32.133773 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:32.133747 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:33.029215 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:33.029174 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:33.030148 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:33.030126 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:35.430714 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.430636 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:58:35.457007 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.456978 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlzl7\" (UniqueName: \"kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-kube-api-access-mlzl7\") pod \"620d4121-817e-43aa-8a84-1d6776d8e56f\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " Jul 13 17:58:35.457197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.457019 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-socket\") pod \"620d4121-817e-43aa-8a84-1d6776d8e56f\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " Jul 13 17:58:35.457197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.457056 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/620d4121-817e-43aa-8a84-1d6776d8e56f-istiod-ca-cert\") pod \"620d4121-817e-43aa-8a84-1d6776d8e56f\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " Jul 13 17:58:35.457197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.457096 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-certs\") pod \"620d4121-817e-43aa-8a84-1d6776d8e56f\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " Jul 13 17:58:35.457197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.457129 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-envoy\") pod \"620d4121-817e-43aa-8a84-1d6776d8e56f\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " Jul 13 17:58:35.457197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.457150 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-token\") pod \"620d4121-817e-43aa-8a84-1d6776d8e56f\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " Jul 13 17:58:35.457197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.457189 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-data\") pod \"620d4121-817e-43aa-8a84-1d6776d8e56f\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " Jul 13 17:58:35.457531 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.457211 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-credential-socket\") pod \"620d4121-817e-43aa-8a84-1d6776d8e56f\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " Jul 13 17:58:35.457531 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.457236 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-podinfo\") pod \"620d4121-817e-43aa-8a84-1d6776d8e56f\" (UID: \"620d4121-817e-43aa-8a84-1d6776d8e56f\") " Jul 13 17:58:35.457531 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.457315 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "620d4121-817e-43aa-8a84-1d6776d8e56f" (UID: "620d4121-817e-43aa-8a84-1d6776d8e56f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:58:35.457705 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.457548 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:58:35.458121 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.458075 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/620d4121-817e-43aa-8a84-1d6776d8e56f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "620d4121-817e-43aa-8a84-1d6776d8e56f" (UID: "620d4121-817e-43aa-8a84-1d6776d8e56f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:58:35.458342 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.458212 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "620d4121-817e-43aa-8a84-1d6776d8e56f" (UID: "620d4121-817e-43aa-8a84-1d6776d8e56f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:58:35.458342 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.458267 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "620d4121-817e-43aa-8a84-1d6776d8e56f" (UID: "620d4121-817e-43aa-8a84-1d6776d8e56f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:58:35.458342 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.458279 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-data" (OuterVolumeSpecName: "istio-data") pod "620d4121-817e-43aa-8a84-1d6776d8e56f" (UID: "620d4121-817e-43aa-8a84-1d6776d8e56f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:58:35.459699 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.459671 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-kube-api-access-mlzl7" (OuterVolumeSpecName: "kube-api-access-mlzl7") pod "620d4121-817e-43aa-8a84-1d6776d8e56f" (UID: "620d4121-817e-43aa-8a84-1d6776d8e56f"). InnerVolumeSpecName "kube-api-access-mlzl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:58:35.461593 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.460073 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "620d4121-817e-43aa-8a84-1d6776d8e56f" (UID: "620d4121-817e-43aa-8a84-1d6776d8e56f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 17:58:35.461593 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.460578 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "620d4121-817e-43aa-8a84-1d6776d8e56f" (UID: "620d4121-817e-43aa-8a84-1d6776d8e56f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:58:35.461593 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.461522 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-token" (OuterVolumeSpecName: "istio-token") pod "620d4121-817e-43aa-8a84-1d6776d8e56f" (UID: "620d4121-817e-43aa-8a84-1d6776d8e56f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:58:35.558927 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.558886 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/620d4121-817e-43aa-8a84-1d6776d8e56f-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:58:35.558927 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.558919 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:58:35.558927 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.558928 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:58:35.558927 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.558936 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:58:35.559198 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.558943 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:58:35.559198 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.558951 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/620d4121-817e-43aa-8a84-1d6776d8e56f-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:58:35.559198 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.558960 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/620d4121-817e-43aa-8a84-1d6776d8e56f-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:58:35.559198 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:35.558969 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlzl7\" (UniqueName: \"kubernetes.io/projected/620d4121-817e-43aa-8a84-1d6776d8e56f-kube-api-access-mlzl7\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:58:36.044751 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.044708 2581 generic.go:356] "Generic (PLEG): container finished" podID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerID="5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa" exitCode=0 Jul 13 17:58:36.044923 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.044759 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" Jul 13 17:58:36.044923 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.044808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" event={"ID":"620d4121-817e-43aa-8a84-1d6776d8e56f","Type":"ContainerDied","Data":"5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa"} Jul 13 17:58:36.044923 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.044863 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t" event={"ID":"620d4121-817e-43aa-8a84-1d6776d8e56f","Type":"ContainerDied","Data":"7b6aa3b83a99e358d69096daf3616e32c13b02955b561707fcf44f30158f1545"} Jul 13 17:58:36.044923 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.044889 2581 scope.go:117] "RemoveContainer" containerID="5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa" Jul 13 17:58:36.054989 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.054969 2581 scope.go:117] "RemoveContainer" containerID="82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2" Jul 13 17:58:36.065989 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.065916 2581 scope.go:117] "RemoveContainer" containerID="5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa" Jul 13 17:58:36.066570 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:58:36.066545 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa\": container with ID starting with 5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa not found: ID does not exist" containerID="5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa" Jul 13 17:58:36.066671 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.066577 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa"} err="failed to get container status \"5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa\": rpc error: code = NotFound desc = could not find container \"5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa\": container with ID starting with 5de0c7b4b3c307d14e4263f1359cd327ccb2fe35bc7f9cc6c604d96bf560fdfa not found: ID does not exist" Jul 13 17:58:36.066671 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.066597 2581 scope.go:117] "RemoveContainer" containerID="82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2" Jul 13 17:58:36.066887 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:58:36.066864 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2\": container with ID starting with 82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2 not found: ID does not exist" containerID="82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2" Jul 13 17:58:36.066943 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.066898 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2"} err="failed to get container status \"82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2\": rpc error: code = NotFound desc = could not find container \"82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2\": container with ID starting with 82d2636488434460a3b6a1273380b4c1107c641834a1d2da9635e5c0d94b37b2 not found: ID does not exist" Jul 13 17:58:36.071840 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.071814 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t"] Jul 13 17:58:36.073986 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:36.073964 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a4635dfb-openshift-default-7f75847f65-7227t"] Jul 13 17:58:37.278144 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:37.278110 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" path="/var/lib/kubelet/pods/620d4121-817e-43aa-8a84-1d6776d8e56f/volumes" Jul 13 17:58:44.090376 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:44.090291 2581 generic.go:356] "Generic (PLEG): container finished" podID="16b32909-28f1-4574-a996-bdbfe26dccee" containerID="4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c" exitCode=0 Jul 13 17:58:44.090376 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:44.090362 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" event={"ID":"16b32909-28f1-4574-a996-bdbfe26dccee","Type":"ContainerDied","Data":"4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c"} Jul 13 17:58:44.090843 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:44.090750 2581 scope.go:117] "RemoveContainer" containerID="4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c" Jul 13 17:58:44.091702 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:44.091679 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:58:44.091763 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:44.091746 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:58:44.091795 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:44.091778 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:58:45.097366 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:45.097330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" event={"ID":"16b32909-28f1-4574-a996-bdbfe26dccee","Type":"ContainerStarted","Data":"1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16"} Jul 13 17:58:45.129429 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:45.129402 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:45.131089 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:45.131054 2581 patch_prober.go:28] interesting pod/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 13 17:58:45.131339 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:45.131296 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 13 17:58:46.128715 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:46.128663 2581 patch_prober.go:28] interesting pod/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 13 17:58:46.129228 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:46.128738 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 13 17:58:47.129080 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:47.129036 2581 patch_prober.go:28] interesting pod/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 13 17:58:47.129621 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:47.129113 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 13 17:58:48.029585 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:48.029526 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:48.128822 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:48.128770 2581 patch_prober.go:28] interesting pod/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 13 17:58:48.129043 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:48.128846 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 13 17:58:49.132930 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:49.132899 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:58:49.133943 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:58:49.133923 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:59:36.771748 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:36.771708 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl"] Jul 13 17:59:36.772341 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:36.772019 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" containerID="cri-o://1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16" gracePeriod=30 Jul 13 17:59:42.032867 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.032799 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:59:42.154735 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.154704 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-certs\") pod \"16b32909-28f1-4574-a996-bdbfe26dccee\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " Jul 13 17:59:42.154895 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.154755 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16b32909-28f1-4574-a996-bdbfe26dccee-istiod-ca-cert\") pod \"16b32909-28f1-4574-a996-bdbfe26dccee\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " Jul 13 17:59:42.154895 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.154879 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16b32909-28f1-4574-a996-bdbfe26dccee-istio-podinfo\") pod \"16b32909-28f1-4574-a996-bdbfe26dccee\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " Jul 13 17:59:42.155000 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.154917 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-credential-socket\") pod \"16b32909-28f1-4574-a996-bdbfe26dccee\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " Jul 13 17:59:42.155000 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.154941 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-data\") pod \"16b32909-28f1-4574-a996-bdbfe26dccee\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " Jul 13 17:59:42.155000 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.154961 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16b32909-28f1-4574-a996-bdbfe26dccee" (UID: "16b32909-28f1-4574-a996-bdbfe26dccee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:59:42.155000 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.154968 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-socket\") pod \"16b32909-28f1-4574-a996-bdbfe26dccee\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " Jul 13 17:59:42.155197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.155049 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-666d8\" (UniqueName: \"kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-kube-api-access-666d8\") pod \"16b32909-28f1-4574-a996-bdbfe26dccee\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " Jul 13 17:59:42.155197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.155087 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-envoy\") pod \"16b32909-28f1-4574-a996-bdbfe26dccee\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " Jul 13 17:59:42.155197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.155085 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16b32909-28f1-4574-a996-bdbfe26dccee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16b32909-28f1-4574-a996-bdbfe26dccee" (UID: "16b32909-28f1-4574-a996-bdbfe26dccee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 17:59:42.155197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.155149 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-istio-token\") pod \"16b32909-28f1-4574-a996-bdbfe26dccee\" (UID: \"16b32909-28f1-4574-a996-bdbfe26dccee\") " Jul 13 17:59:42.155197 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.155192 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16b32909-28f1-4574-a996-bdbfe26dccee" (UID: "16b32909-28f1-4574-a996-bdbfe26dccee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:59:42.155474 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.155206 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16b32909-28f1-4574-a996-bdbfe26dccee" (UID: "16b32909-28f1-4574-a996-bdbfe26dccee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:59:42.155538 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.155517 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:59:42.155594 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.155537 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16b32909-28f1-4574-a996-bdbfe26dccee-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:59:42.155594 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.155553 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:59:42.155594 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.155566 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:59:42.156150 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.156122 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-data" (OuterVolumeSpecName: "istio-data") pod "16b32909-28f1-4574-a996-bdbfe26dccee" (UID: "16b32909-28f1-4574-a996-bdbfe26dccee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:59:42.157080 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.157051 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16b32909-28f1-4574-a996-bdbfe26dccee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16b32909-28f1-4574-a996-bdbfe26dccee" (UID: "16b32909-28f1-4574-a996-bdbfe26dccee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 17:59:42.157299 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.157277 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16b32909-28f1-4574-a996-bdbfe26dccee" (UID: "16b32909-28f1-4574-a996-bdbfe26dccee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 17:59:42.157379 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.157305 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-istio-token" (OuterVolumeSpecName: "istio-token") pod "16b32909-28f1-4574-a996-bdbfe26dccee" (UID: "16b32909-28f1-4574-a996-bdbfe26dccee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:59:42.157533 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.157499 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-kube-api-access-666d8" (OuterVolumeSpecName: "kube-api-access-666d8") pod "16b32909-28f1-4574-a996-bdbfe26dccee" (UID: "16b32909-28f1-4574-a996-bdbfe26dccee"). InnerVolumeSpecName "kube-api-access-666d8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 17:59:42.262687 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.262650 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-666d8\" (UniqueName: \"kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-kube-api-access-666d8\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:59:42.262687 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.262682 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:59:42.262687 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.262692 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16b32909-28f1-4574-a996-bdbfe26dccee-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:59:42.262687 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.262699 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16b32909-28f1-4574-a996-bdbfe26dccee-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:59:42.262956 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.262706 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16b32909-28f1-4574-a996-bdbfe26dccee-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 17:59:42.386870 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.386838 2581 generic.go:356] "Generic (PLEG): container finished" podID="16b32909-28f1-4574-a996-bdbfe26dccee" containerID="1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16" exitCode=0 Jul 13 17:59:42.387046 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.386889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" event={"ID":"16b32909-28f1-4574-a996-bdbfe26dccee","Type":"ContainerDied","Data":"1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16"} Jul 13 17:59:42.387046 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.386915 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" Jul 13 17:59:42.387046 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.386931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl" event={"ID":"16b32909-28f1-4574-a996-bdbfe26dccee","Type":"ContainerDied","Data":"157ef05ad5630cbd97500868753717e24c4aab84ad950324dda8e5253264656b"} Jul 13 17:59:42.387046 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.386951 2581 scope.go:117] "RemoveContainer" containerID="1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16" Jul 13 17:59:42.398830 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.398799 2581 scope.go:117] "RemoveContainer" containerID="4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c" Jul 13 17:59:42.407324 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.407301 2581 scope.go:117] "RemoveContainer" containerID="1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16" Jul 13 17:59:42.407683 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:59:42.407660 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16\": container with ID starting with 1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16 not found: ID does not exist" containerID="1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16" Jul 13 17:59:42.407783 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.407694 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16"} err="failed to get container status \"1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16\": rpc error: code = NotFound desc = could not find container \"1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16\": container with ID starting with 1df3c5f4a5c6628c4ae201ad91a0d2aad70cd8877a8e8d915b30bc742fc6cf16 not found: ID does not exist" Jul 13 17:59:42.407783 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.407716 2581 scope.go:117] "RemoveContainer" containerID="4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c" Jul 13 17:59:42.408020 ip-10-0-142-186 kubenswrapper[2581]: E0713 17:59:42.407997 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c\": container with ID starting with 4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c not found: ID does not exist" containerID="4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c" Jul 13 17:59:42.408088 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.408031 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c"} err="failed to get container status \"4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c\": rpc error: code = NotFound desc = could not find container \"4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c\": container with ID starting with 4910807a85b9b48eef7fac9bdd2e94a3efbc3bfb3adedcc466ca6b68fe4f865c not found: ID does not exist" Jul 13 17:59:42.410673 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.410652 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl"] Jul 13 17:59:42.414672 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:42.414651 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-bcf3d6aa-gw-openshift-default-66957c759-j79bl"] Jul 13 17:59:43.204634 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.204593 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm"] Jul 13 17:59:43.205054 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.204988 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" Jul 13 17:59:43.205054 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.205001 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" Jul 13 17:59:43.205054 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.205010 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" Jul 13 17:59:43.205054 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.205017 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" Jul 13 17:59:43.205054 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.205026 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" Jul 13 17:59:43.205054 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.205031 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" Jul 13 17:59:43.205276 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.205084 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" Jul 13 17:59:43.205276 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.205093 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" Jul 13 17:59:43.209674 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.209652 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.212235 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.212216 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ee0971b4-openshift-default-dockercfg-44tj4\"" Jul 13 17:59:43.218986 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.218959 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm"] Jul 13 17:59:43.279115 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.279079 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" path="/var/lib/kubelet/pods/16b32909-28f1-4574-a996-bdbfe26dccee/volumes" Jul 13 17:59:43.373104 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.373063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-credential-socket\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.373282 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.373118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-certs\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.373282 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.373150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-data\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.373282 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.373177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istiod-ca-cert\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.373282 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.373210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-envoy\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.373282 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.373235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ps5c\" (UniqueName: \"kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-kube-api-access-4ps5c\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.373449 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.373319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-socket\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.373449 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.373344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-podinfo\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.373449 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.373383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-token\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.474871 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.474784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-token\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.474871 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.474842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-credential-socket\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.474871 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.474866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-certs\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.475139 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.474884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-data\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.475139 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.474900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istiod-ca-cert\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.475139 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.474917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-envoy\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.475139 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.474931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ps5c\" (UniqueName: \"kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-kube-api-access-4ps5c\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.475139 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.474979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-socket\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.475139 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.475004 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-podinfo\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.475502 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.475455 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-certs\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.475596 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.475544 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-socket\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.475596 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.475562 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-data\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.475711 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.475645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-credential-socket\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.476004 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.475980 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istiod-ca-cert\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.477473 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.477437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-envoy\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.477809 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.477787 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-podinfo\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.483192 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.483164 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-token\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.483311 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.483199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ps5c\" (UniqueName: \"kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-kube-api-access-4ps5c\") pod \"e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.522995 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.522940 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:43.667101 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.667072 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm"] Jul 13 17:59:43.669097 ip-10-0-142-186 kubenswrapper[2581]: W0713 17:59:43.669068 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c33bfdd_4308_48f3_8b26_2e52b4caa65e.slice/crio-95f25520cbb4707415f8a6828e430af0416553020c7d4f466862a9db9f7e81da WatchSource:0}: Error finding container 95f25520cbb4707415f8a6828e430af0416553020c7d4f466862a9db9f7e81da: Status 404 returned error can't find the container with id 95f25520cbb4707415f8a6828e430af0416553020c7d4f466862a9db9f7e81da Jul 13 17:59:43.671290 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.671257 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:59:43.671388 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.671337 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:59:43.671388 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:43.671378 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:59:44.401505 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:44.401436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" event={"ID":"0c33bfdd-4308-48f3-8b26-2e52b4caa65e","Type":"ContainerStarted","Data":"7808ed45be5843afc870d8a28e764d05d4061610aea6ef866e97cd0479559475"} Jul 13 17:59:44.402185 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:44.402162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" event={"ID":"0c33bfdd-4308-48f3-8b26-2e52b4caa65e","Type":"ContainerStarted","Data":"95f25520cbb4707415f8a6828e430af0416553020c7d4f466862a9db9f7e81da"} Jul 13 17:59:44.434224 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:44.434172 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" podStartSLOduration=1.434156297 podStartE2EDuration="1.434156297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:59:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:59:44.432065126 +0000 UTC m=+1663.575402201" watchObservedRunningTime="2026-07-13 17:59:44.434156297 +0000 UTC m=+1663.577493369" Jul 13 17:59:44.523977 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:44.523943 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:44.530142 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:44.530117 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:45.407626 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:45.407597 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:45.408718 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:45.408697 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:56.473823 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:56.473788 2581 generic.go:356] "Generic (PLEG): container finished" podID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerID="7808ed45be5843afc870d8a28e764d05d4061610aea6ef866e97cd0479559475" exitCode=0 Jul 13 17:59:56.474244 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:56.473839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" event={"ID":"0c33bfdd-4308-48f3-8b26-2e52b4caa65e","Type":"ContainerDied","Data":"7808ed45be5843afc870d8a28e764d05d4061610aea6ef866e97cd0479559475"} Jul 13 17:59:56.474244 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:56.474159 2581 scope.go:117] "RemoveContainer" containerID="7808ed45be5843afc870d8a28e764d05d4061610aea6ef866e97cd0479559475" Jul 13 17:59:56.475112 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:56.475086 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:59:56.475174 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:56.475160 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:59:56.475210 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:56.475190 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 17:59:57.480577 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:57.480543 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" event={"ID":"0c33bfdd-4308-48f3-8b26-2e52b4caa65e","Type":"ContainerStarted","Data":"4dfe9d24e575b227d4d56fa2c766459e42706910ec2d953c5b674bf8eed088bb"} Jul 13 17:59:57.523053 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:57.523020 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 17:59:57.524179 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:57.524155 2581 patch_prober.go:28] interesting pod/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 13 17:59:57.524244 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:57.524210 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 13 17:59:58.523822 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:58.523787 2581 patch_prober.go:28] interesting pod/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 13 17:59:58.524303 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:58.523843 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 13 17:59:59.523706 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:59.523672 2581 patch_prober.go:28] interesting pod/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 13 17:59:59.523890 ip-10-0-142-186 kubenswrapper[2581]: I0713 17:59:59.523727 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 13 18:00:00.408055 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:00:00.408021 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 18:00:00.523338 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:00:00.523304 2581 patch_prober.go:28] interesting pod/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 13 18:00:00.523532 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:00:00.523359 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 13 18:00:01.527913 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:00:01.527887 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 18:00:01.529047 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:00:01.529026 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 18:01:15.712122 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:15.712077 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm"] Jul 13 18:01:15.712730 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:15.712337 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" containerID="cri-o://4dfe9d24e575b227d4d56fa2c766459e42706910ec2d953c5b674bf8eed088bb" gracePeriod=30 Jul 13 18:01:16.017225 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.017137 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5"] Jul 13 18:01:16.017692 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.017657 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" Jul 13 18:01:16.017787 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.017696 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" Jul 13 18:01:16.017845 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.017807 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="16b32909-28f1-4574-a996-bdbfe26dccee" containerName="istio-proxy" Jul 13 18:01:16.017845 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.017822 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="620d4121-817e-43aa-8a84-1d6776d8e56f" containerName="istio-proxy" Jul 13 18:01:16.020861 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.020827 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.023596 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.023572 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-338f4926-openshift-default-dockercfg-4pfpk\"" Jul 13 18:01:16.032804 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.032765 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5"] Jul 13 18:01:16.127647 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.127607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-socket\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.127647 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.127643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-podinfo\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.127899 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.127665 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istiod-ca-cert\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.127899 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.127765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-data\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.127899 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.127789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfblj\" (UniqueName: \"kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-kube-api-access-gfblj\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.127899 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.127824 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-envoy\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.127899 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.127847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-certs\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.127899 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.127868 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-credential-socket\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.127899 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.127884 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-token\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.228937 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.228895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-socket\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.228937 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.228938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-podinfo\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.229204 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.228956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istiod-ca-cert\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.229204 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.229027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-data\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.229204 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.229059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfblj\" (UniqueName: \"kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-kube-api-access-gfblj\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.229204 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.229142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-envoy\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.229204 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.229195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-certs\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.229502 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.229224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-credential-socket\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.229502 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.229251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-token\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.229502 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.229368 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-socket\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.229963 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.229940 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istiod-ca-cert\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.230129 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.230107 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-credential-socket\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.230209 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.230148 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-data\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.230250 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.230229 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-certs\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.231554 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.231522 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-envoy\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.231914 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.231894 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-podinfo\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.237598 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.237571 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-token\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.237707 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.237658 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfblj\" (UniqueName: \"kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-kube-api-access-gfblj\") pod \"e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.335054 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.334957 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:16.474930 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.474900 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5"] Jul 13 18:01:16.476822 ip-10-0-142-186 kubenswrapper[2581]: W0713 18:01:16.476792 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c0569a_d8be_4efe_84d2_ad6efb3693ed.slice/crio-7f9b6dac276a7e9b893f4ec3857def762dec64aaa78ad76f33d36fa95f13839a WatchSource:0}: Error finding container 7f9b6dac276a7e9b893f4ec3857def762dec64aaa78ad76f33d36fa95f13839a: Status 404 returned error can't find the container with id 7f9b6dac276a7e9b893f4ec3857def762dec64aaa78ad76f33d36fa95f13839a Jul 13 18:01:16.478895 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.478865 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:01:16.478973 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.478928 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:01:16.478973 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.478958 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:01:16.530924 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.530896 2581 patch_prober.go:28] interesting pod/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 18:01:16.531047 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.530948 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 18:01:16.879715 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.879677 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" event={"ID":"77c0569a-d8be-4efe-84d2-ad6efb3693ed","Type":"ContainerStarted","Data":"27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2"} Jul 13 18:01:16.880081 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.879733 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" event={"ID":"77c0569a-d8be-4efe-84d2-ad6efb3693ed","Type":"ContainerStarted","Data":"7f9b6dac276a7e9b893f4ec3857def762dec64aaa78ad76f33d36fa95f13839a"} Jul 13 18:01:16.900293 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:16.900235 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" podStartSLOduration=1.900217882 podStartE2EDuration="1.900217882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:16.899302652 +0000 UTC m=+1756.042639727" watchObservedRunningTime="2026-07-13 18:01:16.900217882 +0000 UTC m=+1756.043555015" Jul 13 18:01:17.335440 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:17.335355 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:17.340406 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:17.340364 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:17.885502 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:17.885449 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:17.886548 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:17.886525 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:20.904977 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.904943 2581 generic.go:356] "Generic (PLEG): container finished" podID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerID="4dfe9d24e575b227d4d56fa2c766459e42706910ec2d953c5b674bf8eed088bb" exitCode=0 Jul 13 18:01:20.905355 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.905016 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" event={"ID":"0c33bfdd-4308-48f3-8b26-2e52b4caa65e","Type":"ContainerDied","Data":"4dfe9d24e575b227d4d56fa2c766459e42706910ec2d953c5b674bf8eed088bb"} Jul 13 18:01:20.905355 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.905096 2581 scope.go:117] "RemoveContainer" containerID="7808ed45be5843afc870d8a28e764d05d4061610aea6ef866e97cd0479559475" Jul 13 18:01:20.961837 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.961814 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 18:01:20.970284 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970262 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istiod-ca-cert\") pod \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " Jul 13 18:01:20.970419 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970293 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-certs\") pod \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " Jul 13 18:01:20.970419 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970310 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-envoy\") pod \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " Jul 13 18:01:20.970419 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970327 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-socket\") pod \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " Jul 13 18:01:20.970419 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970365 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-podinfo\") pod \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " Jul 13 18:01:20.970419 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970399 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-data\") pod \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " Jul 13 18:01:20.970419 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970419 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-token\") pod \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " Jul 13 18:01:20.970749 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970487 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ps5c\" (UniqueName: \"kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-kube-api-access-4ps5c\") pod \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " Jul 13 18:01:20.970749 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970543 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c33bfdd-4308-48f3-8b26-2e52b4caa65e" (UID: "0c33bfdd-4308-48f3-8b26-2e52b4caa65e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:01:20.970749 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970712 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c33bfdd-4308-48f3-8b26-2e52b4caa65e" (UID: "0c33bfdd-4308-48f3-8b26-2e52b4caa65e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:01:20.970749 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970720 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c33bfdd-4308-48f3-8b26-2e52b4caa65e" (UID: "0c33bfdd-4308-48f3-8b26-2e52b4caa65e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:01:20.970952 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.970780 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:01:20.971478 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.971401 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c33bfdd-4308-48f3-8b26-2e52b4caa65e" (UID: "0c33bfdd-4308-48f3-8b26-2e52b4caa65e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:01:20.972404 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.972364 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c33bfdd-4308-48f3-8b26-2e52b4caa65e" (UID: "0c33bfdd-4308-48f3-8b26-2e52b4caa65e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:01:20.972641 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.972622 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c33bfdd-4308-48f3-8b26-2e52b4caa65e" (UID: "0c33bfdd-4308-48f3-8b26-2e52b4caa65e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:01:20.972918 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.972895 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c33bfdd-4308-48f3-8b26-2e52b4caa65e" (UID: "0c33bfdd-4308-48f3-8b26-2e52b4caa65e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 18:01:20.972918 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:20.972908 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-kube-api-access-4ps5c" (OuterVolumeSpecName: "kube-api-access-4ps5c") pod "0c33bfdd-4308-48f3-8b26-2e52b4caa65e" (UID: "0c33bfdd-4308-48f3-8b26-2e52b4caa65e"). InnerVolumeSpecName "kube-api-access-4ps5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:01:21.071915 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.071880 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-credential-socket\") pod \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\" (UID: \"0c33bfdd-4308-48f3-8b26-2e52b4caa65e\") " Jul 13 18:01:21.072128 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.072086 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:01:21.072128 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.072096 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:01:21.072128 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.072105 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:01:21.072128 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.072114 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:01:21.072128 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.072123 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:01:21.072128 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.072131 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ps5c\" (UniqueName: \"kubernetes.io/projected/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-kube-api-access-4ps5c\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:01:21.072364 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.072140 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:01:21.072364 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.072163 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c33bfdd-4308-48f3-8b26-2e52b4caa65e" (UID: "0c33bfdd-4308-48f3-8b26-2e52b4caa65e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:01:21.172894 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.172860 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c33bfdd-4308-48f3-8b26-2e52b4caa65e-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:01:21.911786 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.911755 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" Jul 13 18:01:21.911786 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.911765 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm" event={"ID":"0c33bfdd-4308-48f3-8b26-2e52b4caa65e","Type":"ContainerDied","Data":"95f25520cbb4707415f8a6828e430af0416553020c7d4f466862a9db9f7e81da"} Jul 13 18:01:21.912268 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.911827 2581 scope.go:117] "RemoveContainer" containerID="4dfe9d24e575b227d4d56fa2c766459e42706910ec2d953c5b674bf8eed088bb" Jul 13 18:01:21.932065 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.932035 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm"] Jul 13 18:01:21.936585 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:21.936560 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ee0971b4-openshift-default-749766f88f-7xfhm"] Jul 13 18:01:23.281334 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:23.281300 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" path="/var/lib/kubelet/pods/0c33bfdd-4308-48f3-8b26-2e52b4caa65e/volumes" Jul 13 18:01:32.886987 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:32.886954 2581 patch_prober.go:28] interesting pod/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 13 18:01:32.887409 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:32.887022 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 13 18:01:32.981589 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:32.981553 2581 generic.go:356] "Generic (PLEG): container finished" podID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerID="27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2" exitCode=0 Jul 13 18:01:32.981775 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:32.981610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" event={"ID":"77c0569a-d8be-4efe-84d2-ad6efb3693ed","Type":"ContainerDied","Data":"27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2"} Jul 13 18:01:32.982014 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:32.981998 2581 scope.go:117] "RemoveContainer" containerID="27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2" Jul 13 18:01:32.983014 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:32.982984 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:01:32.983108 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:32.983060 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:01:32.983156 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:32.983107 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:01:33.987891 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:33.987859 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" event={"ID":"77c0569a-d8be-4efe-84d2-ad6efb3693ed","Type":"ContainerStarted","Data":"1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666"} Jul 13 18:01:34.336451 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:34.336312 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:34.336638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:34.336511 2581 patch_prober.go:28] interesting pod/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 13 18:01:34.336638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:34.336556 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 13 18:01:35.335654 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:35.335614 2581 patch_prober.go:28] interesting pod/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 13 18:01:35.336253 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:35.336213 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 13 18:01:36.335910 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:36.335870 2581 patch_prober.go:28] interesting pod/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 13 18:01:36.336554 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:36.336517 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 13 18:01:37.336093 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:37.336051 2581 patch_prober.go:28] interesting pod/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 13 18:01:37.336623 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:37.336129 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 13 18:01:38.340016 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:38.339980 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:38.340527 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:38.340363 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:01:38.341161 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:01:38.341139 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:02:36.896834 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:36.896794 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5"] Jul 13 18:02:36.897389 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:36.897017 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" containerID="cri-o://1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666" gracePeriod=30 Jul 13 18:02:38.343380 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:38.343347 2581 patch_prober.go:28] interesting pod/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 18:02:38.343812 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:38.343422 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 18:02:42.143985 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.143963 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:02:42.293709 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.293683 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfblj\" (UniqueName: \"kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-kube-api-access-gfblj\") pod \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " Jul 13 18:02:42.293886 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.293732 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-token\") pod \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " Jul 13 18:02:42.293886 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.293750 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-podinfo\") pod \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " Jul 13 18:02:42.293886 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.293766 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-certs\") pod \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " Jul 13 18:02:42.293886 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.293808 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-socket\") pod \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " Jul 13 18:02:42.293886 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.293823 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-envoy\") pod \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " Jul 13 18:02:42.293886 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.293842 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-credential-socket\") pod \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " Jul 13 18:02:42.293886 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.293870 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-data\") pod \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " Jul 13 18:02:42.294227 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.293900 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istiod-ca-cert\") pod \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\" (UID: \"77c0569a-d8be-4efe-84d2-ad6efb3693ed\") " Jul 13 18:02:42.294227 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.294115 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77c0569a-d8be-4efe-84d2-ad6efb3693ed" (UID: "77c0569a-d8be-4efe-84d2-ad6efb3693ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:02:42.294227 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.294132 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77c0569a-d8be-4efe-84d2-ad6efb3693ed" (UID: "77c0569a-d8be-4efe-84d2-ad6efb3693ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:02:42.294227 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.294143 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77c0569a-d8be-4efe-84d2-ad6efb3693ed" (UID: "77c0569a-d8be-4efe-84d2-ad6efb3693ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:02:42.294429 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.294384 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77c0569a-d8be-4efe-84d2-ad6efb3693ed" (UID: "77c0569a-d8be-4efe-84d2-ad6efb3693ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:02:42.294962 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.294917 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "77c0569a-d8be-4efe-84d2-ad6efb3693ed" (UID: "77c0569a-d8be-4efe-84d2-ad6efb3693ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:02:42.295952 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.295926 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-kube-api-access-gfblj" (OuterVolumeSpecName: "kube-api-access-gfblj") pod "77c0569a-d8be-4efe-84d2-ad6efb3693ed" (UID: "77c0569a-d8be-4efe-84d2-ad6efb3693ed"). InnerVolumeSpecName "kube-api-access-gfblj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:02:42.296032 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.295951 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77c0569a-d8be-4efe-84d2-ad6efb3693ed" (UID: "77c0569a-d8be-4efe-84d2-ad6efb3693ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:02:42.296032 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.295957 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77c0569a-d8be-4efe-84d2-ad6efb3693ed" (UID: "77c0569a-d8be-4efe-84d2-ad6efb3693ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 18:02:42.296236 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.296222 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "77c0569a-d8be-4efe-84d2-ad6efb3693ed" (UID: "77c0569a-d8be-4efe-84d2-ad6efb3693ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:02:42.334101 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.334070 2581 generic.go:356] "Generic (PLEG): container finished" podID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerID="1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666" exitCode=0 Jul 13 18:02:42.334253 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.334115 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" Jul 13 18:02:42.334253 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.334152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" event={"ID":"77c0569a-d8be-4efe-84d2-ad6efb3693ed","Type":"ContainerDied","Data":"1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666"} Jul 13 18:02:42.334253 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.334205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5" event={"ID":"77c0569a-d8be-4efe-84d2-ad6efb3693ed","Type":"ContainerDied","Data":"7f9b6dac276a7e9b893f4ec3857def762dec64aaa78ad76f33d36fa95f13839a"} Jul 13 18:02:42.334253 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.334236 2581 scope.go:117] "RemoveContainer" containerID="1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666" Jul 13 18:02:42.343217 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.343202 2581 scope.go:117] "RemoveContainer" containerID="27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2" Jul 13 18:02:42.350679 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.350665 2581 scope.go:117] "RemoveContainer" containerID="1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666" Jul 13 18:02:42.350923 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:02:42.350902 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666\": container with ID starting with 1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666 not found: ID does not exist" containerID="1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666" Jul 13 18:02:42.350996 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.350934 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666"} err="failed to get container status \"1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666\": rpc error: code = NotFound desc = could not find container \"1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666\": container with ID starting with 1b8cdf744660c33cc16d433b536ad8d89b5c8b6d5f18053780ee3cd7d3978666 not found: ID does not exist" Jul 13 18:02:42.350996 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.350956 2581 scope.go:117] "RemoveContainer" containerID="27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2" Jul 13 18:02:42.351208 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:02:42.351192 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2\": container with ID starting with 27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2 not found: ID does not exist" containerID="27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2" Jul 13 18:02:42.351249 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.351216 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2"} err="failed to get container status \"27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2\": rpc error: code = NotFound desc = could not find container \"27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2\": container with ID starting with 27fb5f64bc7ee7418b97f10e80b2407c8ddb3931a6b706f20988cda72c0977f2 not found: ID does not exist" Jul 13 18:02:42.360253 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.359782 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5"] Jul 13 18:02:42.364171 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.364149 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-338f4926-openshift-default-5cc8647b55-tzfr5"] Jul 13 18:02:42.394547 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.394522 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfblj\" (UniqueName: \"kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-kube-api-access-gfblj\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:02:42.394547 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.394544 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:02:42.394660 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.394554 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:02:42.394660 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.394562 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:02:42.394660 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.394570 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:02:42.394660 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.394578 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:02:42.394660 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.394587 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:02:42.394660 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.394595 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:02:42.394660 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:42.394603 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77c0569a-d8be-4efe-84d2-ad6efb3693ed-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:02:43.278005 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:02:43.277971 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" path="/var/lib/kubelet/pods/77c0569a-d8be-4efe-84d2-ad6efb3693ed/volumes" Jul 13 18:04:15.009786 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.009748 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs"] Jul 13 18:04:15.010315 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.010063 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" Jul 13 18:04:15.010315 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.010073 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" Jul 13 18:04:15.010315 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.010082 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" Jul 13 18:04:15.010315 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.010087 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" Jul 13 18:04:15.010315 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.010102 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" Jul 13 18:04:15.010315 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.010108 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" Jul 13 18:04:15.010315 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.010119 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" Jul 13 18:04:15.010315 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.010125 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" Jul 13 18:04:15.010315 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.010183 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" Jul 13 18:04:15.010315 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.010190 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" Jul 13 18:04:15.013102 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.013085 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.015704 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.015681 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3bf93f7b-openshift-default-dockercfg-7887k\"" Jul 13 18:04:15.030776 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.030752 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs"] Jul 13 18:04:15.071741 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.071712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-socket\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.071741 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.071744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-token\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.071979 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.071772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-certs\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.071979 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.071840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-data\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.071979 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.071866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istiod-ca-cert\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.071979 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.071924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-envoy\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.071979 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.071964 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-credential-socket\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.072143 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.071984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-podinfo\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.072143 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.072028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs6fv\" (UniqueName: \"kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-kube-api-access-qs6fv\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173227 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-data\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173227 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173229 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istiod-ca-cert\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173511 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173248 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-envoy\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173511 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-credential-socket\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173511 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-podinfo\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173511 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs6fv\" (UniqueName: \"kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-kube-api-access-qs6fv\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173752 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-socket\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173752 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-token\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173752 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-certs\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173909 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173801 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-credential-socket\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.173977 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173919 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-socket\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.174045 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.173994 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-data\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.174119 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.174046 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istiod-ca-cert\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.174176 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.174126 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-certs\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.175618 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.175594 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-envoy\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.175851 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.175834 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-podinfo\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.182384 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.182361 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-token\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.188479 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.183661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs6fv\" (UniqueName: \"kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-kube-api-access-qs6fv\") pod \"e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.323988 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.323908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:15.471980 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.471949 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs"] Jul 13 18:04:15.475438 ip-10-0-142-186 kubenswrapper[2581]: W0713 18:04:15.475406 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4c4d66_b7de_4e4e_9521_714f57da4adc.slice/crio-27cacd8470a14432693c06772ccbafc8ae3ff9c70a13afa5687525536c2d3207 WatchSource:0}: Error finding container 27cacd8470a14432693c06772ccbafc8ae3ff9c70a13afa5687525536c2d3207: Status 404 returned error can't find the container with id 27cacd8470a14432693c06772ccbafc8ae3ff9c70a13afa5687525536c2d3207 Jul 13 18:04:15.477854 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.477823 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:04:15.477928 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.477890 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:04:15.477928 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.477915 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:04:15.810076 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.810042 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" event={"ID":"1e4c4d66-b7de-4e4e-9521-714f57da4adc","Type":"ContainerStarted","Data":"7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d"} Jul 13 18:04:15.810249 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.810097 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" event={"ID":"1e4c4d66-b7de-4e4e-9521-714f57da4adc","Type":"ContainerStarted","Data":"27cacd8470a14432693c06772ccbafc8ae3ff9c70a13afa5687525536c2d3207"} Jul 13 18:04:15.829063 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:15.829013 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" podStartSLOduration=1.828996544 podStartE2EDuration="1.828996544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:04:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:04:15.827524702 +0000 UTC m=+1934.970861781" watchObservedRunningTime="2026-07-13 18:04:15.828996544 +0000 UTC m=+1934.972333695" Jul 13 18:04:16.324390 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:16.324359 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:16.329707 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:16.329683 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:16.815333 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:16.815302 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:16.816478 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:16.816420 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:32.712900 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:32.712864 2581 patch_prober.go:28] interesting pod/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": read tcp 10.133.0.2:38988->10.133.0.49:15021: read: connection reset by peer" start-of-body= Jul 13 18:04:32.713318 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:32.712936 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": read tcp 10.133.0.2:38988->10.133.0.49:15021: read: connection reset by peer" Jul 13 18:04:32.906520 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:32.906437 2581 generic.go:356] "Generic (PLEG): container finished" podID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerID="7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d" exitCode=0 Jul 13 18:04:32.906674 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:32.906515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" event={"ID":"1e4c4d66-b7de-4e4e-9521-714f57da4adc","Type":"ContainerDied","Data":"7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d"} Jul 13 18:04:32.906920 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:32.906906 2581 scope.go:117] "RemoveContainer" containerID="7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d" Jul 13 18:04:32.907942 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:32.907918 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:04:32.907997 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:32.907984 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:04:32.908032 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:32.908014 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:04:33.917241 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:33.917207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" event={"ID":"1e4c4d66-b7de-4e4e-9521-714f57da4adc","Type":"ContainerStarted","Data":"91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664"} Jul 13 18:04:34.324964 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:34.324867 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:34.325328 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:34.325303 2581 patch_prober.go:28] interesting pod/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 13 18:04:34.325558 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:34.325529 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 13 18:04:35.325253 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:35.325200 2581 patch_prober.go:28] interesting pod/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 13 18:04:35.325829 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:35.325289 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 13 18:04:36.325293 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:36.325253 2581 patch_prober.go:28] interesting pod/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 13 18:04:36.325949 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:36.325913 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 13 18:04:37.325323 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:37.325276 2581 patch_prober.go:28] interesting pod/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 13 18:04:37.325870 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:37.325352 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 13 18:04:38.328209 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:38.328179 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:38.328633 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:38.328488 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:38.329253 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:38.329233 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:04:55.726015 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:55.725978 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs"] Jul 13 18:04:55.726583 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:04:55.726184 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" containerID="cri-o://91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664" gracePeriod=30 Jul 13 18:05:00.978671 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:00.978641 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:05:01.058304 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.058206 2581 generic.go:356] "Generic (PLEG): container finished" podID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerID="91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664" exitCode=0 Jul 13 18:05:01.058304 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.058272 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" Jul 13 18:05:01.058304 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.058290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" event={"ID":"1e4c4d66-b7de-4e4e-9521-714f57da4adc","Type":"ContainerDied","Data":"91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664"} Jul 13 18:05:01.058619 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.058343 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs" event={"ID":"1e4c4d66-b7de-4e4e-9521-714f57da4adc","Type":"ContainerDied","Data":"27cacd8470a14432693c06772ccbafc8ae3ff9c70a13afa5687525536c2d3207"} Jul 13 18:05:01.058619 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.058365 2581 scope.go:117] "RemoveContainer" containerID="91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664" Jul 13 18:05:01.067038 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.067017 2581 scope.go:117] "RemoveContainer" containerID="7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d" Jul 13 18:05:01.074650 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.074519 2581 scope.go:117] "RemoveContainer" containerID="91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664" Jul 13 18:05:01.074783 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:05:01.074762 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664\": container with ID starting with 91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664 not found: ID does not exist" containerID="91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664" Jul 13 18:05:01.074829 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.074791 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664"} err="failed to get container status \"91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664\": rpc error: code = NotFound desc = could not find container \"91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664\": container with ID starting with 91b8bb7caad731fc0af9df0cb1d1bff6e2b9337594e401539c58d04396647664 not found: ID does not exist" Jul 13 18:05:01.074829 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.074808 2581 scope.go:117] "RemoveContainer" containerID="7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d" Jul 13 18:05:01.074905 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.074850 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-data\") pod \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " Jul 13 18:05:01.074905 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.074874 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-token\") pod \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " Jul 13 18:05:01.074905 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.074889 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs6fv\" (UniqueName: \"kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-kube-api-access-qs6fv\") pod \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " Jul 13 18:05:01.075026 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.074972 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-envoy\") pod \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " Jul 13 18:05:01.075026 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075010 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istiod-ca-cert\") pod \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " Jul 13 18:05:01.075138 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075040 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-socket\") pod \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " Jul 13 18:05:01.075138 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075072 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-credential-socket\") pod \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " Jul 13 18:05:01.075138 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:05:01.075074 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d\": container with ID starting with 7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d not found: ID does not exist" containerID="7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d" Jul 13 18:05:01.075138 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075101 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-certs\") pod \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " Jul 13 18:05:01.075138 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075107 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d"} err="failed to get container status \"7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d\": rpc error: code = NotFound desc = could not find container \"7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d\": container with ID starting with 7a273783078c38dfe6ad51dedf200494fe4770b207df5b0e63931da0e36d9d3d not found: ID does not exist" Jul 13 18:05:01.075138 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075125 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-podinfo\") pod \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\" (UID: \"1e4c4d66-b7de-4e4e-9521-714f57da4adc\") " Jul 13 18:05:01.075517 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075481 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e4c4d66-b7de-4e4e-9521-714f57da4adc" (UID: "1e4c4d66-b7de-4e4e-9521-714f57da4adc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:05:01.075517 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075501 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e4c4d66-b7de-4e4e-9521-714f57da4adc" (UID: "1e4c4d66-b7de-4e4e-9521-714f57da4adc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:05:01.075718 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075530 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e4c4d66-b7de-4e4e-9521-714f57da4adc" (UID: "1e4c4d66-b7de-4e4e-9521-714f57da4adc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:05:01.075718 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075602 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e4c4d66-b7de-4e4e-9521-714f57da4adc" (UID: "1e4c4d66-b7de-4e4e-9521-714f57da4adc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:05:01.075992 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.075968 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e4c4d66-b7de-4e4e-9521-714f57da4adc" (UID: "1e4c4d66-b7de-4e4e-9521-714f57da4adc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:05:01.077108 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.077089 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e4c4d66-b7de-4e4e-9521-714f57da4adc" (UID: "1e4c4d66-b7de-4e4e-9521-714f57da4adc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:05:01.077495 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.077448 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e4c4d66-b7de-4e4e-9521-714f57da4adc" (UID: "1e4c4d66-b7de-4e4e-9521-714f57da4adc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 18:05:01.077598 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.077492 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-kube-api-access-qs6fv" (OuterVolumeSpecName: "kube-api-access-qs6fv") pod "1e4c4d66-b7de-4e4e-9521-714f57da4adc" (UID: "1e4c4d66-b7de-4e4e-9521-714f57da4adc"). InnerVolumeSpecName "kube-api-access-qs6fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:05:01.077704 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.077677 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e4c4d66-b7de-4e4e-9521-714f57da4adc" (UID: "1e4c4d66-b7de-4e4e-9521-714f57da4adc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:05:01.179399 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.179372 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:05:01.179399 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.179398 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:05:01.179638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.179410 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:05:01.179638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.179419 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:05:01.179638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.179428 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:05:01.179638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.179438 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:05:01.179638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.179445 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:05:01.179638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.179453 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:05:01.179638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.179484 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs6fv\" (UniqueName: \"kubernetes.io/projected/1e4c4d66-b7de-4e4e-9521-714f57da4adc-kube-api-access-qs6fv\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:05:01.376479 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.376411 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs"] Jul 13 18:05:01.378512 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:01.378492 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3bf93f7b-openshift-default-699f7867bc-fdgjs"] Jul 13 18:05:03.277872 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:03.277836 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" path="/var/lib/kubelet/pods/1e4c4d66-b7de-4e4e-9521-714f57da4adc/volumes" Jul 13 18:05:15.855715 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.855681 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v"] Jul 13 18:05:15.856116 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.855998 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" Jul 13 18:05:15.856116 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.856010 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" Jul 13 18:05:15.856116 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.856029 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" Jul 13 18:05:15.856116 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.856035 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" Jul 13 18:05:15.856116 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.856100 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" Jul 13 18:05:15.856116 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.856109 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e4c4d66-b7de-4e4e-9521-714f57da4adc" containerName="istio-proxy" Jul 13 18:05:15.856116 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.856117 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c0569a-d8be-4efe-84d2-ad6efb3693ed" containerName="istio-proxy" Jul 13 18:05:15.856352 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.856124 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c33bfdd-4308-48f3-8b26-2e52b4caa65e" containerName="istio-proxy" Jul 13 18:05:15.859192 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.859171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:15.861762 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.861737 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ee8b02ac-openshift-default-dockercfg-mwsl7\"" Jul 13 18:05:15.871633 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.871610 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v"] Jul 13 18:05:15.904143 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.904089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-socket\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:15.904273 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.904164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph7w8\" (UniqueName: \"kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-kube-api-access-ph7w8\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:15.904273 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.904208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-data\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:15.904273 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.904254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-credential-socket\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:15.904510 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.904354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-certs\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:15.904510 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.904379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/784cd055-832e-4fb1-b19e-134c3e2da254-istiod-ca-cert\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:15.904591 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.904531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-istio-token\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:15.904591 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.904580 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/784cd055-832e-4fb1-b19e-134c3e2da254-istio-podinfo\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:15.904878 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:15.904623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-envoy\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.005346 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.005315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-istio-token\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.005566 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.005360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/784cd055-832e-4fb1-b19e-134c3e2da254-istio-podinfo\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.005566 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.005388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-envoy\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.005566 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.005409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-socket\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.005566 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.005531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph7w8\" (UniqueName: \"kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-kube-api-access-ph7w8\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.005821 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.005583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-data\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.005821 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.005638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-credential-socket\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.005821 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.005678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-certs\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.005821 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.005700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/784cd055-832e-4fb1-b19e-134c3e2da254-istiod-ca-cert\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.006033 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.005867 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-socket\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.006086 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.006028 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-credential-socket\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.006139 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.006079 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-data\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.006139 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.006095 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-certs\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.006355 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.006336 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/784cd055-832e-4fb1-b19e-134c3e2da254-istiod-ca-cert\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.008098 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.008078 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-envoy\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.008414 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.008396 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/784cd055-832e-4fb1-b19e-134c3e2da254-istio-podinfo\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.013593 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.013572 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-istio-token\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.013964 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.013939 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph7w8\" (UniqueName: \"kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-kube-api-access-ph7w8\") pod \"e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.170118 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.170032 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:16.320040 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.320016 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v"] Jul 13 18:05:16.321662 ip-10-0-142-186 kubenswrapper[2581]: W0713 18:05:16.321637 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784cd055_832e_4fb1_b19e_134c3e2da254.slice/crio-d1b766d622353800645267c5ea36953b9579df3f04105685d3e2bb5028b92d41 WatchSource:0}: Error finding container d1b766d622353800645267c5ea36953b9579df3f04105685d3e2bb5028b92d41: Status 404 returned error can't find the container with id d1b766d622353800645267c5ea36953b9579df3f04105685d3e2bb5028b92d41 Jul 13 18:05:16.323561 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.323528 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:05:16.323663 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.323597 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:05:16.323663 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:16.323625 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:05:17.141276 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:17.141240 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" event={"ID":"784cd055-832e-4fb1-b19e-134c3e2da254","Type":"ContainerStarted","Data":"ed6126465539fe2676d2febb7fec401e1277b6e36e205ea14a4a56b01a24143a"} Jul 13 18:05:17.141784 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:17.141292 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" event={"ID":"784cd055-832e-4fb1-b19e-134c3e2da254","Type":"ContainerStarted","Data":"d1b766d622353800645267c5ea36953b9579df3f04105685d3e2bb5028b92d41"} Jul 13 18:05:17.164089 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:17.164044 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" podStartSLOduration=2.164029533 podStartE2EDuration="2.164029533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:05:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:05:17.163040422 +0000 UTC m=+1996.306377490" watchObservedRunningTime="2026-07-13 18:05:17.164029533 +0000 UTC m=+1996.307366605" Jul 13 18:05:17.170831 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:17.170811 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:17.175849 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:17.175829 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:18.146884 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:18.146853 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:18.147919 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:18.147898 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:33.517586 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:33.517540 2581 patch_prober.go:28] interesting pod/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:59380->10.133.0.50:15021: read: connection reset by peer" start-of-body= Jul 13 18:05:33.518017 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:33.517653 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:59380->10.133.0.50:15021: read: connection reset by peer" Jul 13 18:05:34.228302 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:34.228268 2581 generic.go:356] "Generic (PLEG): container finished" podID="784cd055-832e-4fb1-b19e-134c3e2da254" containerID="ed6126465539fe2676d2febb7fec401e1277b6e36e205ea14a4a56b01a24143a" exitCode=0 Jul 13 18:05:34.228551 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:34.228351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" event={"ID":"784cd055-832e-4fb1-b19e-134c3e2da254","Type":"ContainerDied","Data":"ed6126465539fe2676d2febb7fec401e1277b6e36e205ea14a4a56b01a24143a"} Jul 13 18:05:34.228814 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:34.228797 2581 scope.go:117] "RemoveContainer" containerID="ed6126465539fe2676d2febb7fec401e1277b6e36e205ea14a4a56b01a24143a" Jul 13 18:05:34.229804 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:34.229780 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:05:34.229866 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:34.229845 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:05:34.229904 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:34.229876 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:05:35.240333 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:35.240287 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" event={"ID":"784cd055-832e-4fb1-b19e-134c3e2da254","Type":"ContainerStarted","Data":"0346f1c66a9f2e69f40e97a37dd60b538ba496d43c8a1b0b7cd927f73e9e8b10"} Jul 13 18:05:36.170676 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:36.170639 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:36.170881 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:36.170858 2581 patch_prober.go:28] interesting pod/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 13 18:05:36.170939 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:36.170920 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 13 18:05:37.170730 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:37.170689 2581 patch_prober.go:28] interesting pod/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 13 18:05:37.171095 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:37.170779 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 13 18:05:38.170738 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:38.170698 2581 patch_prober.go:28] interesting pod/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 13 18:05:38.171130 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:38.170760 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 13 18:05:39.170660 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:39.170619 2581 patch_prober.go:28] interesting pod/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 13 18:05:39.170846 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:39.170698 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 13 18:05:40.173985 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:40.173952 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:40.174387 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:40.174247 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:05:40.175000 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:05:40.174985 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:07:44.737776 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:44.737738 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v"] Jul 13 18:07:44.738368 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:44.738311 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" containerID="cri-o://0346f1c66a9f2e69f40e97a37dd60b538ba496d43c8a1b0b7cd927f73e9e8b10" gracePeriod=30 Jul 13 18:07:49.920141 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:49.920102 2581 generic.go:356] "Generic (PLEG): container finished" podID="784cd055-832e-4fb1-b19e-134c3e2da254" containerID="0346f1c66a9f2e69f40e97a37dd60b538ba496d43c8a1b0b7cd927f73e9e8b10" exitCode=0 Jul 13 18:07:49.920629 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:49.920195 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" event={"ID":"784cd055-832e-4fb1-b19e-134c3e2da254","Type":"ContainerDied","Data":"0346f1c66a9f2e69f40e97a37dd60b538ba496d43c8a1b0b7cd927f73e9e8b10"} Jul 13 18:07:49.920629 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:49.920293 2581 scope.go:117] "RemoveContainer" containerID="ed6126465539fe2676d2febb7fec401e1277b6e36e205ea14a4a56b01a24143a" Jul 13 18:07:49.991229 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:49.991202 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:07:50.034054 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.033960 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/784cd055-832e-4fb1-b19e-134c3e2da254-istio-podinfo\") pod \"784cd055-832e-4fb1-b19e-134c3e2da254\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " Jul 13 18:07:50.034054 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.033998 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-envoy\") pod \"784cd055-832e-4fb1-b19e-134c3e2da254\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " Jul 13 18:07:50.034054 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034028 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/784cd055-832e-4fb1-b19e-134c3e2da254-istiod-ca-cert\") pod \"784cd055-832e-4fb1-b19e-134c3e2da254\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " Jul 13 18:07:50.034358 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034069 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-socket\") pod \"784cd055-832e-4fb1-b19e-134c3e2da254\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " Jul 13 18:07:50.034358 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034091 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-data\") pod \"784cd055-832e-4fb1-b19e-134c3e2da254\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " Jul 13 18:07:50.034358 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034118 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-credential-socket\") pod \"784cd055-832e-4fb1-b19e-134c3e2da254\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " Jul 13 18:07:50.034358 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034150 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-certs\") pod \"784cd055-832e-4fb1-b19e-134c3e2da254\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " Jul 13 18:07:50.034358 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034181 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph7w8\" (UniqueName: \"kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-kube-api-access-ph7w8\") pod \"784cd055-832e-4fb1-b19e-134c3e2da254\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " Jul 13 18:07:50.034358 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034215 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-istio-token\") pod \"784cd055-832e-4fb1-b19e-134c3e2da254\" (UID: \"784cd055-832e-4fb1-b19e-134c3e2da254\") " Jul 13 18:07:50.034704 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034388 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "784cd055-832e-4fb1-b19e-134c3e2da254" (UID: "784cd055-832e-4fb1-b19e-134c3e2da254"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:07:50.034704 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034566 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "784cd055-832e-4fb1-b19e-134c3e2da254" (UID: "784cd055-832e-4fb1-b19e-134c3e2da254"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:07:50.034704 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034510 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/784cd055-832e-4fb1-b19e-134c3e2da254-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "784cd055-832e-4fb1-b19e-134c3e2da254" (UID: "784cd055-832e-4fb1-b19e-134c3e2da254"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:07:50.034704 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034587 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:07:50.034704 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.034589 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "784cd055-832e-4fb1-b19e-134c3e2da254" (UID: "784cd055-832e-4fb1-b19e-134c3e2da254"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:07:50.035388 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.035347 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-data" (OuterVolumeSpecName: "istio-data") pod "784cd055-832e-4fb1-b19e-134c3e2da254" (UID: "784cd055-832e-4fb1-b19e-134c3e2da254"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:07:50.036742 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.036701 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-istio-token" (OuterVolumeSpecName: "istio-token") pod "784cd055-832e-4fb1-b19e-134c3e2da254" (UID: "784cd055-832e-4fb1-b19e-134c3e2da254"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:07:50.036742 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.036720 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-kube-api-access-ph7w8" (OuterVolumeSpecName: "kube-api-access-ph7w8") pod "784cd055-832e-4fb1-b19e-134c3e2da254" (UID: "784cd055-832e-4fb1-b19e-134c3e2da254"). InnerVolumeSpecName "kube-api-access-ph7w8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:07:50.036921 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.036769 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "784cd055-832e-4fb1-b19e-134c3e2da254" (UID: "784cd055-832e-4fb1-b19e-134c3e2da254"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:07:50.036921 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.036798 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/784cd055-832e-4fb1-b19e-134c3e2da254-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "784cd055-832e-4fb1-b19e-134c3e2da254" (UID: "784cd055-832e-4fb1-b19e-134c3e2da254"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 18:07:50.135670 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.135635 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:07:50.135670 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.135664 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:07:50.135670 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.135674 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:07:50.135918 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.135683 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph7w8\" (UniqueName: \"kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-kube-api-access-ph7w8\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:07:50.135918 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.135692 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/784cd055-832e-4fb1-b19e-134c3e2da254-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:07:50.135918 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.135700 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/784cd055-832e-4fb1-b19e-134c3e2da254-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:07:50.135918 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.135707 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/784cd055-832e-4fb1-b19e-134c3e2da254-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:07:50.135918 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.135715 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/784cd055-832e-4fb1-b19e-134c3e2da254-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:07:50.926614 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.926574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" event={"ID":"784cd055-832e-4fb1-b19e-134c3e2da254","Type":"ContainerDied","Data":"d1b766d622353800645267c5ea36953b9579df3f04105685d3e2bb5028b92d41"} Jul 13 18:07:50.927069 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.926646 2581 scope.go:117] "RemoveContainer" containerID="0346f1c66a9f2e69f40e97a37dd60b538ba496d43c8a1b0b7cd927f73e9e8b10" Jul 13 18:07:50.927069 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.926584 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v" Jul 13 18:07:50.951370 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.951346 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v"] Jul 13 18:07:50.957357 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:50.957334 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ee8b02ac-openshift-default-688945859f-dsq8v"] Jul 13 18:07:51.277909 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:07:51.277827 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" path="/var/lib/kubelet/pods/784cd055-832e-4fb1-b19e-134c3e2da254/volumes" Jul 13 18:08:40.488125 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.488091 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2"] Jul 13 18:08:40.488636 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.488597 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" Jul 13 18:08:40.488636 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.488612 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" Jul 13 18:08:40.488636 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.488629 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" Jul 13 18:08:40.488636 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.488637 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" Jul 13 18:08:40.488769 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.488730 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" Jul 13 18:08:40.488769 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.488741 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="784cd055-832e-4fb1-b19e-134c3e2da254" containerName="istio-proxy" Jul 13 18:08:40.491899 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.491883 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.494846 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.494816 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d09cc8-openshift-default-dockercfg-rh25v\"" Jul 13 18:08:40.506578 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.506554 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2"] Jul 13 18:08:40.671931 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.671896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-certs\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.671931 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.671937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mmb4\" (UniqueName: \"kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-kube-api-access-4mmb4\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.672176 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.671956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-token\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.672176 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.671979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-socket\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.672176 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.672044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istiod-ca-cert\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.672176 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.672067 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-data\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.672176 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.672085 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-podinfo\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.672176 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.672114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-credential-socket\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.672448 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.672222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-envoy\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.773412 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istiod-ca-cert\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.773412 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-data\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.773412 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773376 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-podinfo\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.773412 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-credential-socket\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.773788 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-envoy\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.773788 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-certs\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.773788 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mmb4\" (UniqueName: \"kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-kube-api-access-4mmb4\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.773788 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-token\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.773788 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-socket\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.774050 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773821 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-credential-socket\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.774050 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.773890 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-data\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.774162 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.774119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-socket\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.774218 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.774191 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istiod-ca-cert\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.774354 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.774336 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-certs\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.775833 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.775813 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-envoy\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.775933 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.775917 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-podinfo\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.783008 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.782987 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-token\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.783149 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.783132 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mmb4\" (UniqueName: \"kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-kube-api-access-4mmb4\") pod \"e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.803042 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.803020 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:40.945512 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.945478 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2"] Jul 13 18:08:40.946851 ip-10-0-142-186 kubenswrapper[2581]: W0713 18:08:40.946819 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6994becf_a7a1_4be4_9ed5_3cfaaff5d694.slice/crio-8431ee1decdbd32854d0624a748dc8a1c8f723cc44ad35014ab3a7553b6d3415 WatchSource:0}: Error finding container 8431ee1decdbd32854d0624a748dc8a1c8f723cc44ad35014ab3a7553b6d3415: Status 404 returned error can't find the container with id 8431ee1decdbd32854d0624a748dc8a1c8f723cc44ad35014ab3a7553b6d3415 Jul 13 18:08:40.948982 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.948947 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:08:40.949076 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.949025 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:08:40.949076 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:40.949070 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:08:41.172173 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:41.172135 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" event={"ID":"6994becf-a7a1-4be4-9ed5-3cfaaff5d694","Type":"ContainerStarted","Data":"4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2"} Jul 13 18:08:41.172351 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:41.172196 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" event={"ID":"6994becf-a7a1-4be4-9ed5-3cfaaff5d694","Type":"ContainerStarted","Data":"8431ee1decdbd32854d0624a748dc8a1c8f723cc44ad35014ab3a7553b6d3415"} Jul 13 18:08:41.196234 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:41.196179 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" podStartSLOduration=1.196160402 podStartE2EDuration="1.196160402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:08:41.194344573 +0000 UTC m=+2200.337681646" watchObservedRunningTime="2026-07-13 18:08:41.196160402 +0000 UTC m=+2200.339497527" Jul 13 18:08:41.803648 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:41.803604 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:42.808152 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:42.808118 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:43.183193 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:43.183159 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:43.184203 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:43.184185 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:48.537330 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.537295 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6"] Jul 13 18:08:48.540967 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.540941 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.543564 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.543536 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-dc368b-openshift-default-dockercfg-mt2pj\"" Jul 13 18:08:48.553198 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.553176 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6"] Jul 13 18:08:48.627751 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.627716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-certs\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.627751 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.627757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-socket\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.627953 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.627833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-envoy\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.627953 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.627869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-credential-socket\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.627953 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.627886 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-token\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.627953 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.627905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-data\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.627953 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.627922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istiod-ca-cert\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.628135 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.628015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-podinfo\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.628135 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.628037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckwx5\" (UniqueName: \"kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-kube-api-access-ckwx5\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.728814 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.728782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-envoy\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.728814 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.728816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-credential-socket\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729059 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.728833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-token\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729059 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.728851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-data\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729059 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.728985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istiod-ca-cert\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729230 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.729067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-podinfo\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729230 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.729095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckwx5\" (UniqueName: \"kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-kube-api-access-ckwx5\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729230 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.729115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-certs\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729230 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.729156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-socket\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729447 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.729290 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-credential-socket\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729447 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.729317 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-data\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729586 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.729539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-socket\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729664 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.729583 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-certs\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.729731 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.729715 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istiod-ca-cert\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.731181 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.731160 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-envoy\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.731598 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.731578 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-podinfo\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.737285 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.737264 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-token\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.738624 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.738604 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckwx5\" (UniqueName: \"kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-kube-api-access-ckwx5\") pod \"e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.852872 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.852767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:48.995087 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.995058 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6"] Jul 13 18:08:48.996716 ip-10-0-142-186 kubenswrapper[2581]: W0713 18:08:48.996674 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c32bc2_b6b4_4e9f_adc9_a5ac80380032.slice/crio-d99ecc6576ed39c5938a1d6ec22a5e3388b2522d54a688230a9213848929636b WatchSource:0}: Error finding container d99ecc6576ed39c5938a1d6ec22a5e3388b2522d54a688230a9213848929636b: Status 404 returned error can't find the container with id d99ecc6576ed39c5938a1d6ec22a5e3388b2522d54a688230a9213848929636b Jul 13 18:08:48.998780 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.998744 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:08:48.998879 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.998804 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:08:48.998879 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:48.998831 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:08:49.215417 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:49.215315 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" event={"ID":"76c32bc2-b6b4-4e9f-adc9-a5ac80380032","Type":"ContainerStarted","Data":"eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14"} Jul 13 18:08:49.215417 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:49.215369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" event={"ID":"76c32bc2-b6b4-4e9f-adc9-a5ac80380032","Type":"ContainerStarted","Data":"d99ecc6576ed39c5938a1d6ec22a5e3388b2522d54a688230a9213848929636b"} Jul 13 18:08:49.247088 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:49.247038 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" podStartSLOduration=1.24702188 podStartE2EDuration="1.24702188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:08:49.245346987 +0000 UTC m=+2208.388684061" watchObservedRunningTime="2026-07-13 18:08:49.24702188 +0000 UTC m=+2208.390358952" Jul 13 18:08:49.853438 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:49.853400 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:50.861176 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:50.861146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:51.226991 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:51.226888 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:51.227747 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:51.227727 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:08:58.184809 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:58.184769 2581 patch_prober.go:28] interesting pod/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 13 18:08:58.185145 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:58.184832 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 13 18:08:58.280804 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:58.280772 2581 generic.go:356] "Generic (PLEG): container finished" podID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerID="4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2" exitCode=0 Jul 13 18:08:58.280954 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:58.280833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" event={"ID":"6994becf-a7a1-4be4-9ed5-3cfaaff5d694","Type":"ContainerDied","Data":"4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2"} Jul 13 18:08:58.281199 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:58.281186 2581 scope.go:117] "RemoveContainer" containerID="4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2" Jul 13 18:08:58.282164 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:58.282138 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:08:58.282218 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:58.282205 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:08:58.282254 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:58.282235 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:08:59.287471 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:59.287436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" event={"ID":"6994becf-a7a1-4be4-9ed5-3cfaaff5d694","Type":"ContainerStarted","Data":"0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a"} Jul 13 18:08:59.803475 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:59.803438 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:08:59.803659 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:59.803594 2581 patch_prober.go:28] interesting pod/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 13 18:08:59.803659 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:08:59.803638 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 13 18:09:00.803658 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:00.803618 2581 patch_prober.go:28] interesting pod/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 13 18:09:00.804056 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:00.803694 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 13 18:09:01.803840 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:01.803803 2581 patch_prober.go:28] interesting pod/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 13 18:09:01.804254 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:01.803872 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 13 18:09:02.803513 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:02.803447 2581 patch_prober.go:28] interesting pod/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 13 18:09:02.803699 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:02.803528 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 13 18:09:03.807887 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:03.807856 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:09:03.808261 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:03.808178 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:09:03.809039 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:03.809019 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:09:06.228588 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:06.228547 2581 patch_prober.go:28] interesting pod/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 13 18:09:06.228975 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:06.228637 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 13 18:09:06.322472 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:06.322421 2581 generic.go:356] "Generic (PLEG): container finished" podID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerID="eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14" exitCode=0 Jul 13 18:09:06.322637 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:06.322499 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" event={"ID":"76c32bc2-b6b4-4e9f-adc9-a5ac80380032","Type":"ContainerDied","Data":"eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14"} Jul 13 18:09:06.322912 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:06.322895 2581 scope.go:117] "RemoveContainer" containerID="eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14" Jul 13 18:09:06.323894 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:06.323870 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:09:06.323959 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:06.323938 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:09:06.323994 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:06.323972 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:09:07.333164 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:07.333118 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" event={"ID":"76c32bc2-b6b4-4e9f-adc9-a5ac80380032","Type":"ContainerStarted","Data":"add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb"} Jul 13 18:09:07.853571 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:07.853540 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:09:07.853893 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:07.853712 2581 patch_prober.go:28] interesting pod/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 13 18:09:07.854046 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:07.854019 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 13 18:09:08.853303 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:08.853259 2581 patch_prober.go:28] interesting pod/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 13 18:09:08.853817 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:08.853349 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 13 18:09:09.854029 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:09.853972 2581 patch_prober.go:28] interesting pod/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 13 18:09:09.854561 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:09.854043 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 13 18:09:10.853701 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:10.853659 2581 patch_prober.go:28] interesting pod/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 13 18:09:10.853926 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:10.853731 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 13 18:09:11.857949 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:11.857914 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:09:11.858397 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:11.858177 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:09:11.858815 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:09:11.858799 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:10:11.303594 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:11.303559 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2"] Jul 13 18:10:11.304185 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:11.303864 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" containerID="cri-o://0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a" gracePeriod=30 Jul 13 18:10:16.551381 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.551356 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:10:16.586519 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586441 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-podinfo\") pod \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " Jul 13 18:10:16.586519 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586491 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-credential-socket\") pod \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " Jul 13 18:10:16.586702 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586523 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-certs\") pod \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " Jul 13 18:10:16.586702 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586558 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-token\") pod \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " Jul 13 18:10:16.586702 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586599 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istiod-ca-cert\") pod \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " Jul 13 18:10:16.586702 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586627 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-envoy\") pod \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " Jul 13 18:10:16.586702 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586666 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mmb4\" (UniqueName: \"kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-kube-api-access-4mmb4\") pod \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " Jul 13 18:10:16.586956 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586704 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-socket\") pod \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " Jul 13 18:10:16.586956 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586750 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-data\") pod \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\" (UID: \"6994becf-a7a1-4be4-9ed5-3cfaaff5d694\") " Jul 13 18:10:16.586956 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586842 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6994becf-a7a1-4be4-9ed5-3cfaaff5d694" (UID: "6994becf-a7a1-4be4-9ed5-3cfaaff5d694"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:16.586956 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.586860 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6994becf-a7a1-4be4-9ed5-3cfaaff5d694" (UID: "6994becf-a7a1-4be4-9ed5-3cfaaff5d694"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:16.587163 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.587051 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:16.587163 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.587070 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:16.587163 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.587067 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6994becf-a7a1-4be4-9ed5-3cfaaff5d694" (UID: "6994becf-a7a1-4be4-9ed5-3cfaaff5d694"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:16.587163 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.587087 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6994becf-a7a1-4be4-9ed5-3cfaaff5d694" (UID: "6994becf-a7a1-4be4-9ed5-3cfaaff5d694"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:10:16.587875 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.587845 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-data" (OuterVolumeSpecName: "istio-data") pod "6994becf-a7a1-4be4-9ed5-3cfaaff5d694" (UID: "6994becf-a7a1-4be4-9ed5-3cfaaff5d694"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:16.589027 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.588988 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6994becf-a7a1-4be4-9ed5-3cfaaff5d694" (UID: "6994becf-a7a1-4be4-9ed5-3cfaaff5d694"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:16.589204 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.589186 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6994becf-a7a1-4be4-9ed5-3cfaaff5d694" (UID: "6994becf-a7a1-4be4-9ed5-3cfaaff5d694"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 18:10:16.589277 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.589206 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-kube-api-access-4mmb4" (OuterVolumeSpecName: "kube-api-access-4mmb4") pod "6994becf-a7a1-4be4-9ed5-3cfaaff5d694" (UID: "6994becf-a7a1-4be4-9ed5-3cfaaff5d694"). InnerVolumeSpecName "kube-api-access-4mmb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:10:16.589440 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.589417 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-token" (OuterVolumeSpecName: "istio-token") pod "6994becf-a7a1-4be4-9ed5-3cfaaff5d694" (UID: "6994becf-a7a1-4be4-9ed5-3cfaaff5d694"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:10:16.687919 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.687884 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mmb4\" (UniqueName: \"kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-kube-api-access-4mmb4\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:16.687919 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.687914 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:16.687919 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.687927 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:16.688153 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.687938 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:16.688153 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.687948 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:16.688153 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.687959 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:16.688153 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.687970 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6994becf-a7a1-4be4-9ed5-3cfaaff5d694-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:16.710945 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.710914 2581 generic.go:356] "Generic (PLEG): container finished" podID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerID="0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a" exitCode=0 Jul 13 18:10:16.711039 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.710958 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" Jul 13 18:10:16.711039 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.711000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" event={"ID":"6994becf-a7a1-4be4-9ed5-3cfaaff5d694","Type":"ContainerDied","Data":"0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a"} Jul 13 18:10:16.711130 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.711050 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2" event={"ID":"6994becf-a7a1-4be4-9ed5-3cfaaff5d694","Type":"ContainerDied","Data":"8431ee1decdbd32854d0624a748dc8a1c8f723cc44ad35014ab3a7553b6d3415"} Jul 13 18:10:16.711130 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.711072 2581 scope.go:117] "RemoveContainer" containerID="0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a" Jul 13 18:10:16.720782 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.720764 2581 scope.go:117] "RemoveContainer" containerID="4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2" Jul 13 18:10:16.728783 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.728765 2581 scope.go:117] "RemoveContainer" containerID="0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a" Jul 13 18:10:16.729026 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:10:16.729006 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a\": container with ID starting with 0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a not found: ID does not exist" containerID="0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a" Jul 13 18:10:16.729088 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.729032 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a"} err="failed to get container status \"0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a\": rpc error: code = NotFound desc = could not find container \"0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a\": container with ID starting with 0d2c86061f41a63c2e6d495c07774f79b7df257c188cb97414645ca44213218a not found: ID does not exist" Jul 13 18:10:16.729088 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.729048 2581 scope.go:117] "RemoveContainer" containerID="4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2" Jul 13 18:10:16.729277 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:10:16.729259 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2\": container with ID starting with 4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2 not found: ID does not exist" containerID="4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2" Jul 13 18:10:16.729329 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.729284 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2"} err="failed to get container status \"4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2\": rpc error: code = NotFound desc = could not find container \"4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2\": container with ID starting with 4b5bc2707f707ac71d4e14f7edd68098bcc68c2df6b405681a0c88657e072ac2 not found: ID does not exist" Jul 13 18:10:16.737119 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.737098 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2"] Jul 13 18:10:16.739615 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:16.739594 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d09cc8-openshift-default-65b754b4c-2dck2"] Jul 13 18:10:17.277271 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:17.277238 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" path="/var/lib/kubelet/pods/6994becf-a7a1-4be4-9ed5-3cfaaff5d694/volumes" Jul 13 18:10:37.550040 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:37.550006 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6"] Jul 13 18:10:37.550446 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:37.550221 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" containerID="cri-o://add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb" gracePeriod=30 Jul 13 18:10:38.485816 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.485778 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66"] Jul 13 18:10:38.486500 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.486476 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" Jul 13 18:10:38.486500 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.486499 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" Jul 13 18:10:38.486638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.486523 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" Jul 13 18:10:38.486638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.486532 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" Jul 13 18:10:38.486638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.486611 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" Jul 13 18:10:38.486638 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.486624 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6994becf-a7a1-4be4-9ed5-3cfaaff5d694" containerName="istio-proxy" Jul 13 18:10:38.489732 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.489713 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.492112 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.492088 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a50684-openshift-default-dockercfg-8mpks\"" Jul 13 18:10:38.502692 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.502670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66"] Jul 13 18:10:38.583294 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.583256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-token\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.583802 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.583328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znmnw\" (UniqueName: \"kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-kube-api-access-znmnw\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.583802 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.583359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-envoy\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.583802 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.583436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-data\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.583802 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.583510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-podinfo\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.583802 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.583581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c964ff-a94d-4d26-913c-ad100ead88bd-istiod-ca-cert\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.583802 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.583614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-socket\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.583802 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.583657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-credential-socket\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.583802 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.583681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-certs\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.684588 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.684553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-credential-socket\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.684588 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.684589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-certs\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.684861 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.684611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-token\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.684861 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.684660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znmnw\" (UniqueName: \"kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-kube-api-access-znmnw\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.684861 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.684689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-envoy\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.684861 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.684723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-data\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.684861 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.684758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-podinfo\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.684861 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.684811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c964ff-a94d-4d26-913c-ad100ead88bd-istiod-ca-cert\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.684861 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.684844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-socket\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.685229 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.685046 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-certs\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.685229 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.685221 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-data\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.685343 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.685285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-socket\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.685400 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.685364 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-credential-socket\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.685715 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.685691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c964ff-a94d-4d26-913c-ad100ead88bd-istiod-ca-cert\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.687036 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.687010 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-envoy\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.687348 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.687327 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-podinfo\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.693521 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.693494 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-token\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.693671 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.693650 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znmnw\" (UniqueName: \"kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-kube-api-access-znmnw\") pod \"e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.799919 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.799827 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:38.938760 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.938730 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66"] Jul 13 18:10:38.940346 ip-10-0-142-186 kubenswrapper[2581]: W0713 18:10:38.940322 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c964ff_a94d_4d26_913c_ad100ead88bd.slice/crio-9fc5ca68ff8b5867084e16bfff306be7efce5622d5604afd67a49bbf1419d54d WatchSource:0}: Error finding container 9fc5ca68ff8b5867084e16bfff306be7efce5622d5604afd67a49bbf1419d54d: Status 404 returned error can't find the container with id 9fc5ca68ff8b5867084e16bfff306be7efce5622d5604afd67a49bbf1419d54d Jul 13 18:10:38.942727 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.942694 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:10:38.942806 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.942758 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:10:38.942806 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:38.942786 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:10:39.837326 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:39.837287 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" event={"ID":"43c964ff-a94d-4d26-913c-ad100ead88bd","Type":"ContainerStarted","Data":"8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0"} Jul 13 18:10:39.837850 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:39.837348 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" event={"ID":"43c964ff-a94d-4d26-913c-ad100ead88bd","Type":"ContainerStarted","Data":"9fc5ca68ff8b5867084e16bfff306be7efce5622d5604afd67a49bbf1419d54d"} Jul 13 18:10:39.859976 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:39.859925 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" podStartSLOduration=1.859908968 podStartE2EDuration="1.859908968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:10:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:10:39.858846115 +0000 UTC m=+2319.002183188" watchObservedRunningTime="2026-07-13 18:10:39.859908968 +0000 UTC m=+2319.003246112" Jul 13 18:10:40.799980 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:40.799939 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:40.804919 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:40.804896 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:40.847569 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:40.847535 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:40.848581 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:40.848559 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:41.861204 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:41.861171 2581 patch_prober.go:28] interesting pod/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 18:10:41.861698 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:41.861259 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 18:10:42.811204 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.811140 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:10:42.859688 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.859648 2581 generic.go:356] "Generic (PLEG): container finished" podID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerID="add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb" exitCode=0 Jul 13 18:10:42.859872 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.859695 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" event={"ID":"76c32bc2-b6b4-4e9f-adc9-a5ac80380032","Type":"ContainerDied","Data":"add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb"} Jul 13 18:10:42.859872 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.859704 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" Jul 13 18:10:42.859872 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.859749 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6" event={"ID":"76c32bc2-b6b4-4e9f-adc9-a5ac80380032","Type":"ContainerDied","Data":"d99ecc6576ed39c5938a1d6ec22a5e3388b2522d54a688230a9213848929636b"} Jul 13 18:10:42.859872 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.859778 2581 scope.go:117] "RemoveContainer" containerID="add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb" Jul 13 18:10:42.868516 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.868497 2581 scope.go:117] "RemoveContainer" containerID="eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14" Jul 13 18:10:42.876358 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.876343 2581 scope.go:117] "RemoveContainer" containerID="add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb" Jul 13 18:10:42.876679 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:10:42.876660 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb\": container with ID starting with add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb not found: ID does not exist" containerID="add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb" Jul 13 18:10:42.876747 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.876687 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb"} err="failed to get container status \"add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb\": rpc error: code = NotFound desc = could not find container \"add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb\": container with ID starting with add4b769bba9b14f61e5c69419eda1baa45b893e3c13084eb289945fe8d761bb not found: ID does not exist" Jul 13 18:10:42.876747 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.876704 2581 scope.go:117] "RemoveContainer" containerID="eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14" Jul 13 18:10:42.876911 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:10:42.876894 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14\": container with ID starting with eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14 not found: ID does not exist" containerID="eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14" Jul 13 18:10:42.876958 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.876917 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14"} err="failed to get container status \"eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14\": rpc error: code = NotFound desc = could not find container \"eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14\": container with ID starting with eab3a3ffb6eef7041af9bc00f5ebf65c24142207f6fe5de49113b8922ef06d14 not found: ID does not exist" Jul 13 18:10:42.924243 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924209 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istiod-ca-cert\") pod \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " Jul 13 18:10:42.924394 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924247 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-podinfo\") pod \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " Jul 13 18:10:42.924394 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924299 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-socket\") pod \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " Jul 13 18:10:42.924394 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924342 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-data\") pod \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " Jul 13 18:10:42.924394 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924378 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-certs\") pod \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " Jul 13 18:10:42.924662 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924417 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-token\") pod \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " Jul 13 18:10:42.924662 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924499 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-credential-socket\") pod \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " Jul 13 18:10:42.924662 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924523 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckwx5\" (UniqueName: \"kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-kube-api-access-ckwx5\") pod \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " Jul 13 18:10:42.924662 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924606 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-envoy\") pod \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\" (UID: \"76c32bc2-b6b4-4e9f-adc9-a5ac80380032\") " Jul 13 18:10:42.924857 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924692 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76c32bc2-b6b4-4e9f-adc9-a5ac80380032" (UID: "76c32bc2-b6b4-4e9f-adc9-a5ac80380032"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:10:42.924857 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924802 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76c32bc2-b6b4-4e9f-adc9-a5ac80380032" (UID: "76c32bc2-b6b4-4e9f-adc9-a5ac80380032"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:42.924951 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924859 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76c32bc2-b6b4-4e9f-adc9-a5ac80380032" (UID: "76c32bc2-b6b4-4e9f-adc9-a5ac80380032"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:42.924951 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.924881 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:42.925240 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.925208 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76c32bc2-b6b4-4e9f-adc9-a5ac80380032" (UID: "76c32bc2-b6b4-4e9f-adc9-a5ac80380032"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:42.925790 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.925753 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-data" (OuterVolumeSpecName: "istio-data") pod "76c32bc2-b6b4-4e9f-adc9-a5ac80380032" (UID: "76c32bc2-b6b4-4e9f-adc9-a5ac80380032"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:42.926648 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.926625 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76c32bc2-b6b4-4e9f-adc9-a5ac80380032" (UID: "76c32bc2-b6b4-4e9f-adc9-a5ac80380032"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 18:10:42.926820 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.926795 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76c32bc2-b6b4-4e9f-adc9-a5ac80380032" (UID: "76c32bc2-b6b4-4e9f-adc9-a5ac80380032"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:42.926925 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.926907 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-kube-api-access-ckwx5" (OuterVolumeSpecName: "kube-api-access-ckwx5") pod "76c32bc2-b6b4-4e9f-adc9-a5ac80380032" (UID: "76c32bc2-b6b4-4e9f-adc9-a5ac80380032"). InnerVolumeSpecName "kube-api-access-ckwx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:10:42.927085 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:42.927055 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-token" (OuterVolumeSpecName: "istio-token") pod "76c32bc2-b6b4-4e9f-adc9-a5ac80380032" (UID: "76c32bc2-b6b4-4e9f-adc9-a5ac80380032"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:10:43.025583 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.025514 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:43.025583 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.025549 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:43.025583 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.025562 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:43.025583 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.025577 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:43.025583 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.025590 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckwx5\" (UniqueName: \"kubernetes.io/projected/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-kube-api-access-ckwx5\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:43.025583 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.025604 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:43.025583 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.025616 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:43.026341 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.025640 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76c32bc2-b6b4-4e9f-adc9-a5ac80380032-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:10:43.185168 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.185135 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6"] Jul 13 18:10:43.190641 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.190603 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-dc368b-openshift-default-6d449479f5-dr2s6"] Jul 13 18:10:43.277880 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:43.277846 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" path="/var/lib/kubelet/pods/76c32bc2-b6b4-4e9f-adc9-a5ac80380032/volumes" Jul 13 18:10:47.264301 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.264258 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn"] Jul 13 18:10:47.265408 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.265381 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" Jul 13 18:10:47.265594 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.265571 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" Jul 13 18:10:47.265740 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.265726 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" Jul 13 18:10:47.270481 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.270433 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn"] Jul 13 18:10:47.270596 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.270565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.273307 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.273284 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b8e947-openshift-default-dockercfg-4xl55\"" Jul 13 18:10:47.464922 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.464885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-podinfo\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.464922 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.464926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c54zz\" (UniqueName: \"kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-kube-api-access-c54zz\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.465325 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.464966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-certs\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.465325 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.464998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-socket\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.465325 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.465015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-credential-socket\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.465325 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.465064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-data\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.465325 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.465100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istiod-ca-cert\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.465325 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.465129 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-envoy\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.465325 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.465148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-token\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566049 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.565958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-podinfo\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566049 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.565998 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c54zz\" (UniqueName: \"kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-kube-api-access-c54zz\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566049 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566019 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-certs\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566049 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-socket\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566408 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-credential-socket\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566408 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566223 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-data\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566408 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istiod-ca-cert\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566408 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-envoy\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566408 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-token\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566682 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566410 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-certs\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566682 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566444 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-socket\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566682 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566519 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-credential-socket\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566682 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566642 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-data\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.566940 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.566922 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istiod-ca-cert\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.568374 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.568355 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-envoy\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.568526 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.568509 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-podinfo\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.574304 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.574277 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c54zz\" (UniqueName: \"kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-kube-api-access-c54zz\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.574448 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.574431 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-token\") pod \"e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.583453 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.583433 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:47.757869 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.757841 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn"] Jul 13 18:10:47.759349 ip-10-0-142-186 kubenswrapper[2581]: W0713 18:10:47.759322 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7cdeb8_d831_4abd_89b7_dbf185eefbf7.slice/crio-71da518101d4017a06d853d0509dad184eb2bf84c67dc258197b48fff8763c2b WatchSource:0}: Error finding container 71da518101d4017a06d853d0509dad184eb2bf84c67dc258197b48fff8763c2b: Status 404 returned error can't find the container with id 71da518101d4017a06d853d0509dad184eb2bf84c67dc258197b48fff8763c2b Jul 13 18:10:47.761446 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.761416 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:10:47.761546 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.761511 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:10:47.761614 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.761542 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:10:47.888951 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.888910 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" event={"ID":"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7","Type":"ContainerStarted","Data":"fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57"} Jul 13 18:10:47.889123 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.888978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" event={"ID":"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7","Type":"ContainerStarted","Data":"71da518101d4017a06d853d0509dad184eb2bf84c67dc258197b48fff8763c2b"} Jul 13 18:10:47.909327 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:47.909270 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" podStartSLOduration=0.909255595 podStartE2EDuration="909.255595ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:10:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:10:47.908150267 +0000 UTC m=+2327.051487340" watchObservedRunningTime="2026-07-13 18:10:47.909255595 +0000 UTC m=+2327.052592669" Jul 13 18:10:48.583619 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:48.583588 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:48.588501 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:48.588477 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:48.895146 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:48.895110 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:48.896154 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:48.896136 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:10:53.926579 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:53.926537 2581 generic.go:356] "Generic (PLEG): container finished" podID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerID="8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0" exitCode=0 Jul 13 18:10:53.927086 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:53.926610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" event={"ID":"43c964ff-a94d-4d26-913c-ad100ead88bd","Type":"ContainerDied","Data":"8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0"} Jul 13 18:10:53.927086 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:53.927077 2581 scope.go:117] "RemoveContainer" containerID="8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0" Jul 13 18:10:53.928189 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:53.928155 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:10:53.928276 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:53.928244 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:10:53.928316 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:53.928287 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:10:54.937416 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:54.937370 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" event={"ID":"43c964ff-a94d-4d26-913c-ad100ead88bd","Type":"ContainerStarted","Data":"2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab"} Jul 13 18:10:55.801034 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:55.800997 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:55.802253 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:55.802226 2581 patch_prober.go:28] interesting pod/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 13 18:10:55.802392 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:55.802284 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 13 18:10:55.847781 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:55.847745 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:56.800542 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:56.800484 2581 patch_prober.go:28] interesting pod/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 13 18:10:56.801020 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:56.800559 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 13 18:10:57.800648 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:57.800606 2581 patch_prober.go:28] interesting pod/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 13 18:10:57.801070 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:57.800668 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 13 18:10:58.804304 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:58.804276 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:10:58.805373 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:10:58.805349 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:11:09.015711 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:09.015678 2581 generic.go:356] "Generic (PLEG): container finished" podID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerID="fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57" exitCode=0 Jul 13 18:11:09.016102 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:09.015716 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" event={"ID":"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7","Type":"ContainerDied","Data":"fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57"} Jul 13 18:11:09.016102 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:09.016062 2581 scope.go:117] "RemoveContainer" containerID="fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57" Jul 13 18:11:09.017076 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:09.017049 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:11:09.017139 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:09.017126 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:11:09.017175 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:09.017162 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:11:10.022601 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:10.022563 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" event={"ID":"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7","Type":"ContainerStarted","Data":"219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d"} Jul 13 18:11:10.583906 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:10.583869 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:11:10.584086 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:10.583996 2581 patch_prober.go:28] interesting pod/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 13 18:11:10.584086 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:10.584039 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 13 18:11:11.583896 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:11.583860 2581 patch_prober.go:28] interesting pod/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 13 18:11:11.584308 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:11.583915 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 13 18:11:12.584779 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:12.584738 2581 patch_prober.go:28] interesting pod/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 13 18:11:12.585202 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:12.584798 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 13 18:11:13.584293 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:13.584259 2581 patch_prober.go:28] interesting pod/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 13 18:11:13.584601 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:13.584322 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 13 18:11:14.588302 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:14.588271 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:11:14.588816 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:14.588709 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:11:14.589419 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:14.589400 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:11:28.480695 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:28.480660 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66"] Jul 13 18:11:28.481179 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:28.480933 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" containerID="cri-o://2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab" gracePeriod=30 Jul 13 18:11:28.807424 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:28.807342 2581 patch_prober.go:28] interesting pod/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 18:11:28.807424 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:28.807398 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 18:11:33.739080 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.739057 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:11:33.891187 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891152 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c964ff-a94d-4d26-913c-ad100ead88bd-istiod-ca-cert\") pod \"43c964ff-a94d-4d26-913c-ad100ead88bd\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " Jul 13 18:11:33.891386 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891193 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-credential-socket\") pod \"43c964ff-a94d-4d26-913c-ad100ead88bd\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " Jul 13 18:11:33.891386 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891236 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-envoy\") pod \"43c964ff-a94d-4d26-913c-ad100ead88bd\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " Jul 13 18:11:33.891386 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891252 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-certs\") pod \"43c964ff-a94d-4d26-913c-ad100ead88bd\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " Jul 13 18:11:33.891386 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891275 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-data\") pod \"43c964ff-a94d-4d26-913c-ad100ead88bd\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " Jul 13 18:11:33.891386 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891333 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-socket\") pod \"43c964ff-a94d-4d26-913c-ad100ead88bd\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " Jul 13 18:11:33.891386 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891362 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-podinfo\") pod \"43c964ff-a94d-4d26-913c-ad100ead88bd\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " Jul 13 18:11:33.891743 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891405 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-token\") pod \"43c964ff-a94d-4d26-913c-ad100ead88bd\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " Jul 13 18:11:33.891743 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891434 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znmnw\" (UniqueName: \"kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-kube-api-access-znmnw\") pod \"43c964ff-a94d-4d26-913c-ad100ead88bd\" (UID: \"43c964ff-a94d-4d26-913c-ad100ead88bd\") " Jul 13 18:11:33.891743 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891545 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "43c964ff-a94d-4d26-913c-ad100ead88bd" (UID: "43c964ff-a94d-4d26-913c-ad100ead88bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:11:33.891743 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891554 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "43c964ff-a94d-4d26-913c-ad100ead88bd" (UID: "43c964ff-a94d-4d26-913c-ad100ead88bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:11:33.891743 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891714 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:11:33.891743 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891722 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "43c964ff-a94d-4d26-913c-ad100ead88bd" (UID: "43c964ff-a94d-4d26-913c-ad100ead88bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:11:33.892101 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891734 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:11:33.892101 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.891790 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43c964ff-a94d-4d26-913c-ad100ead88bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "43c964ff-a94d-4d26-913c-ad100ead88bd" (UID: "43c964ff-a94d-4d26-913c-ad100ead88bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:11:33.892353 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.892331 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "43c964ff-a94d-4d26-913c-ad100ead88bd" (UID: "43c964ff-a94d-4d26-913c-ad100ead88bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:11:33.893485 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.893444 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "43c964ff-a94d-4d26-913c-ad100ead88bd" (UID: "43c964ff-a94d-4d26-913c-ad100ead88bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:11:33.893617 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.893587 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "43c964ff-a94d-4d26-913c-ad100ead88bd" (UID: "43c964ff-a94d-4d26-913c-ad100ead88bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 18:11:33.894032 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.894004 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "43c964ff-a94d-4d26-913c-ad100ead88bd" (UID: "43c964ff-a94d-4d26-913c-ad100ead88bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:11:33.894123 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.894028 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-kube-api-access-znmnw" (OuterVolumeSpecName: "kube-api-access-znmnw") pod "43c964ff-a94d-4d26-913c-ad100ead88bd" (UID: "43c964ff-a94d-4d26-913c-ad100ead88bd"). InnerVolumeSpecName "kube-api-access-znmnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:11:33.993102 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.993052 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:11:33.993102 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.993097 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:11:33.993102 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.993109 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:11:33.993102 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.993117 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znmnw\" (UniqueName: \"kubernetes.io/projected/43c964ff-a94d-4d26-913c-ad100ead88bd-kube-api-access-znmnw\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:11:33.993390 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.993126 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43c964ff-a94d-4d26-913c-ad100ead88bd-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:11:33.993390 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.993134 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:11:33.993390 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:33.993142 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43c964ff-a94d-4d26-913c-ad100ead88bd-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:11:34.156709 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.156620 2581 generic.go:356] "Generic (PLEG): container finished" podID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerID="2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab" exitCode=0 Jul 13 18:11:34.156709 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.156668 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" Jul 13 18:11:34.156913 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.156705 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" event={"ID":"43c964ff-a94d-4d26-913c-ad100ead88bd","Type":"ContainerDied","Data":"2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab"} Jul 13 18:11:34.156913 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.156753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66" event={"ID":"43c964ff-a94d-4d26-913c-ad100ead88bd","Type":"ContainerDied","Data":"9fc5ca68ff8b5867084e16bfff306be7efce5622d5604afd67a49bbf1419d54d"} Jul 13 18:11:34.156913 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.156776 2581 scope.go:117] "RemoveContainer" containerID="2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab" Jul 13 18:11:34.165652 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.165545 2581 scope.go:117] "RemoveContainer" containerID="8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0" Jul 13 18:11:34.173324 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.173308 2581 scope.go:117] "RemoveContainer" containerID="2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab" Jul 13 18:11:34.173614 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:11:34.173595 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab\": container with ID starting with 2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab not found: ID does not exist" containerID="2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab" Jul 13 18:11:34.173684 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.173637 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab"} err="failed to get container status \"2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab\": rpc error: code = NotFound desc = could not find container \"2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab\": container with ID starting with 2effb33ccecdef5f81e41b5e8bb304a24d494a68b51506343bd4a091001bf2ab not found: ID does not exist" Jul 13 18:11:34.173684 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.173653 2581 scope.go:117] "RemoveContainer" containerID="8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0" Jul 13 18:11:34.173882 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:11:34.173864 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0\": container with ID starting with 8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0 not found: ID does not exist" containerID="8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0" Jul 13 18:11:34.173923 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.173888 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0"} err="failed to get container status \"8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0\": rpc error: code = NotFound desc = could not find container \"8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0\": container with ID starting with 8e14cadc72f88bd615f92bc238ea7e15c064f8de38b2ce57578983e4faa228b0 not found: ID does not exist" Jul 13 18:11:34.183012 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.182989 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66"] Jul 13 18:11:34.187611 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:34.187591 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a50684-openshift-default-77578fc7f5-7pw66"] Jul 13 18:11:35.277566 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:35.277528 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" path="/var/lib/kubelet/pods/43c964ff-a94d-4d26-913c-ad100ead88bd/volumes" Jul 13 18:11:54.660141 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:54.660107 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn"] Jul 13 18:11:54.660662 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:54.660355 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" containerID="cri-o://219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d" gracePeriod=30 Jul 13 18:11:55.599269 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.599231 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7"] Jul 13 18:11:55.599659 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.599642 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" Jul 13 18:11:55.599770 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.599661 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" Jul 13 18:11:55.599770 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.599672 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" Jul 13 18:11:55.599770 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.599680 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" Jul 13 18:11:55.599770 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.599689 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" Jul 13 18:11:55.599770 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.599697 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" Jul 13 18:11:55.600012 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.599783 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" Jul 13 18:11:55.600012 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.599799 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="76c32bc2-b6b4-4e9f-adc9-a5ac80380032" containerName="istio-proxy" Jul 13 18:11:55.602936 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.602915 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.605914 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.605895 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-a74fcd-openshift-default-dockercfg-qtl4w\"" Jul 13 18:11:55.615226 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.615199 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7"] Jul 13 18:11:55.670920 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.670888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-socket\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.670920 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.670918 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95206f58-4e54-42cf-a67d-03ecf1c868b1-istiod-ca-cert\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.671353 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.670938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-certs\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.671353 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.670997 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-data\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.671353 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.671034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-podinfo\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.671353 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.671073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-envoy\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.671353 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.671093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-token\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.671353 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.671129 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lvsq\" (UniqueName: \"kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-kube-api-access-8lvsq\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.671353 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.671231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-credential-socket\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772161 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-credential-socket\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772330 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-socket\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772330 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95206f58-4e54-42cf-a67d-03ecf1c868b1-istiod-ca-cert\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772330 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-certs\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772330 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-data\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772330 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-podinfo\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772668 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-envoy\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772668 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772408 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-token\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772668 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lvsq\" (UniqueName: \"kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-kube-api-access-8lvsq\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772668 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772629 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-credential-socket\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772924 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772779 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-data\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.772924 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.772789 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-socket\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.773022 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.773001 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-certs\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.773069 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.773059 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95206f58-4e54-42cf-a67d-03ecf1c868b1-istiod-ca-cert\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.774789 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.774765 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-envoy\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.774866 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.774842 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-podinfo\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.781154 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.781122 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-token\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.781329 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.781311 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lvsq\" (UniqueName: \"kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-kube-api-access-8lvsq\") pod \"e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:55.912958 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:55.912913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:56.055031 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:56.055002 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7"] Jul 13 18:11:56.055793 ip-10-0-142-186 kubenswrapper[2581]: W0713 18:11:56.055768 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95206f58_4e54_42cf_a67d_03ecf1c868b1.slice/crio-c4785adc3cc8a3779aae3027a709459551bf53d65c912dfa9edee130192feb97 WatchSource:0}: Error finding container c4785adc3cc8a3779aae3027a709459551bf53d65c912dfa9edee130192feb97: Status 404 returned error can't find the container with id c4785adc3cc8a3779aae3027a709459551bf53d65c912dfa9edee130192feb97 Jul 13 18:11:56.058141 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:56.058110 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:11:56.058224 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:56.058172 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:11:56.058224 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:56.058199 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:11:56.271907 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:56.271815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" event={"ID":"95206f58-4e54-42cf-a67d-03ecf1c868b1","Type":"ContainerStarted","Data":"41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e"} Jul 13 18:11:56.272157 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:56.272121 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" event={"ID":"95206f58-4e54-42cf-a67d-03ecf1c868b1","Type":"ContainerStarted","Data":"c4785adc3cc8a3779aae3027a709459551bf53d65c912dfa9edee130192feb97"} Jul 13 18:11:56.289965 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:56.289901 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" podStartSLOduration=1.289881542 podStartE2EDuration="1.289881542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:11:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:11:56.289849675 +0000 UTC m=+2395.433186760" watchObservedRunningTime="2026-07-13 18:11:56.289881542 +0000 UTC m=+2395.433218616" Jul 13 18:11:56.913342 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:56.913303 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:57.917966 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:57.917929 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:58.283995 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:58.283909 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:58.284963 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:58.284943 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:11:59.590919 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:59.590885 2581 patch_prober.go:28] interesting pod/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 18:11:59.591292 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:59.590940 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 18:11:59.913551 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:11:59.913526 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:12:00.009605 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009574 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-credential-socket\") pod \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " Jul 13 18:12:00.009814 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009618 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-socket\") pod \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " Jul 13 18:12:00.009814 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009682 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-data\") pod \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " Jul 13 18:12:00.009814 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009707 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-certs\") pod \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " Jul 13 18:12:00.009814 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009737 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c54zz\" (UniqueName: \"kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-kube-api-access-c54zz\") pod \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " Jul 13 18:12:00.009814 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009767 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-envoy\") pod \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " Jul 13 18:12:00.009814 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009797 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istiod-ca-cert\") pod \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " Jul 13 18:12:00.010138 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009830 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-token\") pod \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " Jul 13 18:12:00.010138 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009892 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" (UID: "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:12:00.010138 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009974 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-podinfo\") pod \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\" (UID: \"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7\") " Jul 13 18:12:00.010307 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.009971 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" (UID: "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:12:00.010307 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.010179 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" (UID: "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:12:00.010307 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.010273 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:12:00.010493 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.010405 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" (UID: "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:12:00.010655 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.010635 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" (UID: "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:12:00.012020 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.011993 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" (UID: "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:12:00.012020 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.011999 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" (UID: "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 18:12:00.012297 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.012276 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-kube-api-access-c54zz" (OuterVolumeSpecName: "kube-api-access-c54zz") pod "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" (UID: "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7"). InnerVolumeSpecName "kube-api-access-c54zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:12:00.012384 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.012298 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" (UID: "8b7cdeb8-d831-4abd-89b7-dbf185eefbf7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:12:00.111566 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.111527 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:12:00.111566 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.111562 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:12:00.111566 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.111571 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c54zz\" (UniqueName: \"kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-kube-api-access-c54zz\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:12:00.111902 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.111580 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:12:00.111902 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.111590 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:12:00.111902 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.111597 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:12:00.111902 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.111605 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:12:00.111902 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.111614 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:12:00.295147 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.295064 2581 generic.go:356] "Generic (PLEG): container finished" podID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerID="219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d" exitCode=0 Jul 13 18:12:00.295147 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.295112 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" Jul 13 18:12:00.295333 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.295151 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" event={"ID":"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7","Type":"ContainerDied","Data":"219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d"} Jul 13 18:12:00.295333 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.295204 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn" event={"ID":"8b7cdeb8-d831-4abd-89b7-dbf185eefbf7","Type":"ContainerDied","Data":"71da518101d4017a06d853d0509dad184eb2bf84c67dc258197b48fff8763c2b"} Jul 13 18:12:00.295333 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.295232 2581 scope.go:117] "RemoveContainer" containerID="219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d" Jul 13 18:12:00.304659 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.304643 2581 scope.go:117] "RemoveContainer" containerID="fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57" Jul 13 18:12:00.312864 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.312843 2581 scope.go:117] "RemoveContainer" containerID="219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d" Jul 13 18:12:00.313125 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:12:00.313103 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d\": container with ID starting with 219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d not found: ID does not exist" containerID="219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d" Jul 13 18:12:00.313205 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.313137 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d"} err="failed to get container status \"219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d\": rpc error: code = NotFound desc = could not find container \"219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d\": container with ID starting with 219206fc6c6c8bd258d1bb5f53660546abffd7ca5785cc86fe22257932023b1d not found: ID does not exist" Jul 13 18:12:00.313205 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.313163 2581 scope.go:117] "RemoveContainer" containerID="fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57" Jul 13 18:12:00.313413 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:12:00.313393 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57\": container with ID starting with fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57 not found: ID does not exist" containerID="fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57" Jul 13 18:12:00.313453 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.313420 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57"} err="failed to get container status \"fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57\": rpc error: code = NotFound desc = could not find container \"fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57\": container with ID starting with fda676ec377da194b0d3630cff81e6cf94e91f36db76cb5e4c8b1937d1234f57 not found: ID does not exist" Jul 13 18:12:00.318019 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.317997 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn"] Jul 13 18:12:00.322352 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:00.322332 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b8e947-openshift-default-68bc86f9ff-txqhn"] Jul 13 18:12:01.277101 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:01.277065 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" path="/var/lib/kubelet/pods/8b7cdeb8-d831-4abd-89b7-dbf185eefbf7/volumes" Jul 13 18:12:03.491149 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.491114 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q"] Jul 13 18:12:03.491533 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.491449 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" Jul 13 18:12:03.491533 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.491473 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" Jul 13 18:12:03.491533 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.491532 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c964ff-a94d-4d26-913c-ad100ead88bd" containerName="istio-proxy" Jul 13 18:12:03.491681 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.491541 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" Jul 13 18:12:03.491681 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.491548 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" Jul 13 18:12:03.495976 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.495954 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.498569 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.498541 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-762866-openshift-default-dockercfg-fm6wg\"" Jul 13 18:12:03.506568 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.506542 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q"] Jul 13 18:12:03.642740 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.642700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-socket\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.642922 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.642763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-credential-socket\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.642922 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.642807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lpfd\" (UniqueName: \"kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-kube-api-access-2lpfd\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.642922 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.642859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-token\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.642922 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.642885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-podinfo\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.642922 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.642913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bcf0144-6d43-4198-8558-7e8fc3602e32-istiod-ca-cert\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.643090 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.642953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-envoy\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.643090 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.643014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-certs\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.643090 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.643034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-data\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.743843 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.743744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-certs\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.743843 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.743780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-data\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.743843 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.743811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-socket\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.743843 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.743834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-credential-socket\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.744191 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.743853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lpfd\" (UniqueName: \"kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-kube-api-access-2lpfd\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.744191 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.743873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-token\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.744191 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.743892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-podinfo\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.744191 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.743910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bcf0144-6d43-4198-8558-7e8fc3602e32-istiod-ca-cert\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.744191 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.743951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-envoy\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.744501 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.744205 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-data\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.744501 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.744254 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-certs\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.744501 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.744382 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-socket\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.744679 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.744575 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-credential-socket\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.744905 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.744883 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bcf0144-6d43-4198-8558-7e8fc3602e32-istiod-ca-cert\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.746723 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.746698 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-envoy\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.747020 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.747000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-podinfo\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.752492 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.752437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lpfd\" (UniqueName: \"kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-kube-api-access-2lpfd\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.752589 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.752501 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-token\") pod \"e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.807688 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.807641 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:03.953949 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.953921 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q"] Jul 13 18:12:03.955734 ip-10-0-142-186 kubenswrapper[2581]: W0713 18:12:03.955706 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bcf0144_6d43_4198_8558_7e8fc3602e32.slice/crio-e623608c748160039f17f27cbfc83512b6cd5c4c4b3ac27856fb5acebd9a5147 WatchSource:0}: Error finding container e623608c748160039f17f27cbfc83512b6cd5c4c4b3ac27856fb5acebd9a5147: Status 404 returned error can't find the container with id e623608c748160039f17f27cbfc83512b6cd5c4c4b3ac27856fb5acebd9a5147 Jul 13 18:12:03.958031 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.957996 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:12:03.958127 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.958079 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:12:03.958127 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:03.958117 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:12:04.318557 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:04.318443 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" event={"ID":"4bcf0144-6d43-4198-8558-7e8fc3602e32","Type":"ContainerStarted","Data":"d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5"} Jul 13 18:12:04.318557 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:04.318514 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" event={"ID":"4bcf0144-6d43-4198-8558-7e8fc3602e32","Type":"ContainerStarted","Data":"e623608c748160039f17f27cbfc83512b6cd5c4c4b3ac27856fb5acebd9a5147"} Jul 13 18:12:04.339973 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:04.339907 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" podStartSLOduration=1.339891092 podStartE2EDuration="1.339891092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:12:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:12:04.338699738 +0000 UTC m=+2403.482036844" watchObservedRunningTime="2026-07-13 18:12:04.339891092 +0000 UTC m=+2403.483228165" Jul 13 18:12:04.808390 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:04.808355 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:05.813440 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:05.813400 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:06.340530 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:06.340501 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:06.344773 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:06.344740 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:11.381878 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:11.381848 2581 generic.go:356] "Generic (PLEG): container finished" podID="95206f58-4e54-42cf-a67d-03ecf1c868b1" containerID="41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e" exitCode=0 Jul 13 18:12:11.382248 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:11.381916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" event={"ID":"95206f58-4e54-42cf-a67d-03ecf1c868b1","Type":"ContainerDied","Data":"41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e"} Jul 13 18:12:11.382343 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:11.382323 2581 scope.go:117] "RemoveContainer" containerID="41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e" Jul 13 18:12:11.383262 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:11.383234 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:12:11.383360 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:11.383315 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:12:11.383421 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:11.383361 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:12:12.389190 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:12.389149 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" event={"ID":"95206f58-4e54-42cf-a67d-03ecf1c868b1","Type":"ContainerStarted","Data":"75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa"} Jul 13 18:12:12.913151 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:12.913114 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:12:12.914129 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:12.914106 2581 patch_prober.go:28] interesting pod/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 13 18:12:12.914206 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:12.914167 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" podUID="95206f58-4e54-42cf-a67d-03ecf1c868b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 13 18:12:13.284112 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:13.284014 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:12:13.913879 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:13.913843 2581 patch_prober.go:28] interesting pod/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 13 18:12:13.914264 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:13.913913 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" podUID="95206f58-4e54-42cf-a67d-03ecf1c868b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 13 18:12:14.914277 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:14.914238 2581 patch_prober.go:28] interesting pod/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 13 18:12:14.914702 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:14.914290 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" podUID="95206f58-4e54-42cf-a67d-03ecf1c868b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 13 18:12:15.914101 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:15.914058 2581 patch_prober.go:28] interesting pod/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Jul 13 18:12:15.914279 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:15.914121 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" podUID="95206f58-4e54-42cf-a67d-03ecf1c868b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Jul 13 18:12:16.917682 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:16.917645 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:12:16.918934 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:16.918912 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:12:19.427322 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:19.427289 2581 generic.go:356] "Generic (PLEG): container finished" podID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerID="d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5" exitCode=0 Jul 13 18:12:19.427881 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:19.427339 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" event={"ID":"4bcf0144-6d43-4198-8558-7e8fc3602e32","Type":"ContainerDied","Data":"d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5"} Jul 13 18:12:19.427881 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:19.427733 2581 scope.go:117] "RemoveContainer" containerID="d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5" Jul 13 18:12:19.428752 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:19.428723 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:12:19.428825 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:19.428789 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:12:19.428825 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:19.428820 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:12:20.437784 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:20.437741 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" event={"ID":"4bcf0144-6d43-4198-8558-7e8fc3602e32","Type":"ContainerStarted","Data":"6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d"} Jul 13 18:12:20.808679 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:20.808592 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:20.809725 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:20.809691 2581 patch_prober.go:28] interesting pod/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 13 18:12:20.809863 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:20.809741 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 13 18:12:21.340816 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:21.340774 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:21.808331 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:21.808292 2581 patch_prober.go:28] interesting pod/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 13 18:12:21.808771 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:21.808357 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 13 18:12:22.808544 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:22.808502 2581 patch_prober.go:28] interesting pod/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 13 18:12:22.808959 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:22.808563 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 13 18:12:23.808327 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:23.808288 2581 patch_prober.go:28] interesting pod/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 13 18:12:23.808553 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:23.808359 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 13 18:12:24.811858 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:24.811828 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:12:24.813045 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:12:24.813023 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:18:39.663167 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:39.663128 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7"] Jul 13 18:18:39.663630 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:39.663332 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" podUID="95206f58-4e54-42cf-a67d-03ecf1c868b1" containerName="istio-proxy" containerID="cri-o://75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa" gracePeriod=30 Jul 13 18:18:44.917387 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:44.917363 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:18:45.038226 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038136 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lvsq\" (UniqueName: \"kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-kube-api-access-8lvsq\") pod \"95206f58-4e54-42cf-a67d-03ecf1c868b1\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " Jul 13 18:18:45.038226 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038181 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-credential-socket\") pod \"95206f58-4e54-42cf-a67d-03ecf1c868b1\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " Jul 13 18:18:45.038226 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038213 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-envoy\") pod \"95206f58-4e54-42cf-a67d-03ecf1c868b1\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " Jul 13 18:18:45.038537 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038259 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-socket\") pod \"95206f58-4e54-42cf-a67d-03ecf1c868b1\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " Jul 13 18:18:45.038537 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038279 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95206f58-4e54-42cf-a67d-03ecf1c868b1-istiod-ca-cert\") pod \"95206f58-4e54-42cf-a67d-03ecf1c868b1\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " Jul 13 18:18:45.038537 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038308 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-certs\") pod \"95206f58-4e54-42cf-a67d-03ecf1c868b1\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " Jul 13 18:18:45.038537 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038331 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-podinfo\") pod \"95206f58-4e54-42cf-a67d-03ecf1c868b1\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " Jul 13 18:18:45.038537 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038368 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-data\") pod \"95206f58-4e54-42cf-a67d-03ecf1c868b1\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " Jul 13 18:18:45.038537 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038389 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-token\") pod \"95206f58-4e54-42cf-a67d-03ecf1c868b1\" (UID: \"95206f58-4e54-42cf-a67d-03ecf1c868b1\") " Jul 13 18:18:45.038537 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038424 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95206f58-4e54-42cf-a67d-03ecf1c868b1" (UID: "95206f58-4e54-42cf-a67d-03ecf1c868b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:18:45.038914 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038653 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95206f58-4e54-42cf-a67d-03ecf1c868b1" (UID: "95206f58-4e54-42cf-a67d-03ecf1c868b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:18:45.038914 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038808 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:18:45.038914 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038829 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:18:45.038914 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038786 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95206f58-4e54-42cf-a67d-03ecf1c868b1" (UID: "95206f58-4e54-42cf-a67d-03ecf1c868b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:18:45.039124 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.038955 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95206f58-4e54-42cf-a67d-03ecf1c868b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95206f58-4e54-42cf-a67d-03ecf1c868b1" (UID: "95206f58-4e54-42cf-a67d-03ecf1c868b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:18:45.039386 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.039365 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "95206f58-4e54-42cf-a67d-03ecf1c868b1" (UID: "95206f58-4e54-42cf-a67d-03ecf1c868b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:18:45.040578 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.040552 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "95206f58-4e54-42cf-a67d-03ecf1c868b1" (UID: "95206f58-4e54-42cf-a67d-03ecf1c868b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:18:45.040679 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.040601 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95206f58-4e54-42cf-a67d-03ecf1c868b1" (UID: "95206f58-4e54-42cf-a67d-03ecf1c868b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 18:18:45.040816 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.040796 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-kube-api-access-8lvsq" (OuterVolumeSpecName: "kube-api-access-8lvsq") pod "95206f58-4e54-42cf-a67d-03ecf1c868b1" (UID: "95206f58-4e54-42cf-a67d-03ecf1c868b1"). InnerVolumeSpecName "kube-api-access-8lvsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:18:45.040859 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.040817 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95206f58-4e54-42cf-a67d-03ecf1c868b1" (UID: "95206f58-4e54-42cf-a67d-03ecf1c868b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:18:45.139941 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.139897 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lvsq\" (UniqueName: \"kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-kube-api-access-8lvsq\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:18:45.139941 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.139936 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:18:45.139941 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.139946 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95206f58-4e54-42cf-a67d-03ecf1c868b1-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:18:45.139941 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.139953 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:18:45.140196 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.139962 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:18:45.140196 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.139970 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:18:45.140196 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.139977 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95206f58-4e54-42cf-a67d-03ecf1c868b1-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:18:45.399239 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.399209 2581 generic.go:356] "Generic (PLEG): container finished" podID="95206f58-4e54-42cf-a67d-03ecf1c868b1" containerID="75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa" exitCode=0 Jul 13 18:18:45.399438 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.399262 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" Jul 13 18:18:45.399438 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.399295 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" event={"ID":"95206f58-4e54-42cf-a67d-03ecf1c868b1","Type":"ContainerDied","Data":"75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa"} Jul 13 18:18:45.399438 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.399353 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7" event={"ID":"95206f58-4e54-42cf-a67d-03ecf1c868b1","Type":"ContainerDied","Data":"c4785adc3cc8a3779aae3027a709459551bf53d65c912dfa9edee130192feb97"} Jul 13 18:18:45.399438 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.399375 2581 scope.go:117] "RemoveContainer" containerID="75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa" Jul 13 18:18:45.408076 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.408057 2581 scope.go:117] "RemoveContainer" containerID="41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e" Jul 13 18:18:45.415432 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.415417 2581 scope.go:117] "RemoveContainer" containerID="75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa" Jul 13 18:18:45.415710 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:18:45.415686 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa\": container with ID starting with 75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa not found: ID does not exist" containerID="75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa" Jul 13 18:18:45.415808 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.415718 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa"} err="failed to get container status \"75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa\": rpc error: code = NotFound desc = could not find container \"75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa\": container with ID starting with 75b74343110a9cc498eabe47af5a6eacd8da07ef7976c27d60f2d9afc4bdf6fa not found: ID does not exist" Jul 13 18:18:45.415808 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.415741 2581 scope.go:117] "RemoveContainer" containerID="41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e" Jul 13 18:18:45.416040 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:18:45.416011 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e\": container with ID starting with 41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e not found: ID does not exist" containerID="41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e" Jul 13 18:18:45.416151 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.416039 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e"} err="failed to get container status \"41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e\": rpc error: code = NotFound desc = could not find container \"41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e\": container with ID starting with 41c33f9abf169ac088bb1024ed2441d003bf28bd9ea88d9cff090fe4a2e4cd2e not found: ID does not exist" Jul 13 18:18:45.418980 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.418959 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7"] Jul 13 18:18:45.422430 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:45.422411 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-a74fcd-openshift-default-7cd4c6c55f-4mvr7"] Jul 13 18:18:47.277675 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:18:47.277637 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95206f58-4e54-42cf-a67d-03ecf1c868b1" path="/var/lib/kubelet/pods/95206f58-4e54-42cf-a67d-03ecf1c868b1/volumes" Jul 13 18:19:05.859991 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:05.859952 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q"] Jul 13 18:19:05.860433 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:05.860156 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" containerID="cri-o://6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d" gracePeriod=30 Jul 13 18:19:09.814832 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:09.814796 2581 patch_prober.go:28] interesting pod/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 18:19:09.815219 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:09.814854 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 18:19:11.101715 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.101687 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:19:11.160198 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160126 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-token\") pod \"4bcf0144-6d43-4198-8558-7e8fc3602e32\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " Jul 13 18:19:11.160198 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160155 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-podinfo\") pod \"4bcf0144-6d43-4198-8558-7e8fc3602e32\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " Jul 13 18:19:11.160198 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160173 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-envoy\") pod \"4bcf0144-6d43-4198-8558-7e8fc3602e32\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " Jul 13 18:19:11.160198 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160194 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-certs\") pod \"4bcf0144-6d43-4198-8558-7e8fc3602e32\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " Jul 13 18:19:11.160529 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160217 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-credential-socket\") pod \"4bcf0144-6d43-4198-8558-7e8fc3602e32\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " Jul 13 18:19:11.160529 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160258 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-socket\") pod \"4bcf0144-6d43-4198-8558-7e8fc3602e32\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " Jul 13 18:19:11.160529 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160292 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lpfd\" (UniqueName: \"kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-kube-api-access-2lpfd\") pod \"4bcf0144-6d43-4198-8558-7e8fc3602e32\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " Jul 13 18:19:11.160529 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160308 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bcf0144-6d43-4198-8558-7e8fc3602e32-istiod-ca-cert\") pod \"4bcf0144-6d43-4198-8558-7e8fc3602e32\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " Jul 13 18:19:11.160529 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160330 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-data\") pod \"4bcf0144-6d43-4198-8558-7e8fc3602e32\" (UID: \"4bcf0144-6d43-4198-8558-7e8fc3602e32\") " Jul 13 18:19:11.160796 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160542 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4bcf0144-6d43-4198-8558-7e8fc3602e32" (UID: "4bcf0144-6d43-4198-8558-7e8fc3602e32"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:19:11.160796 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160609 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4bcf0144-6d43-4198-8558-7e8fc3602e32" (UID: "4bcf0144-6d43-4198-8558-7e8fc3602e32"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:19:11.160796 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160654 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-certs\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.160952 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.160824 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4bcf0144-6d43-4198-8558-7e8fc3602e32" (UID: "4bcf0144-6d43-4198-8558-7e8fc3602e32"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:19:11.161033 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.161008 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bcf0144-6d43-4198-8558-7e8fc3602e32-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4bcf0144-6d43-4198-8558-7e8fc3602e32" (UID: "4bcf0144-6d43-4198-8558-7e8fc3602e32"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:19:11.161380 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.161360 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-data" (OuterVolumeSpecName: "istio-data") pod "4bcf0144-6d43-4198-8558-7e8fc3602e32" (UID: "4bcf0144-6d43-4198-8558-7e8fc3602e32"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:19:11.162377 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.162352 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4bcf0144-6d43-4198-8558-7e8fc3602e32" (UID: "4bcf0144-6d43-4198-8558-7e8fc3602e32"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 18:19:11.162705 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.162689 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4bcf0144-6d43-4198-8558-7e8fc3602e32" (UID: "4bcf0144-6d43-4198-8558-7e8fc3602e32"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:19:11.162778 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.162734 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-token" (OuterVolumeSpecName: "istio-token") pod "4bcf0144-6d43-4198-8558-7e8fc3602e32" (UID: "4bcf0144-6d43-4198-8558-7e8fc3602e32"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:19:11.162778 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.162729 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-kube-api-access-2lpfd" (OuterVolumeSpecName: "kube-api-access-2lpfd") pod "4bcf0144-6d43-4198-8558-7e8fc3602e32" (UID: "4bcf0144-6d43-4198-8558-7e8fc3602e32"). InnerVolumeSpecName "kube-api-access-2lpfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:19:11.261438 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.261404 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-token\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.261438 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.261432 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-podinfo\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.261438 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.261442 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-envoy\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.261438 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.261450 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-credential-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.261726 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.261483 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-workload-socket\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.261726 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.261492 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lpfd\" (UniqueName: \"kubernetes.io/projected/4bcf0144-6d43-4198-8558-7e8fc3602e32-kube-api-access-2lpfd\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.261726 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.261503 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bcf0144-6d43-4198-8558-7e8fc3602e32-istiod-ca-cert\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.261726 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.261512 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bcf0144-6d43-4198-8558-7e8fc3602e32-istio-data\") on node \"ip-10-0-142-186.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.536822 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.536721 2581 generic.go:356] "Generic (PLEG): container finished" podID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerID="6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d" exitCode=0 Jul 13 18:19:11.536822 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.536794 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" Jul 13 18:19:11.537063 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.536811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" event={"ID":"4bcf0144-6d43-4198-8558-7e8fc3602e32","Type":"ContainerDied","Data":"6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d"} Jul 13 18:19:11.537063 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.536883 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q" event={"ID":"4bcf0144-6d43-4198-8558-7e8fc3602e32","Type":"ContainerDied","Data":"e623608c748160039f17f27cbfc83512b6cd5c4c4b3ac27856fb5acebd9a5147"} Jul 13 18:19:11.537063 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.536911 2581 scope.go:117] "RemoveContainer" containerID="6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d" Jul 13 18:19:11.545273 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.545251 2581 scope.go:117] "RemoveContainer" containerID="d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5" Jul 13 18:19:11.552537 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.552513 2581 scope.go:117] "RemoveContainer" containerID="6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d" Jul 13 18:19:11.552761 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:19:11.552744 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d\": container with ID starting with 6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d not found: ID does not exist" containerID="6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d" Jul 13 18:19:11.552822 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.552767 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d"} err="failed to get container status \"6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d\": rpc error: code = NotFound desc = could not find container \"6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d\": container with ID starting with 6f875087114a5e299d62a579ec72ef7a2c5f1d94f1d4cdfec825a6f87a76754d not found: ID does not exist" Jul 13 18:19:11.552822 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.552781 2581 scope.go:117] "RemoveContainer" containerID="d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5" Jul 13 18:19:11.553039 ip-10-0-142-186 kubenswrapper[2581]: E0713 18:19:11.553021 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5\": container with ID starting with d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5 not found: ID does not exist" containerID="d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5" Jul 13 18:19:11.553080 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.553045 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5"} err="failed to get container status \"d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5\": rpc error: code = NotFound desc = could not find container \"d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5\": container with ID starting with d4aa042ef08e3caf7be0d5c44ad795370c797793c877148215865afee0fa6bc5 not found: ID does not exist" Jul 13 18:19:11.558360 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.558337 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q"] Jul 13 18:19:11.562351 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:11.562327 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-762866-openshift-default-6847778fc9-7vx2q"] Jul 13 18:19:12.620880 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:12.620854 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59fbf78564-j5v6w_e062ab13-f3ca-4b66-b0b3-8ab1463cadf9/copy-manifests/0.log" Jul 13 18:19:12.628639 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:12.628619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59fbf78564-j5v6w_e062ab13-f3ca-4b66-b0b3-8ab1463cadf9/manager/0.log" Jul 13 18:19:13.277228 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:13.277190 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" path="/var/lib/kubelet/pods/4bcf0144-6d43-4198-8558-7e8fc3602e32/volumes" Jul 13 18:19:16.006543 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.006512 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7_4e120035-5b97-4586-b18f-95254b1feda7/util/0.log" Jul 13 18:19:16.013351 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.013323 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7_4e120035-5b97-4586-b18f-95254b1feda7/pull/0.log" Jul 13 18:19:16.019676 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.019658 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7_4e120035-5b97-4586-b18f-95254b1feda7/extract/0.log" Jul 13 18:19:16.141842 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.141813 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl_dd6ada0c-5cc7-4ad6-9a33-0dc39727f753/util/0.log" Jul 13 18:19:16.148964 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.148937 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl_dd6ada0c-5cc7-4ad6-9a33-0dc39727f753/pull/0.log" Jul 13 18:19:16.155740 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.155723 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl_dd6ada0c-5cc7-4ad6-9a33-0dc39727f753/extract/0.log" Jul 13 18:19:16.285932 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.285864 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74_09d0a432-d612-4133-a87c-d1bf7211327b/util/0.log" Jul 13 18:19:16.292758 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.292736 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74_09d0a432-d612-4133-a87c-d1bf7211327b/pull/0.log" Jul 13 18:19:16.299450 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.299432 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74_09d0a432-d612-4133-a87c-d1bf7211327b/extract/0.log" Jul 13 18:19:16.422655 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.422630 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c_aa4df473-1ca4-44e2-90f5-d85a1dd0f07f/util/0.log" Jul 13 18:19:16.429650 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.429630 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c_aa4df473-1ca4-44e2-90f5-d85a1dd0f07f/pull/0.log" Jul 13 18:19:16.436352 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.436333 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c_aa4df473-1ca4-44e2-90f5-d85a1dd0f07f/extract/0.log" Jul 13 18:19:16.701220 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.701187 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cn7rs_850bd3b3-e4ad-42a9-ba75-58f4e88c4b42/manager/0.log" Jul 13 18:19:16.829328 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:16.829292 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hnk62_fda05b06-14a2-4c43-b91c-0fe0e2b9a007/manager/0.log" Jul 13 18:19:17.107825 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:17.107799 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ncft8_bd425c14-cd10-49c1-b44e-0769ef30c9be/registry-server/0.log" Jul 13 18:19:17.252933 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:17.252896 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cmp48_d20f0275-d128-4fa9-b8d3-97d35bd496f5/manager/0.log" Jul 13 18:19:17.540196 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:17.540121 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-69mbt_7e3b21cf-50e4-488f-9714-becc149970db/manager/0.log" Jul 13 18:19:18.033307 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:18.033277 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-clf9h_c64d3bb9-12ba-4923-9268-f6b992045549/discovery/0.log" Jul 13 18:19:18.149722 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:18.149694 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc9d9cd-7xptx_bf59cf94-f50b-4b63-9501-9d816fb91673/kube-auth-proxy/0.log" Jul 13 18:19:19.243962 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:19.243935 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-ts7q8_96da07f3-96e2-413f-9b17-68fcc71034a0/main/0.log" Jul 13 18:19:19.366169 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:19.366136 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-c4qw5_aa297464-e533-4eca-bcf8-339c429bfeb1/main/0.log" Jul 13 18:19:27.253516 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:27.253484 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5ll5w_d1a5f0ed-3a5f-43ac-9443-5e51a5190b41/global-pull-secret-syncer/0.log" Jul 13 18:19:27.420261 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:27.420228 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9h2rs_53dbd180-faf7-4c7e-b53f-d97476cc88f4/konnectivity-agent/0.log" Jul 13 18:19:27.533129 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:27.533042 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-186.ec2.internal_065a773ad515b5bc840f4897c38a83d1/haproxy/0.log" Jul 13 18:19:31.769828 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:31.769798 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7_4e120035-5b97-4586-b18f-95254b1feda7/extract/0.log" Jul 13 18:19:31.795721 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:31.795697 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7_4e120035-5b97-4586-b18f-95254b1feda7/util/0.log" Jul 13 18:19:31.818906 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:31.818879 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lsbs7_4e120035-5b97-4586-b18f-95254b1feda7/pull/0.log" Jul 13 18:19:31.856661 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:31.856634 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl_dd6ada0c-5cc7-4ad6-9a33-0dc39727f753/extract/0.log" Jul 13 18:19:31.878779 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:31.878756 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl_dd6ada0c-5cc7-4ad6-9a33-0dc39727f753/util/0.log" Jul 13 18:19:31.902109 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:31.902083 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xlvbl_dd6ada0c-5cc7-4ad6-9a33-0dc39727f753/pull/0.log" Jul 13 18:19:31.937826 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:31.937798 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74_09d0a432-d612-4133-a87c-d1bf7211327b/extract/0.log" Jul 13 18:19:31.970613 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:31.970579 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74_09d0a432-d612-4133-a87c-d1bf7211327b/util/0.log" Jul 13 18:19:31.997325 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:31.997292 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fzz74_09d0a432-d612-4133-a87c-d1bf7211327b/pull/0.log" Jul 13 18:19:32.029077 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:32.028988 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c_aa4df473-1ca4-44e2-90f5-d85a1dd0f07f/extract/0.log" Jul 13 18:19:32.052137 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:32.052105 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c_aa4df473-1ca4-44e2-90f5-d85a1dd0f07f/util/0.log" Jul 13 18:19:32.074353 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:32.074329 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gcs6c_aa4df473-1ca4-44e2-90f5-d85a1dd0f07f/pull/0.log" Jul 13 18:19:32.628570 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:32.628535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cn7rs_850bd3b3-e4ad-42a9-ba75-58f4e88c4b42/manager/0.log" Jul 13 18:19:32.657547 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:32.657519 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hnk62_fda05b06-14a2-4c43-b91c-0fe0e2b9a007/manager/0.log" Jul 13 18:19:32.751874 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:32.751840 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ncft8_bd425c14-cd10-49c1-b44e-0769ef30c9be/registry-server/0.log" Jul 13 18:19:32.952185 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:32.952085 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cmp48_d20f0275-d128-4fa9-b8d3-97d35bd496f5/manager/0.log" Jul 13 18:19:33.078531 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:33.078496 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-69mbt_7e3b21cf-50e4-488f-9714-becc149970db/manager/0.log" Jul 13 18:19:35.299197 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:35.299168 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z9c5v_38087688-f1dc-42fd-a3b0-a704efd46107/node-exporter/0.log" Jul 13 18:19:35.322301 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:35.322269 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z9c5v_38087688-f1dc-42fd-a3b0-a704efd46107/kube-rbac-proxy/0.log" Jul 13 18:19:35.348108 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:35.348080 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z9c5v_38087688-f1dc-42fd-a3b0-a704efd46107/init-textfile/0.log" Jul 13 18:19:37.422676 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.422640 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5"] Jul 13 18:19:37.423057 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.422948 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" Jul 13 18:19:37.423057 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.422959 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" Jul 13 18:19:37.423057 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.422966 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" Jul 13 18:19:37.423057 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.422972 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" Jul 13 18:19:37.423057 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.422986 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95206f58-4e54-42cf-a67d-03ecf1c868b1" containerName="istio-proxy" Jul 13 18:19:37.423057 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.422992 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="95206f58-4e54-42cf-a67d-03ecf1c868b1" containerName="istio-proxy" Jul 13 18:19:37.423057 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.423000 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" Jul 13 18:19:37.423057 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.423004 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b7cdeb8-d831-4abd-89b7-dbf185eefbf7" containerName="istio-proxy" Jul 13 18:19:37.423316 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.423065 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="95206f58-4e54-42cf-a67d-03ecf1c868b1" containerName="istio-proxy" Jul 13 18:19:37.423316 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.423071 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" Jul 13 18:19:37.423316 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.423078 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bcf0144-6d43-4198-8558-7e8fc3602e32" containerName="istio-proxy" Jul 13 18:19:37.427495 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.427479 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.430164 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.430140 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nbr9z\"/\"default-dockercfg-svj4k\"" Jul 13 18:19:37.430292 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.430251 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbr9z\"/\"kube-root-ca.crt\"" Jul 13 18:19:37.430990 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.430972 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbr9z\"/\"openshift-service-ca.crt\"" Jul 13 18:19:37.435302 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.435276 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5"] Jul 13 18:19:37.474007 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.473978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-proc\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.474220 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.474019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqdt7\" (UniqueName: \"kubernetes.io/projected/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-kube-api-access-mqdt7\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.474220 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.474056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-podres\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.474220 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.474131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-sys\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.474220 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.474197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-lib-modules\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.574605 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.574570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-lib-modules\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.574605 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.574609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-proc\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.574873 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.574632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdt7\" (UniqueName: \"kubernetes.io/projected/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-kube-api-access-mqdt7\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.574873 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.574656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-podres\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.574873 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.574683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-sys\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.574873 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.574719 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-proc\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.574873 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.574747 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-sys\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.574873 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.574755 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-lib-modules\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.574873 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.574828 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-podres\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.583070 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.583040 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqdt7\" (UniqueName: \"kubernetes.io/projected/82b157c7-0191-4c79-8063-8e0fd0ccb9ee-kube-api-access-mqdt7\") pod \"perf-node-gather-daemonset-wldj5\" (UID: \"82b157c7-0191-4c79-8063-8e0fd0ccb9ee\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.739003 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.738921 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:37.869213 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:37.869188 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5"] Jul 13 18:19:37.871058 ip-10-0-142-186 kubenswrapper[2581]: W0713 18:19:37.871032 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod82b157c7_0191_4c79_8063_8e0fd0ccb9ee.slice/crio-5334a85e45c26a3b4a45a30ae338e7bc9979d79df5e8555872a9c391d3575a3e WatchSource:0}: Error finding container 5334a85e45c26a3b4a45a30ae338e7bc9979d79df5e8555872a9c391d3575a3e: Status 404 returned error can't find the container with id 5334a85e45c26a3b4a45a30ae338e7bc9979d79df5e8555872a9c391d3575a3e Jul 13 18:19:38.303853 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:38.303818 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6598c4f4c8-dxss5_525b843f-eaea-4a5e-9725-08be0b8f962c/console/0.log" Jul 13 18:19:38.351229 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:38.351195 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-p288b_71eba6d9-6eb1-4e21-a3a2-cd73a5a5be78/download-server/0.log" Jul 13 18:19:38.674928 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:38.674892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" event={"ID":"82b157c7-0191-4c79-8063-8e0fd0ccb9ee","Type":"ContainerStarted","Data":"af95d3fe2d600862d8bf8b6f9df687891e1b35611d395cd545878c2e2cdd499a"} Jul 13 18:19:38.675361 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:38.674941 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" event={"ID":"82b157c7-0191-4c79-8063-8e0fd0ccb9ee","Type":"ContainerStarted","Data":"5334a85e45c26a3b4a45a30ae338e7bc9979d79df5e8555872a9c391d3575a3e"} Jul 13 18:19:38.675361 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:38.674991 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:38.694303 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:38.694254 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" podStartSLOduration=1.694236819 podStartE2EDuration="1.694236819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:19:38.693124802 +0000 UTC m=+2857.836461876" watchObservedRunningTime="2026-07-13 18:19:38.694236819 +0000 UTC m=+2857.837573940" Jul 13 18:19:40.090380 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:40.090345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xrnds_dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99/dns/0.log" Jul 13 18:19:40.113626 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:40.113593 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xrnds_dd43cb07-d3fd-4fa8-b91f-f9ce5912bb99/kube-rbac-proxy/0.log" Jul 13 18:19:40.187397 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:40.187358 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zvkj2_379bbd4a-8b61-4fdd-b17b-e1e77e063c32/dns-node-resolver/0.log" Jul 13 18:19:40.733549 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:40.733505 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78fcd886cc-74ncv_fe541a74-b32a-411d-8c55-389759dee843/registry/0.log" Jul 13 18:19:40.759190 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:40.759167 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9gc6l_467e00ec-3e11-4c74-bde3-dc536c806ca5/node-ca/0.log" Jul 13 18:19:41.954840 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:41.954807 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-clf9h_c64d3bb9-12ba-4923-9268-f6b992045549/discovery/0.log" Jul 13 18:19:41.974614 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:41.974591 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc9d9cd-7xptx_bf59cf94-f50b-4b63-9501-9d816fb91673/kube-auth-proxy/0.log" Jul 13 18:19:42.889075 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:42.889035 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2fbmk_c9c07d18-f85a-422f-992c-dff31f06c5ae/serve-healthcheck-canary/0.log" Jul 13 18:19:43.590710 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:43.590676 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skflw_34deecc7-c772-4443-acff-dafaa5c2ee14/kube-rbac-proxy/0.log" Jul 13 18:19:43.612859 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:43.612830 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skflw_34deecc7-c772-4443-acff-dafaa5c2ee14/exporter/0.log" Jul 13 18:19:43.634756 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:43.634732 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skflw_34deecc7-c772-4443-acff-dafaa5c2ee14/extractor/0.log" Jul 13 18:19:44.689562 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:44.689536 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-wldj5" Jul 13 18:19:46.360591 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:46.360551 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59fbf78564-j5v6w_e062ab13-f3ca-4b66-b0b3-8ab1463cadf9/manager/0.log" Jul 13 18:19:46.381435 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:46.381409 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59fbf78564-j5v6w_e062ab13-f3ca-4b66-b0b3-8ab1463cadf9/copy-manifests/0.log" Jul 13 18:19:47.497346 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:47.497255 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-clf9h_c64d3bb9-12ba-4923-9268-f6b992045549/discovery/0.log" Jul 13 18:19:47.511716 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:47.511691 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc9d9cd-7xptx_bf59cf94-f50b-4b63-9501-9d816fb91673/kube-auth-proxy/0.log" Jul 13 18:19:47.898747 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:47.898714 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-kzrhv_b7b83f94-d1f9-41d4-ae86-37b41aeadcbc/openshift-lws-operator/0.log" Jul 13 18:19:49.066017 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:49.065983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-clf9h_c64d3bb9-12ba-4923-9268-f6b992045549/discovery/0.log" Jul 13 18:19:49.077413 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:49.077357 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc9d9cd-7xptx_bf59cf94-f50b-4b63-9501-9d816fb91673/kube-auth-proxy/0.log" Jul 13 18:19:52.829888 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:52.829854 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fmxf8_ff64bdec-6a35-4682-b14e-dea701370067/migrator/0.log" Jul 13 18:19:52.850153 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:52.850124 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fmxf8_ff64bdec-6a35-4682-b14e-dea701370067/graceful-termination/0.log" Jul 13 18:19:54.353253 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:54.353224 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m99k8_c59e5220-b40c-4200-8518-1245a923e31e/kube-multus-additional-cni-plugins/0.log" Jul 13 18:19:54.379374 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:54.379342 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m99k8_c59e5220-b40c-4200-8518-1245a923e31e/egress-router-binary-copy/0.log" Jul 13 18:19:54.403103 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:54.403073 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m99k8_c59e5220-b40c-4200-8518-1245a923e31e/cni-plugins/0.log" Jul 13 18:19:54.426572 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:54.426548 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m99k8_c59e5220-b40c-4200-8518-1245a923e31e/bond-cni-plugin/0.log" Jul 13 18:19:54.453129 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:54.453103 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m99k8_c59e5220-b40c-4200-8518-1245a923e31e/routeoverride-cni/0.log" Jul 13 18:19:54.482579 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:54.482554 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m99k8_c59e5220-b40c-4200-8518-1245a923e31e/whereabouts-cni-bincopy/0.log" Jul 13 18:19:54.507306 ip-10-0-142-186 kubenswrapper[2581]: I0713 18:19:54.507282 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m99k8_c59e5220-b40c-4200-8518-1245a923e31e/whereabouts-cni/0.log"